[2026-05-12T17:24:02.178193] Job 156356 queued by schedule:2026-05-12T17:24:00 Connection: Collistar (facebook) Sync template: Facebook Graph - Incremental Sync Queue class: foreground Procrastinate queue: kpiper Command: python facebook_graph_pipeline.py [2026-05-12T17:24:02.284623] Queued via Procrastinate as job 155207 (queue=kpiper, priority=50). [2026-05-12T17:24:03.531727] Starting job 156356 for connection Collistar (facebook) / sync template Facebook Graph - Incremental Sync (type=dlt) Resolved command: cd /srv/kpiper && python facebook_graph_pipeline.py Injected profile context env vars (tokens exported: 1). Pipeline env overrides applied: ENABLE_PAGE_INSIGHTS, ENABLE_PAGE_OBJECTS, ENABLE_PAGE_POSTS, ENABLE_PAGE_POST_ATTACHMENTS, ENABLE_PAGE_POST_INSIGHTS, PAGE_ID, PAGE_INSIGHTS_LOOKBACK_DAYS, POSTS_BATCH_SIZE, POSTS_LIMIT, POSTS_PAGINATION, POST_INCREMENTAL_LOOKBACK_DAYS, POST_INSIGHTS_LOOKBACK_DAYS, SOURCES__FACEBOOK_GRAPH_REST_API_SOURCE__ACCESS_TOKEN, SYNC_MODE Refreshed Meta Page Token at 2026-05-12T17:24:03.509003. Forced unbuffered Python output for child process. /usr/local/lib/python3.11/site-packages/dlt/pipeline/progress.py:27: UserWarning: psutil dependency is not installed and memory stats will not be available. Add psutil to your environment or pass dump_system_stats=False to disable this warning. return log() -------------------- Extract facebook_graph_rest_api_source -------------------- Resources: 0/5 (0.0%) | Time: 0.00s | Rate: 0.00/s -------------------- Extract facebook_graph_rest_api_source -------------------- Resources: 0/5 (0.0%) | Time: 0.37s | Rate: 0.00/s page_objects: 1 | Time: 0.00s | Rate: 99864.38/s -------------------- Extract facebook_graph_rest_api_source -------------------- Resources: 0/5 (0.0%) | Time: 0.38s | Rate: 0.00/s page_objects: 1 | Time: 0.00s | Rate: 285.91/s page_posts: 1 | Time: 0.00s | Rate: 116508.44/s -------------------- Extract facebook_graph_rest_api_source -------------------- Resources: 0/5 (0.0%) | Time: 0.38s | Rate: 0.00/s page_objects: 1 | Time: 0.01s | Rate: 122.78/s page_posts: 1 | Time: 0.00s | Rate: 214.81/s page_post_attachments: 1 | Time: 0.00s | Rate: 113359.57/s -------------------- Extract facebook_graph_rest_api_source -------------------- Resources: 0/5 (0.0%) | Time: 1.04s | Rate: 0.00/s page_objects: 1 | Time: 0.66s | Rate: 1.51/s page_posts: 1 | Time: 0.66s | Rate: 1.51/s page_post_attachments: 1 | Time: 0.66s | Rate: 1.52/s page_insight_values: 1 | Time: 0.00s | Rate: 95325.09/s -------------------- Extract facebook_graph_rest_api_source -------------------- Resources: 0/5 (0.0%) | Time: 9.30s | Rate: 0.00/s page_objects: 1 | Time: 8.93s | Rate: 0.11/s page_posts: 1 | Time: 8.92s | Rate: 0.11/s page_post_attachments: 1 | Time: 8.92s | Rate: 0.11/s page_insight_values: 1 | Time: 8.26s | Rate: 0.12/s page_post_insight_values: 1 | Time: 0.00s | Rate: 89240.51/s -------------------- Extract facebook_graph_rest_api_source -------------------- Resources: 3/5 (60.0%) | Time: 9.30s | Rate: 0.32/s page_objects: 1 | Time: 8.93s | Rate: 0.11/s page_posts: 1 | Time: 8.93s | Rate: 0.11/s page_post_attachments: 1 | Time: 8.92s | Rate: 0.11/s page_insight_values: 24 | Time: 8.27s | Rate: 2.90/s page_post_insight_values: 23 | Time: 0.01s | Rate: 4319.96/s insight_fetch_skips: 1 | Time: 0.00s | Rate: 83886.08/s -------------------- Extract facebook_graph_rest_api_source -------------------- Resources: 4/5 (80.0%) | Time: 11.95s | Rate: 0.33/s page_objects: 1 | Time: 11.58s | Rate: 0.09/s page_posts: 1 | Time: 11.58s | Rate: 0.09/s page_post_attachments: 1 | Time: 11.57s | Rate: 0.09/s page_insight_values: 34 | Time: 10.92s | Rate: 3.11/s page_post_insight_values: 23 | Time: 2.65s | Rate: 8.66/s insight_fetch_skips: 8 | Time: 2.65s | Rate: 3.02/s -------------------- Extract facebook_graph_rest_api_source -------------------- Resources: 4/5 (80.0%) | Time: 13.75s | Rate: 0.29/s page_objects: 1 | Time: 13.37s | Rate: 0.07/s page_posts: 1 | Time: 13.37s | Rate: 0.07/s page_post_attachments: 1 | Time: 13.37s | Rate: 0.07/s page_insight_values: 66 | Time: 12.71s | Rate: 5.19/s page_post_insight_values: 23 | Time: 4.45s | Rate: 5.17/s insight_fetch_skips: 9 | Time: 4.44s | Rate: 2.03/s -------------------- Extract facebook_graph_rest_api_source -------------------- Resources: 5/5 (100.0%) | Time: 13.77s | Rate: 0.36/s page_objects: 1 | Time: 13.39s | Rate: 0.07/s page_posts: 1 | Time: 13.39s | Rate: 0.07/s page_post_attachments: 1 | Time: 13.38s | Rate: 0.07/s page_insight_values: 66 | Time: 12.73s | Rate: 5.19/s page_post_insight_values: 23 | Time: 4.47s | Rate: 5.15/s insight_fetch_skips: 15 | Time: 4.46s | Rate: 3.36/s -------------------- Extract facebook_graph_rest_api_source -------------------- Resources: 0/1 (0.0%) | Time: 0.00s | Rate: 0.00/s -------------------- Extract facebook_graph_rest_api_source -------------------- Resources: 0/1 (0.0%) | Time: 0.01s | Rate: 0.00/s _dlt_pipeline_state: 1 | Time: 0.00s | Rate: 23563.51/s -------------------- Extract facebook_graph_rest_api_source -------------------- Resources: 1/1 (100.0%) | Time: 0.02s | Rate: 53.12/s _dlt_pipeline_state: 1 | Time: 0.01s | Rate: 74.10/s -------- Normalize facebook_graph_rest_api_source in 1778606648.6896727 -------- Files: 0/7 (0.0%) | Time: 0.00s | Rate: 0.00/s -------- Normalize facebook_graph_rest_api_source in 1778606648.6896727 -------- Files: 0/7 (0.0%) | Time: 0.03s | Rate: 0.00/s page_objects: 0 | Time: 0.00s | Rate: 0.00/s -------- Normalize facebook_graph_rest_api_source in 1778606648.6896727 -------- Files: 1/7 (14.3%) | Time: 0.03s | Rate: 31.41/s page_objects: 1 | Time: 0.01s | Rate: 157.69/s page_posts: 0 | Time: 0.00s | Rate: 0.00/s -------- Normalize facebook_graph_rest_api_source in 1778606648.6896727 -------- Files: 2/7 (28.6%) | Time: 0.04s | Rate: 56.12/s page_objects: 1 | Time: 0.01s | Rate: 98.59/s page_posts: 1 | Time: 0.00s | Rate: 262.44/s page_post_attachments: 0 | Time: 0.00s | Rate: 0.00/s -------- Normalize facebook_graph_rest_api_source in 1778606648.6896727 -------- Files: 3/7 (42.9%) | Time: 0.04s | Rate: 74.49/s page_objects: 1 | Time: 0.01s | Rate: 67.66/s page_posts: 1 | Time: 0.01s | Rate: 118.40/s page_post_attachments: 1 | Time: 0.00s | Rate: 215.45/s page_insight_values: 0 | Time: 0.00s | Rate: 0.00/s -------- Normalize facebook_graph_rest_api_source in 1778606648.6896727 -------- Files: 4/7 (57.1%) | Time: 0.06s | Rate: 70.33/s page_objects: 1 | Time: 0.03s | Rate: 31.87/s page_posts: 1 | Time: 0.03s | Rate: 39.93/s page_post_attachments: 1 | Time: 0.02s | Rate: 47.08/s page_insight_values: 66 | Time: 0.02s | Rate: 3974.27/s page_post_insight_values: 0 | Time: 0.00s | Rate: 0.00/s -------- Normalize facebook_graph_rest_api_source in 1778606648.6896727 -------- Files: 5/7 (71.4%) | Time: 0.07s | Rate: 72.41/s page_objects: 1 | Time: 0.04s | Rate: 22.96/s page_posts: 1 | Time: 0.04s | Rate: 26.86/s page_post_attachments: 1 | Time: 0.03s | Rate: 29.92/s page_insight_values: 66 | Time: 0.03s | Rate: 2292.65/s page_post_insight_values: 23 | Time: 0.01s | Rate: 1886.78/s insight_fetch_skips: 0 | Time: 0.00s | Rate: 0.00/s -------- Normalize facebook_graph_rest_api_source in 1778606648.6896727 -------- Files: 6/7 (85.7%) | Time: 0.08s | Rate: 78.99/s page_objects: 1 | Time: 0.05s | Rate: 19.82/s page_posts: 1 | Time: 0.04s | Rate: 22.66/s page_post_attachments: 1 | Time: 0.04s | Rate: 24.80/s page_insight_values: 66 | Time: 0.04s | Rate: 1849.11/s page_post_insight_values: 23 | Time: 0.02s | Rate: 1204.48/s insight_fetch_skips: 15 | Time: 0.01s | Rate: 2169.99/s _dlt_pipeline_state: 0 | Time: 0.00s | Rate: 0.00/s 2026-05-12 17:24:22,664|[WARNING]|3370|140019563488000|dlt|validate.py|verify_normalized_table:113|In schema `facebook_graph_rest_api_source`: The following columns in table 'page_insight_values' did not receive any data during this load and therefore could not have their types inferred: - post_attachment_types_csv - post_created_time - post_id - post_status_type - value_boolean - value_json Unless type hints are provided, these columns will not be materialized in the destination. One way to provide type hints is to use the 'columns' argument in the '@dlt.resource' decorator. For example: @dlt.resource(columns={'post_attachment_types_csv': {'data_type': 'text'}}) 2026-05-12 17:24:22,664|[WARNING]|3370|140019563488000|dlt|validate.py|verify_normalized_table:113|In schema `facebook_graph_rest_api_source`: The following columns in table 'page_post_insight_values' did not receive any data during this load and therefore could not have their types inferred: - requested_period - value_boolean - value_json Unless type hints are provided, these columns will not be materialized in the destination. One way to provide type hints is to use the 'columns' argument in the '@dlt.resource' decorator. For example: @dlt.resource(columns={'requested_period': {'data_type': 'text'}}) -------- Normalize facebook_graph_rest_api_source in 1778606648.6896727 -------- Files: 7/7 (100.0%) | Time: 0.09s | Rate: 78.86/s page_objects: 1 | Time: 0.06s | Rate: 15.80/s page_posts: 1 | Time: 0.06s | Rate: 17.56/s page_post_attachments: 1 | Time: 0.05s | Rate: 18.82/s page_insight_values: 66 | Time: 0.05s | Rate: 1360.80/s page_post_insight_values: 23 | Time: 0.03s | Rate: 720.92/s insight_fetch_skips: 15 | Time: 0.02s | Rate: 760.63/s _dlt_pipeline_state: 1 | Time: 0.01s | Rate: 78.04/s ---------- Load facebook_graph_rest_api_source in 1778606648.6896727 ----------- Jobs: 0/7 (0.0%) | Time: 0.00s | Rate: 0.00/s ---------- Load facebook_graph_rest_api_source in 1778606648.6896727 ----------- Jobs: 9/12 (75.0%) | Time: 2.02s | Rate: 4.45/s ---------- Load facebook_graph_rest_api_source in 1778606648.6896727 ----------- Jobs: 10/12 (83.3%) | Time: 4.38s | Rate: 2.28/s ---------- Load facebook_graph_rest_api_source in 1778606648.6896727 ----------- Jobs: 11/12 (91.7%) | Time: 11.29s | Rate: 0.97/s ---------- Load facebook_graph_rest_api_source in 1778606648.6896727 ----------- Jobs: 12/12 (100.0%) | Time: 11.33s | Rate: 1.06/s Pipeline facebook_graph_pipeline load step completed in 11.33 seconds 1 load package(s) were loaded to destination postgres and into dataset facebook_graph The postgres destination used postgresql://kpiper_dlt_app:***@[/cloudsql/pacelab-487114:europe-west4:pacelab-pg18-ew4]:5432/kpiper_data location to store data Load package 1778606648.6896727 is LOADED and contains no failed jobs [2026-05-12T17:24:34.606097] Command completed successfully. [2026-05-12T17:24:34.606394] Pipeline status payload: {"backfill_complete": true, "backfill_progress_mode": "incremental", "page_id": "104320356067875", "sync_mode": "incremental"}