[2026-05-12T10:56:02.237440] Job 155800 queued by schedule:2026-05-12T10:56:00
Connection: Musei Ferrari (facebook)
Sync template: Facebook Graph - Incremental Sync
Queue class: foreground
Procrastinate queue: kpiper
Command: python facebook_graph_pipeline.py
[2026-05-12T10:56:02.336903] Queued via Procrastinate as job 154651 (queue=kpiper, priority=50).
[2026-05-12T11:17:54.279866] Starting job 155800 for connection Musei Ferrari (facebook) / sync template Facebook Graph - Incremental Sync (type=dlt)
Resolved command: cd /srv/kpiper && python facebook_graph_pipeline.py
Injected profile context env vars (tokens exported: 1).
Pipeline env overrides applied: ENABLE_PAGE_INSIGHTS, ENABLE_PAGE_OBJECTS, ENABLE_PAGE_POSTS, ENABLE_PAGE_POST_ATTACHMENTS, ENABLE_PAGE_POST_INSIGHTS, PAGE_ID, PAGE_INSIGHTS_LOOKBACK_DAYS, POSTS_BATCH_SIZE, POSTS_LIMIT, POSTS_PAGINATION, POST_INCREMENTAL_LOOKBACK_DAYS, POST_INSIGHTS_LOOKBACK_DAYS, SOURCES__FACEBOOK_GRAPH_REST_API_SOURCE__ACCESS_TOKEN, SYNC_MODE
Refreshed Meta Page Token at 2026-05-12T11:17:54.254660.
Forced unbuffered Python output for child process.
/usr/local/lib/python3.11/site-packages/dlt/pipeline/progress.py:27: UserWarning: psutil dependency is not installed and memory stats will not be available. Add psutil to your environment or pass dump_system_stats=False to disable this warning.
  return log()
-------------------- Extract facebook_graph_rest_api_source --------------------
Resources: 0/5 (0.0%) | Time: 0.00s | Rate: 0.00/s

-------------------- Extract facebook_graph_rest_api_source --------------------
Resources: 0/5 (0.0%) | Time: 0.30s | Rate: 0.00/s
page_objects: 1  | Time: 0.00s | Rate: 68759.08/s

-------------------- Extract facebook_graph_rest_api_source --------------------
Resources: 0/5 (0.0%) | Time: 0.30s | Rate: 0.00/s
page_objects: 1  | Time: 0.00s | Rate: 213.78/s
page_posts: 1  | Time: 0.00s | Rate: 91180.52/s

-------------------- Extract facebook_graph_rest_api_source --------------------
Resources: 0/5 (0.0%) | Time: 0.31s | Rate: 0.00/s
page_objects: 1  | Time: 0.01s | Rate: 114.34/s
page_posts: 1  | Time: 0.00s | Rate: 245.17/s
page_post_attachments: 1  | Time: 0.00s | Rate: 89240.51/s

-------------------- Extract facebook_graph_rest_api_source --------------------
Resources: 0/5 (0.0%) | Time: 0.84s | Rate: 0.00/s
page_objects: 1  | Time: 0.54s | Rate: 1.85/s
page_posts: 1  | Time: 0.54s | Rate: 1.87/s
page_post_attachments: 1  | Time: 0.53s | Rate: 1.88/s
page_insight_values: 1  | Time: 0.00s | Rate: 83886.08/s

-------------------- Extract facebook_graph_rest_api_source --------------------
Resources: 0/5 (0.0%) | Time: 13.83s | Rate: 0.00/s
page_objects: 1  | Time: 13.53s | Rate: 0.07/s
page_posts: 1  | Time: 13.53s | Rate: 0.07/s
page_post_attachments: 1  | Time: 13.52s | Rate: 0.07/s
page_insight_values: 1  | Time: 12.99s | Rate: 0.08/s
page_post_insight_values: 1  | Time: 0.00s | Rate: 20867.18/s

-------------------- Extract facebook_graph_rest_api_source --------------------
Resources: 3/5 (60.0%) | Time: 15.76s | Rate: 0.19/s
page_objects: 1  | Time: 15.46s | Rate: 0.06/s
page_posts: 6  | Time: 15.46s | Rate: 0.39/s
page_post_attachments: 14  | Time: 15.45s | Rate: 0.91/s
page_insight_values: 34  | Time: 14.92s | Rate: 2.28/s
page_post_insight_values: 33  | Time: 1.93s | Rate: 17.11/s

-------------------- Extract facebook_graph_rest_api_source --------------------
Resources: 3/5 (60.0%) | Time: 17.69s | Rate: 0.17/s
page_objects: 1  | Time: 17.39s | Rate: 0.06/s
page_posts: 6  | Time: 17.39s | Rate: 0.35/s
page_post_attachments: 14  | Time: 17.38s | Rate: 0.81/s
page_insight_values: 66  | Time: 16.85s | Rate: 3.92/s
page_post_insight_values: 66  | Time: 3.86s | Rate: 17.10/s
insight_fetch_skips: 1  | Time: 0.00s | Rate: 87381.33/s

-------------------- Extract facebook_graph_rest_api_source --------------------
Resources: 4/5 (80.0%) | Time: 18.80s | Rate: 0.21/s
page_objects: 1  | Time: 18.50s | Rate: 0.05/s
page_posts: 6  | Time: 18.49s | Rate: 0.32/s
page_post_attachments: 14  | Time: 18.49s | Rate: 0.76/s
page_insight_values: 66  | Time: 17.96s | Rate: 3.68/s
page_post_insight_values: 105  | Time: 4.97s | Rate: 21.14/s
insight_fetch_skips: 7  | Time: 1.11s | Rate: 6.33/s

-------------------- Extract facebook_graph_rest_api_source --------------------
Resources: 4/5 (80.0%) | Time: 19.88s | Rate: 0.20/s
page_objects: 1  | Time: 19.58s | Rate: 0.05/s
page_posts: 6  | Time: 19.57s | Rate: 0.31/s
page_post_attachments: 14  | Time: 19.57s | Rate: 0.72/s
page_insight_values: 66  | Time: 19.04s | Rate: 3.47/s
page_post_insight_values: 151  | Time: 6.05s | Rate: 24.97/s
insight_fetch_skips: 7  | Time: 2.19s | Rate: 3.20/s

-------------------- Extract facebook_graph_rest_api_source --------------------
Resources: 4/5 (80.0%) | Time: 20.92s | Rate: 0.19/s
page_objects: 1  | Time: 20.62s | Rate: 0.05/s
page_posts: 6  | Time: 20.62s | Rate: 0.29/s
page_post_attachments: 14  | Time: 20.61s | Rate: 0.68/s
page_insight_values: 66  | Time: 20.08s | Rate: 3.29/s
page_post_insight_values: 197  | Time: 7.09s | Rate: 27.78/s
insight_fetch_skips: 7  | Time: 3.23s | Rate: 2.17/s

-------------------- Extract facebook_graph_rest_api_source --------------------
Resources: 4/5 (80.0%) | Time: 22.16s | Rate: 0.18/s
page_objects: 1  | Time: 21.86s | Rate: 0.05/s
page_posts: 6  | Time: 21.85s | Rate: 0.27/s
page_post_attachments: 14  | Time: 21.85s | Rate: 0.64/s
page_insight_values: 66  | Time: 21.32s | Rate: 3.10/s
page_post_insight_values: 247  | Time: 8.33s | Rate: 29.66/s
insight_fetch_skips: 7  | Time: 4.47s | Rate: 1.57/s

-------------------- Extract facebook_graph_rest_api_source --------------------
Resources: 4/5 (80.0%) | Time: 23.38s | Rate: 0.17/s
page_objects: 1  | Time: 23.09s | Rate: 0.04/s
page_posts: 6  | Time: 23.08s | Rate: 0.26/s
page_post_attachments: 14  | Time: 23.08s | Rate: 0.61/s
page_insight_values: 66  | Time: 22.55s | Rate: 2.93/s
page_post_insight_values: 293  | Time: 9.56s | Rate: 30.66/s
insight_fetch_skips: 7  | Time: 5.70s | Rate: 1.23/s

-------------------- Extract facebook_graph_rest_api_source --------------------
Resources: 4/5 (80.0%) | Time: 24.54s | Rate: 0.16/s
page_objects: 1  | Time: 24.24s | Rate: 0.04/s
page_posts: 6  | Time: 24.24s | Rate: 0.25/s
page_post_attachments: 14  | Time: 24.24s | Rate: 0.58/s
page_insight_values: 66  | Time: 23.70s | Rate: 2.78/s
page_post_insight_values: 352  | Time: 10.71s | Rate: 32.86/s
insight_fetch_skips: 7  | Time: 6.85s | Rate: 1.02/s

-------------------- Extract facebook_graph_rest_api_source --------------------
Resources: 4/5 (80.0%) | Time: 25.58s | Rate: 0.16/s
page_objects: 1  | Time: 25.28s | Rate: 0.04/s
page_posts: 6  | Time: 25.27s | Rate: 0.24/s
page_post_attachments: 14  | Time: 25.27s | Rate: 0.55/s
page_insight_values: 66  | Time: 24.74s | Rate: 2.67/s
page_post_insight_values: 398  | Time: 11.75s | Rate: 33.88/s
insight_fetch_skips: 7  | Time: 7.89s | Rate: 0.89/s

-------------------- Extract facebook_graph_rest_api_source --------------------
Resources: 4/5 (80.0%) | Time: 26.61s | Rate: 0.15/s
page_objects: 1  | Time: 26.31s | Rate: 0.04/s
page_posts: 6  | Time: 26.30s | Rate: 0.23/s
page_post_attachments: 14  | Time: 26.30s | Rate: 0.53/s
page_insight_values: 66  | Time: 25.77s | Rate: 2.56/s
page_post_insight_values: 444  | Time: 12.78s | Rate: 34.75/s
insight_fetch_skips: 7  | Time: 8.92s | Rate: 0.78/s

-------------------- Extract facebook_graph_rest_api_source --------------------
Resources: 4/5 (80.0%) | Time: 27.80s | Rate: 0.14/s
page_objects: 1  | Time: 27.50s | Rate: 0.04/s
page_posts: 6  | Time: 27.50s | Rate: 0.22/s
page_post_attachments: 14  | Time: 27.49s | Rate: 0.51/s
page_insight_values: 66  | Time: 26.96s | Rate: 2.45/s
page_post_insight_values: 490  | Time: 13.97s | Rate: 35.07/s
insight_fetch_skips: 7  | Time: 10.11s | Rate: 0.69/s

-------------------- Extract facebook_graph_rest_api_source --------------------
Resources: 4/5 (80.0%) | Time: 29.38s | Rate: 0.14/s
page_objects: 1  | Time: 29.08s | Rate: 0.03/s
page_posts: 6  | Time: 29.07s | Rate: 0.21/s
page_post_attachments: 14  | Time: 29.07s | Rate: 0.48/s
page_insight_values: 66  | Time: 28.54s | Rate: 2.31/s
page_post_insight_values: 563  | Time: 15.55s | Rate: 36.21/s
insight_fetch_skips: 7  | Time: 11.69s | Rate: 0.60/s

-------------------- Extract facebook_graph_rest_api_source --------------------
Resources: 4/5 (80.0%) | Time: 30.53s | Rate: 0.13/s
page_objects: 1  | Time: 30.24s | Rate: 0.03/s
page_posts: 6  | Time: 30.23s | Rate: 0.20/s
page_post_attachments: 14  | Time: 30.23s | Rate: 0.46/s
page_insight_values: 66  | Time: 29.69s | Rate: 2.22/s
page_post_insight_values: 614  | Time: 16.70s | Rate: 36.76/s
insight_fetch_skips: 7  | Time: 12.84s | Rate: 0.54/s

-------------------- Extract facebook_graph_rest_api_source --------------------
Resources: 4/5 (80.0%) | Time: 31.71s | Rate: 0.13/s
page_objects: 1  | Time: 31.41s | Rate: 0.03/s
page_posts: 6  | Time: 31.40s | Rate: 0.19/s
page_post_attachments: 14  | Time: 31.40s | Rate: 0.45/s
page_insight_values: 66  | Time: 30.87s | Rate: 2.14/s
page_post_insight_values: 669  | Time: 17.88s | Rate: 37.42/s
insight_fetch_skips: 7  | Time: 14.02s | Rate: 0.50/s

-------------------- Extract facebook_graph_rest_api_source --------------------
Resources: 5/5 (100.0%) | Time: 32.71s | Rate: 0.15/s
page_objects: 1  | Time: 32.41s | Rate: 0.03/s
page_posts: 6  | Time: 32.41s | Rate: 0.19/s
page_post_attachments: 14  | Time: 32.40s | Rate: 0.43/s
page_insight_values: 66  | Time: 31.87s | Rate: 2.07/s
page_post_insight_values: 737  | Time: 18.88s | Rate: 39.03/s
insight_fetch_skips: 15  | Time: 15.02s | Rate: 1.00/s

-------------------- Extract facebook_graph_rest_api_source --------------------
Resources: 5/5 (100.0%) | Time: 32.73s | Rate: 0.15/s
page_objects: 1  | Time: 32.43s | Rate: 0.03/s
page_posts: 6  | Time: 32.42s | Rate: 0.19/s
page_post_attachments: 14  | Time: 32.42s | Rate: 0.43/s
page_insight_values: 66  | Time: 31.89s | Rate: 2.07/s
page_post_insight_values: 737  | Time: 18.90s | Rate: 39.00/s
insight_fetch_skips: 15  | Time: 15.04s | Rate: 1.00/s

-------------------- Extract facebook_graph_rest_api_source --------------------
Resources: 0/1 (0.0%) | Time: 0.00s | Rate: 0.00/s

-------------------- Extract facebook_graph_rest_api_source --------------------
Resources: 0/1 (0.0%) | Time: 0.00s | Rate: 0.00/s
_dlt_pipeline_state: 1  | Time: 0.00s | Rate: 149796.57/s

-------------------- Extract facebook_graph_rest_api_source --------------------
Resources: 1/1 (100.0%) | Time: 0.02s | Rate: 58.02/s
_dlt_pipeline_state: 1  | Time: 0.01s | Rate: 74.97/s

-------- Normalize facebook_graph_rest_api_source in 1778584683.4579537 --------
Files: 0/7 (0.0%) | Time: 0.00s | Rate: 0.00/s

-------- Normalize facebook_graph_rest_api_source in 1778584683.4579537 --------
Files: 0/7 (0.0%) | Time: 0.02s | Rate: 0.00/s
page_objects: 0  | Time: 0.00s | Rate: 0.00/s

-------- Normalize facebook_graph_rest_api_source in 1778584683.4579537 --------
Files: 1/7 (14.3%) | Time: 0.02s | Rate: 42.68/s
page_objects: 1  | Time: 0.01s | Rate: 174.39/s
page_posts: 0  | Time: 0.00s | Rate: 0.00/s

-------- Normalize facebook_graph_rest_api_source in 1778584683.4579537 --------
Files: 2/7 (28.6%) | Time: 0.03s | Rate: 66.44/s
page_objects: 1  | Time: 0.01s | Rate: 80.62/s
page_posts: 6  | Time: 0.01s | Rate: 898.59/s
page_post_attachments: 0  | Time: 0.00s | Rate: 0.00/s

-------- Normalize facebook_graph_rest_api_source in 1778584683.4579537 --------
Files: 3/7 (42.9%) | Time: 0.04s | Rate: 82.77/s
page_objects: 1  | Time: 0.02s | Rate: 53.92/s
page_posts: 6  | Time: 0.01s | Rate: 468.04/s
page_post_attachments: 14  | Time: 0.01s | Rate: 2276.60/s
page_insight_values: 0  | Time: 0.00s | Rate: 0.00/s

-------- Normalize facebook_graph_rest_api_source in 1778584683.4579537 --------
Files: 4/7 (57.1%) | Time: 0.05s | Rate: 78.75/s
page_objects: 1  | Time: 0.03s | Rate: 30.22/s
page_posts: 6  | Time: 0.03s | Rate: 219.25/s
page_post_attachments: 14  | Time: 0.02s | Rate: 676.45/s
page_insight_values: 66  | Time: 0.01s | Rate: 4534.53/s
page_post_insight_values: 0  | Time: 0.00s | Rate: 0.00/s

-------- Normalize facebook_graph_rest_api_source in 1778584683.4579537 --------
Files: 5/7 (71.4%) | Time: 0.22s | Rate: 22.22/s
page_objects: 1  | Time: 0.21s | Rate: 4.82/s
page_posts: 6  | Time: 0.20s | Rate: 29.77/s
page_post_attachments: 14  | Time: 0.19s | Rate: 71.83/s
page_insight_values: 66  | Time: 0.19s | Rate: 349.66/s
page_post_insight_values: 737  | Time: 0.17s | Rate: 4230.64/s
insight_fetch_skips: 0  | Time: 0.00s | Rate: 0.00/s

-------- Normalize facebook_graph_rest_api_source in 1778584683.4579537 --------
Files: 6/7 (85.7%) | Time: 0.23s | Rate: 26.04/s
page_objects: 1  | Time: 0.21s | Rate: 4.70/s
page_posts: 6  | Time: 0.21s | Rate: 28.99/s
page_post_attachments: 14  | Time: 0.20s | Rate: 69.89/s
page_insight_values: 66  | Time: 0.19s | Rate: 339.88/s
page_post_insight_values: 737  | Time: 0.18s | Rate: 4102.72/s
insight_fetch_skips: 15  | Time: 0.01s | Rate: 2758.08/s
_dlt_pipeline_state: 0  | Time: 0.00s | Rate: 0.00/s

2026-05-12 11:18:36,583|[WARNING]|70|140702192845568|dlt|validate.py|verify_normalized_table:113|In schema `facebook_graph_rest_api_source`: The following columns in table 'page_insight_values' did not receive any data during this load and therefore could not have their types inferred:
  - post_attachment_types_csv
  - post_created_time
  - post_id
  - post_status_type
  - value_boolean
  - value_json

Unless type hints are provided, these columns will not be materialized in the destination.
One way to provide type hints is to use the 'columns' argument in the '@dlt.resource' decorator.  For example:

@dlt.resource(columns={'post_attachment_types_csv': {'data_type': 'text'}})

2026-05-12 11:18:36,583|[WARNING]|70|140702192845568|dlt|validate.py|verify_normalized_table:113|In schema `facebook_graph_rest_api_source`: The following columns in table 'page_post_insight_values' did not receive any data during this load and therefore could not have their types inferred:
  - requested_period
  - value_boolean
  - value_json

Unless type hints are provided, these columns will not be materialized in the destination.
One way to provide type hints is to use the 'columns' argument in the '@dlt.resource' decorator.  For example:

@dlt.resource(columns={'requested_period': {'data_type': 'text'}})

-------- Normalize facebook_graph_rest_api_source in 1778584683.4579537 --------
Files: 7/7 (100.0%) | Time: 0.29s | Rate: 24.54/s
page_objects: 1  | Time: 0.27s | Rate: 3.74/s
page_posts: 6  | Time: 0.26s | Rate: 22.92/s
page_post_attachments: 14  | Time: 0.26s | Rate: 54.87/s
page_insight_values: 66  | Time: 0.25s | Rate: 265.07/s
page_post_insight_values: 737  | Time: 0.23s | Rate: 3143.65/s
insight_fetch_skips: 15  | Time: 0.06s | Rate: 248.99/s
_dlt_pipeline_state: 1  | Time: 0.05s | Rate: 18.24/s

---------- Load facebook_graph_rest_api_source in 1778584683.4579537 -----------
Jobs: 0/7 (0.0%) | Time: 0.00s | Rate: 0.00/s

---------- Load facebook_graph_rest_api_source in 1778584683.4579537 -----------
Jobs: 10/12 (83.3%) | Time: 3.65s | Rate: 2.74/s

---------- Load facebook_graph_rest_api_source in 1778584683.4579537 -----------
Jobs: 11/12 (91.7%) | Time: 11.66s | Rate: 0.94/s

---------- Load facebook_graph_rest_api_source in 1778584683.4579537 -----------
Jobs: 12/12 (100.0%) | Time: 11.70s | Rate: 1.03/s

Pipeline facebook_graph_pipeline load step completed in 11.70 seconds
1 load package(s) were loaded to destination postgres and into dataset facebook_graph
The postgres destination used postgresql://kpiper_dlt_app:***@[/cloudsql/pacelab-487114:europe-west4:pacelab-pg18-ew4]:5432/kpiper_data location to store data
Load package 1778584683.4579537 is LOADED and contains no failed jobs
[2026-05-12T11:18:48.963845] Command completed successfully.
[2026-05-12T11:18:48.964075] Pipeline status payload: {"backfill_complete": true, "backfill_progress_mode": "incremental", "page_id": "218187911525591", "sync_mode": "incremental"}