[2026-05-12T20:14:01.577806] Job 156617 queued by schedule:2026-05-12T20:14:00
Connection: ferrariraces (instagram)
Sync template: Instagram Graph - Incremental Metrics Refresh
Queue class: background
Procrastinate queue: kpiper-background
Command: python instagram_graph_pipeline.py
[2026-05-12T20:14:01.679733] Queued via Procrastinate as job 155468 (queue=kpiper-background, priority=10).
[2026-05-12T20:14:03.098612] Starting job 156617 for connection ferrariraces (instagram) / sync template Instagram Graph - Incremental Metrics Refresh (type=dlt)
Resolved command: cd /srv/kpiper && python instagram_graph_pipeline.py
Injected profile context env vars (tokens exported: 1).
Pipeline env overrides applied: DOWNLOAD_ASSETS, ENABLE_ACCOUNT_OBJECTS, ENABLE_ASSETS, ENABLE_COMMENTS, ENABLE_CONTENT_PUBLISHING_LIMITS, ENABLE_MEDIA_CHILD_OBJECTS, ENABLE_MEDIA_INSIGHTS, ENABLE_MEDIA_OBJECTS, ENABLE_STORY_INSIGHTS, ENABLE_STORY_OBJECTS, ENABLE_USER_INSIGHTS, ENABLE_WEBHOOK_SUBSCRIBED_APPS, IG_PAGE_ID, IG_USER_ID, MEDIA_INSIGHTS_LOOKBACK_DAYS, MEDIA_PAGINATION, SOURCES__INSTAGRAM_GRAPH_REST_API_SOURCE__ACCESS_TOKEN, SYNC_MODE
Refreshed Meta Page Token at 2026-05-12T20:14:03.076804.
Forced unbuffered Python output for child process.
/usr/local/lib/python3.11/site-packages/dlt/pipeline/progress.py:27: UserWarning: psutil dependency is not installed and memory stats will not be available. Add psutil to your environment or pass dump_system_stats=False to disable this warning.
  return log()
------------------- Extract instagram_graph_rest_api_source --------------------
Resources: 0/1 (0.0%) | Time: 0.00s | Rate: 0.00/s

------------------- Extract instagram_graph_rest_api_source --------------------
Resources: 0/1 (0.0%) | Time: 1.16s | Rate: 0.00/s
media_insight_values: 1  | Time: 0.00s | Rate: 95325.09/s

------------------- Extract instagram_graph_rest_api_source --------------------
Resources: 0/1 (0.0%) | Time: 2.48s | Rate: 0.00/s
media_insight_values: 13  | Time: 1.32s | Rate: 9.82/s

------------------- Extract instagram_graph_rest_api_source --------------------
Resources: 0/1 (0.0%) | Time: 4.04s | Rate: 0.00/s
media_insight_values: 19  | Time: 2.88s | Rate: 6.60/s

------------------- Extract instagram_graph_rest_api_source --------------------
Resources: 0/1 (0.0%) | Time: 5.67s | Rate: 0.00/s
media_insight_values: 34  | Time: 4.51s | Rate: 7.54/s

------------------- Extract instagram_graph_rest_api_source --------------------
Resources: 0/1 (0.0%) | Time: 7.07s | Rate: 0.00/s
media_insight_values: 46  | Time: 5.91s | Rate: 7.78/s

------------------- Extract instagram_graph_rest_api_source --------------------
Resources: 0/1 (0.0%) | Time: 8.29s | Rate: 0.00/s
media_insight_values: 52  | Time: 7.13s | Rate: 7.29/s

------------------- Extract instagram_graph_rest_api_source --------------------
Resources: 0/1 (0.0%) | Time: 10.01s | Rate: 0.00/s
media_insight_values: 64  | Time: 8.85s | Rate: 7.23/s

------------------- Extract instagram_graph_rest_api_source --------------------
Resources: 0/1 (0.0%) | Time: 12.31s | Rate: 0.00/s
media_insight_values: 79  | Time: 11.15s | Rate: 7.08/s

------------------- Extract instagram_graph_rest_api_source --------------------
Resources: 0/1 (0.0%) | Time: 14.43s | Rate: 0.00/s
media_insight_values: 94  | Time: 13.27s | Rate: 7.08/s

------------------- Extract instagram_graph_rest_api_source --------------------
Resources: 0/1 (0.0%) | Time: 16.35s | Rate: 0.00/s
media_insight_values: 103  | Time: 15.19s | Rate: 6.78/s

------------------- Extract instagram_graph_rest_api_source --------------------
Resources: 0/1 (0.0%) | Time: 17.61s | Rate: 0.00/s
media_insight_values: 112  | Time: 16.45s | Rate: 6.81/s

------------------- Extract instagram_graph_rest_api_source --------------------
Resources: 0/1 (0.0%) | Time: 19.43s | Rate: 0.00/s
media_insight_values: 124  | Time: 18.27s | Rate: 6.79/s

------------------- Extract instagram_graph_rest_api_source --------------------
Resources: 0/1 (0.0%) | Time: 20.58s | Rate: 0.00/s
media_insight_values: 136  | Time: 19.42s | Rate: 7.00/s

------------------- Extract instagram_graph_rest_api_source --------------------
Resources: 0/1 (0.0%) | Time: 21.74s | Rate: 0.00/s
media_insight_values: 148  | Time: 20.58s | Rate: 7.19/s

------------------- Extract instagram_graph_rest_api_source --------------------
Resources: 0/1 (0.0%) | Time: 23.35s | Rate: 0.00/s
media_insight_values: 163  | Time: 22.19s | Rate: 7.35/s

------------------- Extract instagram_graph_rest_api_source --------------------
Resources: 0/1 (0.0%) | Time: 25.12s | Rate: 0.00/s
media_insight_values: 169  | Time: 23.96s | Rate: 7.05/s

------------------- Extract instagram_graph_rest_api_source --------------------
Resources: 0/1 (0.0%) | Time: 26.51s | Rate: 0.00/s
media_insight_values: 184  | Time: 25.35s | Rate: 7.26/s

------------------- Extract instagram_graph_rest_api_source --------------------
Resources: 0/1 (0.0%) | Time: 28.09s | Rate: 0.00/s
media_insight_values: 202  | Time: 26.93s | Rate: 7.50/s

------------------- Extract instagram_graph_rest_api_source --------------------
Resources: 0/1 (0.0%) | Time: 29.58s | Rate: 0.00/s
media_insight_values: 217  | Time: 28.42s | Rate: 7.64/s

------------------- Extract instagram_graph_rest_api_source --------------------
Resources: 0/1 (0.0%) | Time: 31.19s | Rate: 0.00/s
media_insight_values: 232  | Time: 30.03s | Rate: 7.73/s

------------------- Extract instagram_graph_rest_api_source --------------------
Resources: 0/1 (0.0%) | Time: 32.79s | Rate: 0.00/s
media_insight_values: 247  | Time: 31.63s | Rate: 7.81/s

------------------- Extract instagram_graph_rest_api_source --------------------
Resources: 0/1 (0.0%) | Time: 34.02s | Rate: 0.00/s
media_insight_values: 262  | Time: 32.86s | Rate: 7.97/s

------------------- Extract instagram_graph_rest_api_source --------------------
Resources: 0/1 (0.0%) | Time: 35.52s | Rate: 0.00/s
media_insight_values: 280  | Time: 34.36s | Rate: 8.15/s

------------------- Extract instagram_graph_rest_api_source --------------------
Resources: 0/1 (0.0%) | Time: 36.85s | Rate: 0.00/s
media_insight_values: 292  | Time: 35.69s | Rate: 8.18/s

------------------- Extract instagram_graph_rest_api_source --------------------
Resources: 0/1 (0.0%) | Time: 38.27s | Rate: 0.00/s
media_insight_values: 310  | Time: 37.11s | Rate: 8.35/s

------------------- Extract instagram_graph_rest_api_source --------------------
Resources: 0/1 (0.0%) | Time: 39.98s | Rate: 0.00/s
media_insight_values: 325  | Time: 38.82s | Rate: 8.37/s

------------------- Extract instagram_graph_rest_api_source --------------------
Resources: 0/1 (0.0%) | Time: 41.05s | Rate: 0.00/s
media_insight_values: 334  | Time: 39.89s | Rate: 8.37/s

------------------- Extract instagram_graph_rest_api_source --------------------
Resources: 0/1 (0.0%) | Time: 44.33s | Rate: 0.00/s
media_insight_values: 349  | Time: 43.17s | Rate: 8.08/s

------------------- Extract instagram_graph_rest_api_source --------------------
Resources: 0/1 (0.0%) | Time: 45.50s | Rate: 0.00/s
media_insight_values: 364  | Time: 44.34s | Rate: 8.21/s

------------------- Extract instagram_graph_rest_api_source --------------------
Resources: 0/1 (0.0%) | Time: 58.08s | Rate: 0.00/s
media_insight_values: 370  | Time: 56.92s | Rate: 6.50/s

------------------- Extract instagram_graph_rest_api_source --------------------
Resources: 0/1 (0.0%) | Time: 60.05s | Rate: 0.00/s
media_insight_values: 379  | Time: 58.89s | Rate: 6.44/s

------------------- Extract instagram_graph_rest_api_source --------------------
Resources: 0/1 (0.0%) | Time: 62.06s | Rate: 0.00/s
media_insight_values: 394  | Time: 60.90s | Rate: 6.47/s

------------------- Extract instagram_graph_rest_api_source --------------------
Resources: 0/1 (0.0%) | Time: 64.28s | Rate: 0.00/s
media_insight_values: 409  | Time: 63.12s | Rate: 6.48/s

------------------- Extract instagram_graph_rest_api_source --------------------
Resources: 0/1 (0.0%) | Time: 65.36s | Rate: 0.00/s
media_insight_values: 421  | Time: 64.20s | Rate: 6.56/s

------------------- Extract instagram_graph_rest_api_source --------------------
Resources: 0/1 (0.0%) | Time: 66.94s | Rate: 0.00/s
media_insight_values: 433  | Time: 65.78s | Rate: 6.58/s

------------------- Extract instagram_graph_rest_api_source --------------------
Resources: 0/1 (0.0%) | Time: 68.36s | Rate: 0.00/s
media_insight_values: 439  | Time: 67.20s | Rate: 6.53/s

------------------- Extract instagram_graph_rest_api_source --------------------
Resources: 0/1 (0.0%) | Time: 69.86s | Rate: 0.00/s
media_insight_values: 454  | Time: 68.70s | Rate: 6.61/s

------------------- Extract instagram_graph_rest_api_source --------------------
Resources: 0/1 (0.0%) | Time: 71.80s | Rate: 0.00/s
media_insight_values: 466  | Time: 70.64s | Rate: 6.60/s

------------------- Extract instagram_graph_rest_api_source --------------------
Resources: 0/1 (0.0%) | Time: 74.01s | Rate: 0.00/s
media_insight_values: 481  | Time: 72.85s | Rate: 6.60/s

------------------- Extract instagram_graph_rest_api_source --------------------
Resources: 0/1 (0.0%) | Time: 76.07s | Rate: 0.00/s
media_insight_values: 493  | Time: 74.91s | Rate: 6.58/s

------------------- Extract instagram_graph_rest_api_source --------------------
Resources: 1/1 (100.0%) | Time: 76.89s | Rate: 0.01/s
media_insight_values: 504  | Time: 75.73s | Rate: 6.66/s

------- Normalize instagram_graph_rest_api_source in 1778616872.4462364 --------
Files: 0/1 (0.0%) | Time: 0.00s | Rate: 0.00/s

------- Normalize instagram_graph_rest_api_source in 1778616872.4462364 --------
Files: 0/1 (0.0%) | Time: 0.02s | Rate: 0.00/s
media_insight_values: 0  | Time: 0.00s | Rate: 0.00/s

------- Normalize instagram_graph_rest_api_source in 1778616872.4462364 --------
Files: 1/1 (100.0%) | Time: 0.14s | Rate: 7.40/s
media_insight_values: 504  | Time: 0.12s | Rate: 4343.46/s

---------- Load instagram_graph_rest_api_source in 1778616872.4462364 ----------
Jobs: 0/1 (0.0%) | Time: 0.00s | Rate: 0.00/s

---------- Load instagram_graph_rest_api_source in 1778616872.4462364 ----------
Jobs: 2/2 (100.0%) | Time: 0.33s | Rate: 6.06/s

Pipeline instagram_graph_pipeline load step completed in 0.33 seconds
1 load package(s) were loaded to destination postgres and into dataset instagram_graph
The postgres destination used postgresql://kpiper_dlt_app:***@[/cloudsql/pacelab-487114:europe-west4:pacelab-pg18-ew4]:5432/kpiper_data location to store data
Load package 1778616872.4462364 is LOADED and contains no failed jobs
[2026-05-12T20:15:50.423449] Command completed successfully.
[2026-05-12T20:15:50.423738] Pipeline status payload: {"backfill_complete": true, "backfill_progress_mode": "incremental", "ig_user_id": "17841412874410918", "sync_mode": "incremental"}