[2026-05-13T02:14:02.064658] Job 157050 queued by schedule:2026-05-13T02:14:00
Connection: ferrariraces (instagram)
Sync template: Instagram Graph - Incremental Metrics Refresh
Queue class: background
Procrastinate queue: kpiper-background
Command: python instagram_graph_pipeline.py
[2026-05-13T02:14:02.166716] Queued via Procrastinate as job 155901 (queue=kpiper-background, priority=10).
[2026-05-13T02:14:04.100312] Starting job 157050 for connection ferrariraces (instagram) / sync template Instagram Graph - Incremental Metrics Refresh (type=dlt)
Resolved command: cd /srv/kpiper && python instagram_graph_pipeline.py
Injected profile context env vars (tokens exported: 1).
Pipeline env overrides applied: DOWNLOAD_ASSETS, ENABLE_ACCOUNT_OBJECTS, ENABLE_ASSETS, ENABLE_COMMENTS, ENABLE_CONTENT_PUBLISHING_LIMITS, ENABLE_MEDIA_CHILD_OBJECTS, ENABLE_MEDIA_INSIGHTS, ENABLE_MEDIA_OBJECTS, ENABLE_STORY_INSIGHTS, ENABLE_STORY_OBJECTS, ENABLE_USER_INSIGHTS, ENABLE_WEBHOOK_SUBSCRIBED_APPS, IG_PAGE_ID, IG_USER_ID, MEDIA_INSIGHTS_LOOKBACK_DAYS, MEDIA_PAGINATION, SOURCES__INSTAGRAM_GRAPH_REST_API_SOURCE__ACCESS_TOKEN, SYNC_MODE
Refreshed Meta Page Token at 2026-05-13T02:14:04.077828.
Forced unbuffered Python output for child process.
/usr/local/lib/python3.11/site-packages/dlt/pipeline/progress.py:27: UserWarning: psutil dependency is not installed and memory stats will not be available. Add psutil to your environment or pass dump_system_stats=False to disable this warning.
  return log()
------------------- Extract instagram_graph_rest_api_source --------------------
Resources: 0/1 (0.0%) | Time: 0.00s | Rate: 0.00/s

------------------- Extract instagram_graph_rest_api_source --------------------
Resources: 0/1 (0.0%) | Time: 0.77s | Rate: 0.00/s
media_insight_values: 1  | Time: 0.00s | Rate: 87381.33/s

------------------- Extract instagram_graph_rest_api_source --------------------
Resources: 0/1 (0.0%) | Time: 1.82s | Rate: 0.00/s
media_insight_values: 13  | Time: 1.04s | Rate: 12.45/s

------------------- Extract instagram_graph_rest_api_source --------------------
Resources: 0/1 (0.0%) | Time: 3.58s | Rate: 0.00/s
media_insight_values: 28  | Time: 2.81s | Rate: 9.98/s

------------------- Extract instagram_graph_rest_api_source --------------------
Resources: 0/1 (0.0%) | Time: 4.94s | Rate: 0.00/s
media_insight_values: 40  | Time: 4.16s | Rate: 9.61/s

------------------- Extract instagram_graph_rest_api_source --------------------
Resources: 0/1 (0.0%) | Time: 6.50s | Rate: 0.00/s
media_insight_values: 52  | Time: 5.73s | Rate: 9.08/s

------------------- Extract instagram_graph_rest_api_source --------------------
Resources: 0/1 (0.0%) | Time: 8.28s | Rate: 0.00/s
media_insight_values: 64  | Time: 7.51s | Rate: 8.52/s

------------------- Extract instagram_graph_rest_api_source --------------------
Resources: 0/1 (0.0%) | Time: 11.42s | Rate: 0.00/s
media_insight_values: 79  | Time: 10.64s | Rate: 7.42/s

------------------- Extract instagram_graph_rest_api_source --------------------
Resources: 0/1 (0.0%) | Time: 13.29s | Rate: 0.00/s
media_insight_values: 94  | Time: 12.52s | Rate: 7.51/s

------------------- Extract instagram_graph_rest_api_source --------------------
Resources: 0/1 (0.0%) | Time: 15.03s | Rate: 0.00/s
media_insight_values: 112  | Time: 14.25s | Rate: 7.86/s

------------------- Extract instagram_graph_rest_api_source --------------------
Resources: 0/1 (0.0%) | Time: 16.36s | Rate: 0.00/s
media_insight_values: 124  | Time: 15.58s | Rate: 7.96/s

------------------- Extract instagram_graph_rest_api_source --------------------
Resources: 0/1 (0.0%) | Time: 17.74s | Rate: 0.00/s
media_insight_values: 136  | Time: 16.97s | Rate: 8.01/s

------------------- Extract instagram_graph_rest_api_source --------------------
Resources: 0/1 (0.0%) | Time: 18.88s | Rate: 0.00/s
media_insight_values: 148  | Time: 18.11s | Rate: 8.17/s

------------------- Extract instagram_graph_rest_api_source --------------------
Resources: 0/1 (0.0%) | Time: 20.12s | Rate: 0.00/s
media_insight_values: 154  | Time: 19.34s | Rate: 7.96/s

------------------- Extract instagram_graph_rest_api_source --------------------
Resources: 0/1 (0.0%) | Time: 21.90s | Rate: 0.00/s
media_insight_values: 169  | Time: 21.13s | Rate: 8.00/s

------------------- Extract instagram_graph_rest_api_source --------------------
Resources: 0/1 (0.0%) | Time: 24.61s | Rate: 0.00/s
media_insight_values: 184  | Time: 23.83s | Rate: 7.72/s

------------------- Extract instagram_graph_rest_api_source --------------------
Resources: 0/1 (0.0%) | Time: 26.17s | Rate: 0.00/s
media_insight_values: 202  | Time: 25.40s | Rate: 7.95/s

------------------- Extract instagram_graph_rest_api_source --------------------
Resources: 0/1 (0.0%) | Time: 27.89s | Rate: 0.00/s
media_insight_values: 217  | Time: 27.11s | Rate: 8.00/s

------------------- Extract instagram_graph_rest_api_source --------------------
Resources: 0/1 (0.0%) | Time: 29.36s | Rate: 0.00/s
media_insight_values: 232  | Time: 28.59s | Rate: 8.12/s

------------------- Extract instagram_graph_rest_api_source --------------------
Resources: 0/1 (0.0%) | Time: 30.93s | Rate: 0.00/s
media_insight_values: 247  | Time: 30.15s | Rate: 8.19/s

------------------- Extract instagram_graph_rest_api_source --------------------
Resources: 0/1 (0.0%) | Time: 32.63s | Rate: 0.00/s
media_insight_values: 262  | Time: 31.86s | Rate: 8.22/s

------------------- Extract instagram_graph_rest_api_source --------------------
Resources: 0/1 (0.0%) | Time: 34.11s | Rate: 0.00/s
media_insight_values: 280  | Time: 33.33s | Rate: 8.40/s

------------------- Extract instagram_graph_rest_api_source --------------------
Resources: 0/1 (0.0%) | Time: 35.18s | Rate: 0.00/s
media_insight_values: 286  | Time: 34.41s | Rate: 8.31/s

------------------- Extract instagram_graph_rest_api_source --------------------
Resources: 0/1 (0.0%) | Time: 36.35s | Rate: 0.00/s
media_insight_values: 292  | Time: 35.57s | Rate: 8.21/s

------------------- Extract instagram_graph_rest_api_source --------------------
Resources: 0/1 (0.0%) | Time: 38.46s | Rate: 0.00/s
media_insight_values: 310  | Time: 37.69s | Rate: 8.23/s

------------------- Extract instagram_graph_rest_api_source --------------------
Resources: 0/1 (0.0%) | Time: 39.90s | Rate: 0.00/s
media_insight_values: 325  | Time: 39.13s | Rate: 8.31/s

------------------- Extract instagram_graph_rest_api_source --------------------
Resources: 0/1 (0.0%) | Time: 41.32s | Rate: 0.00/s
media_insight_values: 343  | Time: 40.55s | Rate: 8.46/s

------------------- Extract instagram_graph_rest_api_source --------------------
Resources: 0/1 (0.0%) | Time: 43.07s | Rate: 0.00/s
media_insight_values: 358  | Time: 42.29s | Rate: 8.46/s

------------------- Extract instagram_graph_rest_api_source --------------------
Resources: 0/1 (0.0%) | Time: 44.86s | Rate: 0.00/s
media_insight_values: 370  | Time: 44.09s | Rate: 8.39/s

------------------- Extract instagram_graph_rest_api_source --------------------
Resources: 0/1 (0.0%) | Time: 46.39s | Rate: 0.00/s
media_insight_values: 388  | Time: 45.61s | Rate: 8.51/s

------------------- Extract instagram_graph_rest_api_source --------------------
Resources: 0/1 (0.0%) | Time: 48.16s | Rate: 0.00/s
media_insight_values: 400  | Time: 47.39s | Rate: 8.44/s

------------------- Extract instagram_graph_rest_api_source --------------------
Resources: 0/1 (0.0%) | Time: 49.79s | Rate: 0.00/s
media_insight_values: 415  | Time: 49.01s | Rate: 8.47/s

------------------- Extract instagram_graph_rest_api_source --------------------
Resources: 0/1 (0.0%) | Time: 51.68s | Rate: 0.00/s
media_insight_values: 427  | Time: 50.91s | Rate: 8.39/s

------------------- Extract instagram_graph_rest_api_source --------------------
Resources: 0/1 (0.0%) | Time: 53.97s | Rate: 0.00/s
media_insight_values: 439  | Time: 53.19s | Rate: 8.25/s

------------------- Extract instagram_graph_rest_api_source --------------------
Resources: 0/1 (0.0%) | Time: 55.44s | Rate: 0.00/s
media_insight_values: 454  | Time: 54.67s | Rate: 8.30/s

------------------- Extract instagram_graph_rest_api_source --------------------
Resources: 0/1 (0.0%) | Time: 57.29s | Rate: 0.00/s
media_insight_values: 466  | Time: 56.52s | Rate: 8.25/s

------------------- Extract instagram_graph_rest_api_source --------------------
Resources: 0/1 (0.0%) | Time: 58.99s | Rate: 0.00/s
media_insight_values: 481  | Time: 58.21s | Rate: 8.26/s

------------------- Extract instagram_graph_rest_api_source --------------------
Resources: 0/1 (0.0%) | Time: 60.78s | Rate: 0.00/s
media_insight_values: 493  | Time: 60.01s | Rate: 8.22/s

------------------- Extract instagram_graph_rest_api_source --------------------
Resources: 1/1 (100.0%) | Time: 61.68s | Rate: 0.02/s
media_insight_values: 504  | Time: 60.90s | Rate: 8.28/s

------- Normalize instagram_graph_rest_api_source in 1778638460.5039654 --------
Files: 0/1 (0.0%) | Time: 0.00s | Rate: 0.00/s

------- Normalize instagram_graph_rest_api_source in 1778638460.5039654 --------
Files: 0/1 (0.0%) | Time: 0.04s | Rate: 0.00/s
media_insight_values: 0  | Time: 0.00s | Rate: 0.00/s

------- Normalize instagram_graph_rest_api_source in 1778638460.5039654 --------
Files: 1/1 (100.0%) | Time: 0.15s | Rate: 6.60/s
media_insight_values: 504  | Time: 0.11s | Rate: 4387.71/s

---------- Load instagram_graph_rest_api_source in 1778638460.5039654 ----------
Jobs: 0/1 (0.0%) | Time: 0.00s | Rate: 0.00/s

---------- Load instagram_graph_rest_api_source in 1778638460.5039654 ----------
Jobs: 2/2 (100.0%) | Time: 0.34s | Rate: 5.82/s

Pipeline instagram_graph_pipeline load step completed in 0.34 seconds
1 load package(s) were loaded to destination postgres and into dataset instagram_graph
The postgres destination used postgresql://kpiper_dlt_app:***@[/cloudsql/pacelab-487114:europe-west4:pacelab-pg18-ew4]:5432/kpiper_data location to store data
Load package 1778638460.5039654 is LOADED and contains no failed jobs
[2026-05-13T02:15:23.383619] Command completed successfully.
[2026-05-13T02:15:23.383914] Pipeline status payload: {"backfill_complete": true, "backfill_progress_mode": "incremental", "ig_user_id": "17841412874410918", "sync_mode": "incremental"}