[2026-05-13T00:30:01.683595] Job 156979 queued by schedule:2026-05-13T00:30:00 Connection: barillaitalia (instagram) Sync template: Instagram Graph - Webhook Reconcile Queue class: foreground Procrastinate queue: kpiper Command: python instagram_graph_pipeline.py [2026-05-13T00:30:01.781839] Queued via Procrastinate as job 155830 (queue=kpiper, priority=50). [2026-05-13T04:46:20.839818] Starting job 156979 for connection barillaitalia (instagram) / sync template Instagram Graph - Webhook Reconcile (type=dlt) Resolved command: cd /srv/kpiper && python instagram_graph_pipeline.py Injected profile context env vars (tokens exported: 1). Pipeline env overrides applied: COMMENTS_MEDIA_LOOKBACK_DAYS, DOWNLOAD_ASSETS, ENABLE_ACCOUNT_OBJECTS, ENABLE_ASSETS, ENABLE_COMMENTS, ENABLE_COMMENT_REPLIES, ENABLE_CONTENT_PUBLISHING_LIMITS, ENABLE_MEDIA_CHILD_OBJECTS, ENABLE_MEDIA_INSIGHTS, ENABLE_MEDIA_OBJECTS, ENABLE_STORY_INSIGHTS, ENABLE_STORY_OBJECTS, ENABLE_USER_INSIGHTS, ENABLE_WEBHOOK_SUBSCRIBED_APPS, IG_PAGE_ID, IG_USER_ID, MEDIA_INCREMENTAL_LOOKBACK_DAYS, MEDIA_PAGINATION, SOURCES__INSTAGRAM_GRAPH_REST_API_SOURCE__ACCESS_TOKEN, SYNC_MODE Refreshed Meta Page Token at 2026-05-13T04:46:20.816463. Forced unbuffered Python output for child process. /usr/local/lib/python3.11/site-packages/dlt/pipeline/progress.py:27: UserWarning: psutil dependency is not installed and memory stats will not be available. Add psutil to your environment or pass dump_system_stats=False to disable this warning. return log() ------------------- Extract instagram_graph_rest_api_source -------------------- Resources: 0/2 (0.0%) | Time: 0.00s | Rate: 0.00/s ------------------- Extract instagram_graph_rest_api_source -------------------- Resources: 0/2 (0.0%) | Time: 0.00s | Rate: 0.00/s media_objects: 1 | Time: 0.00s | Rate: 91180.52/s ------------------- Extract instagram_graph_rest_api_source -------------------- Resources: 0/2 (0.0%) | Time: 0.64s | Rate: 0.00/s media_objects: 1 | Time: 0.64s | Rate: 1.57/s media_comments: 1 | Time: 0.00s | Rate: 82241.25/s ------------------- Extract instagram_graph_rest_api_source -------------------- Resources: 1/2 (50.0%) | Time: 2.48s | Rate: 0.40/s media_objects: 2 | Time: 2.47s | Rate: 0.81/s media_comments: 2 | Time: 1.83s | Rate: 1.09/s ------------------- Extract instagram_graph_rest_api_source -------------------- Resources: 1/2 (50.0%) | Time: 5.17s | Rate: 0.19/s media_objects: 2 | Time: 5.17s | Rate: 0.39/s media_comments: 5 | Time: 4.53s | Rate: 1.10/s ------------------- Extract instagram_graph_rest_api_source -------------------- Resources: 1/2 (50.0%) | Time: 7.32s | Rate: 0.14/s media_objects: 2 | Time: 7.32s | Rate: 0.27/s media_comments: 6 | Time: 6.68s | Rate: 0.90/s media_comment_replies: 1 | Time: 0.00s | Rate: 82241.25/s ------------------- Extract instagram_graph_rest_api_source -------------------- Resources: 1/2 (50.0%) | Time: 9.31s | Rate: 0.11/s media_objects: 2 | Time: 9.30s | Rate: 0.22/s media_comments: 6 | Time: 8.66s | Rate: 0.69/s media_comment_replies: 4 | Time: 1.98s | Rate: 2.02/s ------------------- Extract instagram_graph_rest_api_source -------------------- Resources: 1/2 (50.0%) | Time: 11.14s | Rate: 0.09/s media_objects: 2 | Time: 11.14s | Rate: 0.18/s media_comments: 6 | Time: 10.50s | Rate: 0.57/s media_comment_replies: 6 | Time: 3.82s | Rate: 1.57/s ------------------- Extract instagram_graph_rest_api_source -------------------- Resources: 1/2 (50.0%) | Time: 13.07s | Rate: 0.08/s media_objects: 2 | Time: 13.07s | Rate: 0.15/s media_comments: 6 | Time: 12.43s | Rate: 0.48/s media_comment_replies: 8 | Time: 5.75s | Rate: 1.39/s ------------------- Extract instagram_graph_rest_api_source -------------------- Resources: 1/2 (50.0%) | Time: 14.11s | Rate: 0.07/s media_objects: 2 | Time: 14.10s | Rate: 0.14/s media_comments: 6 | Time: 13.47s | Rate: 0.45/s media_comment_replies: 9 | Time: 6.79s | Rate: 1.33/s ------------------- Extract instagram_graph_rest_api_source -------------------- Resources: 1/2 (50.0%) | Time: 19.94s | Rate: 0.05/s media_objects: 2 | Time: 19.94s | Rate: 0.10/s media_comments: 6 | Time: 19.30s | Rate: 0.31/s media_comment_replies: 10 | Time: 12.62s | Rate: 0.79/s ------------------- Extract instagram_graph_rest_api_source -------------------- Resources: 1/2 (50.0%) | Time: 21.03s | Rate: 0.05/s media_objects: 2 | Time: 21.02s | Rate: 0.10/s media_comments: 6 | Time: 20.38s | Rate: 0.29/s media_comment_replies: 12 | Time: 13.71s | Rate: 0.88/s ------------------- Extract instagram_graph_rest_api_source -------------------- Resources: 1/2 (50.0%) | Time: 22.11s | Rate: 0.05/s media_objects: 2 | Time: 22.10s | Rate: 0.09/s media_comments: 6 | Time: 21.47s | Rate: 0.28/s media_comment_replies: 13 | Time: 14.79s | Rate: 0.88/s ------------------- Extract instagram_graph_rest_api_source -------------------- Resources: 1/2 (50.0%) | Time: 23.13s | Rate: 0.04/s media_objects: 2 | Time: 23.12s | Rate: 0.09/s media_comments: 6 | Time: 22.48s | Rate: 0.27/s media_comment_replies: 14 | Time: 15.80s | Rate: 0.89/s ------------------- Extract instagram_graph_rest_api_source -------------------- Resources: 1/2 (50.0%) | Time: 25.15s | Rate: 0.04/s media_objects: 2 | Time: 25.15s | Rate: 0.08/s media_comments: 6 | Time: 24.51s | Rate: 0.24/s media_comment_replies: 17 | Time: 17.83s | Rate: 0.95/s ------------------- Extract instagram_graph_rest_api_source -------------------- Resources: 1/2 (50.0%) | Time: 27.25s | Rate: 0.04/s media_objects: 2 | Time: 27.25s | Rate: 0.07/s media_comments: 6 | Time: 26.61s | Rate: 0.23/s media_comment_replies: 19 | Time: 19.93s | Rate: 0.95/s ------------------- Extract instagram_graph_rest_api_source -------------------- Resources: 1/2 (50.0%) | Time: 28.33s | Rate: 0.04/s media_objects: 2 | Time: 28.33s | Rate: 0.07/s media_comments: 6 | Time: 27.69s | Rate: 0.22/s media_comment_replies: 22 | Time: 21.01s | Rate: 1.05/s ------------------- Extract instagram_graph_rest_api_source -------------------- Resources: 1/2 (50.0%) | Time: 30.03s | Rate: 0.03/s media_objects: 2 | Time: 30.03s | Rate: 0.07/s media_comments: 6 | Time: 29.39s | Rate: 0.20/s media_comment_replies: 24 | Time: 22.71s | Rate: 1.06/s ------------------- Extract instagram_graph_rest_api_source -------------------- Resources: 1/2 (50.0%) | Time: 31.61s | Rate: 0.03/s media_objects: 2 | Time: 31.60s | Rate: 0.06/s media_comments: 6 | Time: 30.96s | Rate: 0.19/s media_comment_replies: 25 | Time: 24.28s | Rate: 1.03/s ------------------- Extract instagram_graph_rest_api_source -------------------- Resources: 1/2 (50.0%) | Time: 33.45s | Rate: 0.03/s media_objects: 2 | Time: 33.44s | Rate: 0.06/s media_comments: 6 | Time: 32.81s | Rate: 0.18/s media_comment_replies: 27 | Time: 26.13s | Rate: 1.03/s ------------------- Extract instagram_graph_rest_api_source -------------------- Resources: 1/2 (50.0%) | Time: 34.73s | Rate: 0.03/s media_objects: 2 | Time: 34.73s | Rate: 0.06/s media_comments: 6 | Time: 34.09s | Rate: 0.18/s media_comment_replies: 28 | Time: 27.41s | Rate: 1.02/s ------------------- Extract instagram_graph_rest_api_source -------------------- Resources: 1/2 (50.0%) | Time: 36.32s | Rate: 0.03/s media_objects: 2 | Time: 36.32s | Rate: 0.06/s media_comments: 6 | Time: 35.68s | Rate: 0.17/s media_comment_replies: 32 | Time: 29.00s | Rate: 1.10/s ------------------- Extract instagram_graph_rest_api_source -------------------- Resources: 1/2 (50.0%) | Time: 38.39s | Rate: 0.03/s media_objects: 2 | Time: 38.39s | Rate: 0.05/s media_comments: 6 | Time: 37.75s | Rate: 0.16/s media_comment_replies: 34 | Time: 31.07s | Rate: 1.09/s ------------------- Extract instagram_graph_rest_api_source -------------------- Resources: 1/2 (50.0%) | Time: 46.00s | Rate: 0.02/s media_objects: 2 | Time: 46.00s | Rate: 0.04/s media_comments: 6 | Time: 45.36s | Rate: 0.13/s media_comment_replies: 37 | Time: 38.68s | Rate: 0.96/s ------------------- Extract instagram_graph_rest_api_source -------------------- Resources: 1/2 (50.0%) | Time: 48.25s | Rate: 0.02/s media_objects: 2 | Time: 48.25s | Rate: 0.04/s media_comments: 6 | Time: 47.61s | Rate: 0.13/s media_comment_replies: 39 | Time: 40.93s | Rate: 0.95/s ------------------- Extract instagram_graph_rest_api_source -------------------- Resources: 1/2 (50.0%) | Time: 49.91s | Rate: 0.02/s media_objects: 2 | Time: 49.91s | Rate: 0.04/s media_comments: 6 | Time: 49.27s | Rate: 0.12/s media_comment_replies: 42 | Time: 42.59s | Rate: 0.99/s ------------------- Extract instagram_graph_rest_api_source -------------------- Resources: 1/2 (50.0%) | Time: 51.57s | Rate: 0.02/s media_objects: 2 | Time: 51.56s | Rate: 0.04/s media_comments: 6 | Time: 50.93s | Rate: 0.12/s media_comment_replies: 43 | Time: 44.25s | Rate: 0.97/s ------------------- Extract instagram_graph_rest_api_source -------------------- Resources: 1/2 (50.0%) | Time: 57.43s | Rate: 0.02/s media_objects: 2 | Time: 57.42s | Rate: 0.03/s media_comments: 6 | Time: 56.79s | Rate: 0.11/s media_comment_replies: 48 | Time: 50.11s | Rate: 0.96/s ------------------- Extract instagram_graph_rest_api_source -------------------- Resources: 1/2 (50.0%) | Time: 59.29s | Rate: 0.02/s media_objects: 2 | Time: 59.29s | Rate: 0.03/s media_comments: 6 | Time: 58.65s | Rate: 0.10/s media_comment_replies: 50 | Time: 51.97s | Rate: 0.96/s ------------------- Extract instagram_graph_rest_api_source -------------------- Resources: 1/2 (50.0%) | Time: 60.54s | Rate: 0.02/s media_objects: 2 | Time: 60.53s | Rate: 0.03/s media_comments: 6 | Time: 59.90s | Rate: 0.10/s media_comment_replies: 51 | Time: 53.22s | Rate: 0.96/s ------------------- Extract instagram_graph_rest_api_source -------------------- Resources: 1/2 (50.0%) | Time: 62.98s | Rate: 0.02/s media_objects: 2 | Time: 62.98s | Rate: 0.03/s media_comments: 6 | Time: 62.34s | Rate: 0.10/s media_comment_replies: 55 | Time: 55.66s | Rate: 0.99/s ------------------- Extract instagram_graph_rest_api_source -------------------- Resources: 1/2 (50.0%) | Time: 64.21s | Rate: 0.02/s media_objects: 2 | Time: 64.21s | Rate: 0.03/s media_comments: 6 | Time: 63.57s | Rate: 0.09/s media_comment_replies: 56 | Time: 56.89s | Rate: 0.98/s ------------------- Extract instagram_graph_rest_api_source -------------------- Resources: 1/2 (50.0%) | Time: 65.25s | Rate: 0.02/s media_objects: 2 | Time: 65.25s | Rate: 0.03/s media_comments: 6 | Time: 64.61s | Rate: 0.09/s media_comment_replies: 57 | Time: 57.93s | Rate: 0.98/s ------------------- Extract instagram_graph_rest_api_source -------------------- Resources: 1/2 (50.0%) | Time: 70.25s | Rate: 0.01/s media_objects: 2 | Time: 70.25s | Rate: 0.03/s media_comments: 6 | Time: 69.61s | Rate: 0.09/s media_comment_replies: 59 | Time: 62.93s | Rate: 0.94/s ------------------- Extract instagram_graph_rest_api_source -------------------- Resources: 1/2 (50.0%) | Time: 71.38s | Rate: 0.01/s media_objects: 2 | Time: 71.37s | Rate: 0.03/s media_comments: 6 | Time: 70.73s | Rate: 0.08/s media_comment_replies: 60 | Time: 64.05s | Rate: 0.94/s ------------------- Extract instagram_graph_rest_api_source -------------------- Resources: 1/2 (50.0%) | Time: 72.81s | Rate: 0.01/s media_objects: 2 | Time: 72.81s | Rate: 0.03/s media_comments: 6 | Time: 72.17s | Rate: 0.08/s media_comment_replies: 62 | Time: 65.49s | Rate: 0.95/s ------------------- Extract instagram_graph_rest_api_source -------------------- Resources: 1/2 (50.0%) | Time: 74.04s | Rate: 0.01/s media_objects: 2 | Time: 74.04s | Rate: 0.03/s media_comments: 6 | Time: 73.40s | Rate: 0.08/s media_comment_replies: 64 | Time: 66.72s | Rate: 0.96/s ------------------- Extract instagram_graph_rest_api_source -------------------- Resources: 1/2 (50.0%) | Time: 75.09s | Rate: 0.01/s media_objects: 2 | Time: 75.09s | Rate: 0.03/s media_comments: 6 | Time: 74.45s | Rate: 0.08/s media_comment_replies: 66 | Time: 67.77s | Rate: 0.97/s ------------------- Extract instagram_graph_rest_api_source -------------------- Resources: 1/2 (50.0%) | Time: 76.19s | Rate: 0.01/s media_objects: 2 | Time: 76.18s | Rate: 0.03/s media_comments: 6 | Time: 75.54s | Rate: 0.08/s media_comment_replies: 67 | Time: 68.87s | Rate: 0.97/s ------------------- Extract instagram_graph_rest_api_source -------------------- Resources: 1/2 (50.0%) | Time: 77.79s | Rate: 0.01/s media_objects: 2 | Time: 77.79s | Rate: 0.03/s media_comments: 6 | Time: 77.15s | Rate: 0.08/s media_comment_replies: 69 | Time: 70.47s | Rate: 0.98/s ------------------- Extract instagram_graph_rest_api_source -------------------- Resources: 1/2 (50.0%) | Time: 78.92s | Rate: 0.01/s media_objects: 2 | Time: 78.92s | Rate: 0.03/s media_comments: 6 | Time: 78.28s | Rate: 0.08/s media_comment_replies: 70 | Time: 71.60s | Rate: 0.98/s ------------------- Extract instagram_graph_rest_api_source -------------------- Resources: 1/2 (50.0%) | Time: 80.17s | Rate: 0.01/s media_objects: 2 | Time: 80.16s | Rate: 0.02/s media_comments: 6 | Time: 79.53s | Rate: 0.08/s media_comment_replies: 72 | Time: 72.85s | Rate: 0.99/s ------------------- Extract instagram_graph_rest_api_source -------------------- Resources: 1/2 (50.0%) | Time: 81.98s | Rate: 0.01/s media_objects: 2 | Time: 81.98s | Rate: 0.02/s media_comments: 6 | Time: 81.34s | Rate: 0.07/s media_comment_replies: 74 | Time: 74.66s | Rate: 0.99/s ------------------- Extract instagram_graph_rest_api_source -------------------- Resources: 1/2 (50.0%) | Time: 90.50s | Rate: 0.01/s media_objects: 2 | Time: 90.50s | Rate: 0.02/s media_comments: 6 | Time: 89.86s | Rate: 0.07/s media_comment_replies: 76 | Time: 83.18s | Rate: 0.91/s ------------------- Extract instagram_graph_rest_api_source -------------------- Resources: 1/2 (50.0%) | Time: 93.51s | Rate: 0.01/s media_objects: 2 | Time: 93.51s | Rate: 0.02/s media_comments: 6 | Time: 92.87s | Rate: 0.06/s media_comment_replies: 78 | Time: 86.19s | Rate: 0.90/s ------------------- Extract instagram_graph_rest_api_source -------------------- Resources: 1/2 (50.0%) | Time: 94.57s | Rate: 0.01/s media_objects: 2 | Time: 94.56s | Rate: 0.02/s media_comments: 6 | Time: 93.92s | Rate: 0.06/s media_comment_replies: 79 | Time: 87.24s | Rate: 0.91/s ------------------- Extract instagram_graph_rest_api_source -------------------- Resources: 1/2 (50.0%) | Time: 96.15s | Rate: 0.01/s media_objects: 2 | Time: 96.14s | Rate: 0.02/s media_comments: 6 | Time: 95.51s | Rate: 0.06/s media_comment_replies: 80 | Time: 88.83s | Rate: 0.90/s ------------------- Extract instagram_graph_rest_api_source -------------------- Resources: 2/2 (100.0%) | Time: 97.76s | Rate: 0.02/s media_objects: 2 | Time: 97.76s | Rate: 0.02/s media_comments: 6 | Time: 97.12s | Rate: 0.06/s media_comment_replies: 82 | Time: 90.44s | Rate: 0.91/s ------------------- Extract instagram_graph_rest_api_source -------------------- Resources: 2/2 (100.0%) | Time: 97.76s | Rate: 0.02/s media_objects: 2 | Time: 97.76s | Rate: 0.02/s media_comments: 6 | Time: 97.12s | Rate: 0.06/s media_comment_replies: 82 | Time: 90.44s | Rate: 0.91/s ------------------- Extract instagram_graph_rest_api_source -------------------- Resources: 0/1 (0.0%) | Time: 0.00s | Rate: 0.00/s ------------------- Extract instagram_graph_rest_api_source -------------------- Resources: 0/1 (0.0%) | Time: 0.00s | Rate: 0.00/s _dlt_pipeline_state: 1 | Time: 0.00s | Rate: 139810.13/s ------------------- Extract instagram_graph_rest_api_source -------------------- Resources: 1/1 (100.0%) | Time: 0.02s | Rate: 53.97/s _dlt_pipeline_state: 1 | Time: 0.01s | Rate: 69.89/s ------- Normalize instagram_graph_rest_api_source in 1778647593.2920148 -------- Files: 0/4 (0.0%) | Time: 0.00s | Rate: 0.00/s ------- Normalize instagram_graph_rest_api_source in 1778647593.2920148 -------- Files: 0/4 (0.0%) | Time: 0.02s | Rate: 0.00/s media_objects: 0 | Time: 0.00s | Rate: 0.00/s ------- Normalize instagram_graph_rest_api_source in 1778647593.2920148 -------- Files: 1/4 (25.0%) | Time: 0.02s | Rate: 40.74/s media_objects: 2 | Time: 0.01s | Rate: 377.41/s media_comments: 0 | Time: 0.00s | Rate: 0.00/s ------- Normalize instagram_graph_rest_api_source in 1778647593.2920148 -------- Files: 2/4 (50.0%) | Time: 0.03s | Rate: 68.54/s media_objects: 2 | Time: 0.01s | Rate: 201.27/s media_comments: 6 | Time: 0.00s | Rate: 1291.81/s media_comment_replies: 0 | Time: 0.00s | Rate: 0.00/s ------- Normalize instagram_graph_rest_api_source in 1778647593.2920148 -------- Files: 3/4 (75.0%) | Time: 0.05s | Rate: 64.26/s media_objects: 2 | Time: 0.03s | Rate: 72.88/s media_comments: 6 | Time: 0.02s | Rate: 270.86/s media_comment_replies: 82 | Time: 0.02s | Rate: 4682.04/s _dlt_pipeline_state: 0 | Time: 0.00s | Rate: 0.00/s 2026-05-13 04:48:11,254|[WARNING]|7446|139929650791168|dlt|validate.py|verify_normalized_table:113|In schema `instagram_graph_rest_api_source`: The following columns in table 'media_comments' did not receive any data during this load and therefore could not have their types inferred: - parent_comment_id Unless type hints are provided, these columns will not be materialized in the destination. One way to provide type hints is to use the 'columns' argument in the '@dlt.resource' decorator. For example: @dlt.resource(columns={'parent_comment_id': {'data_type': 'text'}}) ------- Normalize instagram_graph_rest_api_source in 1778647593.2920148 -------- Files: 4/4 (100.0%) | Time: 0.06s | Rate: 68.81/s media_objects: 2 | Time: 0.04s | Rate: 51.43/s media_comments: 6 | Time: 0.03s | Rate: 178.58/s media_comment_replies: 82 | Time: 0.03s | Rate: 2831.49/s _dlt_pipeline_state: 1 | Time: 0.01s | Rate: 87.31/s ---------- Load instagram_graph_rest_api_source in 1778647593.2920148 ---------- Jobs: 0/4 (0.0%) | Time: 0.00s | Rate: 0.00/s ---------- Load instagram_graph_rest_api_source in 1778647593.2920148 ---------- Jobs: 7/7 (100.0%) | Time: 0.69s | Rate: 10.21/s Pipeline instagram_graph_pipeline load step completed in 0.69 seconds 1 load package(s) were loaded to destination postgres and into dataset instagram_graph The postgres destination used postgresql://kpiper_dlt_app:***@[/cloudsql/pacelab-487114:europe-west4:pacelab-pg18-ew4]:5432/kpiper_data location to store data Load package 1778647593.2920148 is LOADED and contains no failed jobs [2026-05-13T04:48:12.657875] Command completed successfully. [2026-05-13T04:48:12.658250] Pipeline status payload: {"backfill_complete": true, "backfill_progress_mode": "incremental", "ig_user_id": "17841401578360161", "sync_mode": "incremental"}