[2026-08-31T10:51:02.693109] Job 378103 queued by schedule:2026-08-31T10:51:00 Connection: ferraristyle (instagram) Sync template: Instagram Graph - Webhook Reconcile Queue class: foreground Procrastinate queue: kpiper Command: python instagram_graph_pipeline.py [2026-08-31T10:51:02.834049] Queued via Procrastinate as job 376953 (queue=kpiper, priority=50). [2026-08-31T11:08:47.734663] Starting job 378103 for connection ferraristyle (instagram) / sync template Instagram Graph - Webhook Reconcile (type=dlt) Resolved command: cd /srv/kpiper && python instagram_graph_pipeline.py Injected profile context env vars (tokens exported: 1). Pipeline env overrides applied: COMMENTS_MEDIA_LOOKBACK_DAYS, DOWNLOAD_ASSETS, ENABLE_ACCOUNT_OBJECTS, ENABLE_ASSETS, ENABLE_COMMENTS, ENABLE_COMMENT_REPLIES, ENABLE_CONTENT_PUBLISHING_LIMITS, ENABLE_MEDIA_CHILD_OBJECTS, ENABLE_MEDIA_INSIGHTS, ENABLE_MEDIA_OBJECTS, ENABLE_STORY_INSIGHTS, ENABLE_STORY_OBJECTS, ENABLE_USER_INSIGHTS, ENABLE_WEBHOOK_SUBSCRIBED_APPS, IG_PAGE_ID, IG_USER_ID, MEDIA_INCREMENTAL_LOOKBACK_DAYS, MEDIA_PAGINATION, SOURCES__INSTAGRAM_GRAPH_REST_API_SOURCE__ACCESS_TOKEN, SYNC_MODE Refreshed Meta Page Token at 2026-08-31T11:08:47.708447. Forced unbuffered Python output for child process. /usr/local/lib/python3.11/site-packages/dlt/pipeline/progress.py:27: UserWarning: psutil dependency is not installed and memory stats will not be available. Add psutil to your environment or pass dump_system_stats=False to disable this warning. return log() ------------------- Extract instagram_graph_rest_api_source -------------------- Resources: 0/2 (0.0%) | Time: 0.00s | Rate: 0.00/s ------------------- Extract instagram_graph_rest_api_source -------------------- Resources: 0/2 (0.0%) | Time: 0.00s | Rate: 0.00/s media_objects: 1 | Time: 0.00s | Rate: 161319.38/s ------------------- Extract instagram_graph_rest_api_source -------------------- Resources: 0/2 (0.0%) | Time: 1.80s | Rate: 0.00/s media_objects: 1 | Time: 1.80s | Rate: 0.56/s media_comments: 1 | Time: 0.00s | Rate: 127100.12/s ------------------- Extract instagram_graph_rest_api_source -------------------- Resources: 0/2 (0.0%) | Time: 6.69s | Rate: 0.00/s media_objects: 2 | Time: 6.69s | Rate: 0.30/s media_comments: 2 | Time: 4.89s | Rate: 0.41/s ------------------- Extract instagram_graph_rest_api_source -------------------- Resources: 1/2 (50.0%) | Time: 7.96s | Rate: 0.13/s media_objects: 2 | Time: 7.96s | Rate: 0.25/s media_comments: 5 | Time: 6.16s | Rate: 0.81/s ------------------- Extract instagram_graph_rest_api_source -------------------- Resources: 1/2 (50.0%) | Time: 9.16s | Rate: 0.11/s media_objects: 2 | Time: 9.15s | Rate: 0.22/s media_comments: 8 | Time: 7.36s | Rate: 1.09/s ------------------- Extract instagram_graph_rest_api_source -------------------- Resources: 1/2 (50.0%) | Time: 10.33s | Rate: 0.10/s media_objects: 2 | Time: 10.33s | Rate: 0.19/s media_comments: 11 | Time: 8.53s | Rate: 1.29/s ------------------- Extract instagram_graph_rest_api_source -------------------- Resources: 1/2 (50.0%) | Time: 11.64s | Rate: 0.09/s media_objects: 2 | Time: 11.64s | Rate: 0.17/s media_comments: 12 | Time: 9.84s | Rate: 1.22/s ------------------- Extract instagram_graph_rest_api_source -------------------- Resources: 1/2 (50.0%) | Time: 16.68s | Rate: 0.06/s media_objects: 2 | Time: 16.68s | Rate: 0.12/s media_comments: 13 | Time: 14.88s | Rate: 0.87/s ------------------- Extract instagram_graph_rest_api_source -------------------- Resources: 1/2 (50.0%) | Time: 18.18s | Rate: 0.06/s media_objects: 2 | Time: 18.18s | Rate: 0.11/s media_comments: 16 | Time: 16.38s | Rate: 0.98/s ------------------- Extract instagram_graph_rest_api_source -------------------- Resources: 1/2 (50.0%) | Time: 19.38s | Rate: 0.05/s media_objects: 2 | Time: 19.38s | Rate: 0.10/s media_comments: 19 | Time: 17.58s | Rate: 1.08/s ------------------- Extract instagram_graph_rest_api_source -------------------- Resources: 1/2 (50.0%) | Time: 20.55s | Rate: 0.05/s media_objects: 2 | Time: 20.55s | Rate: 0.10/s media_comments: 21 | Time: 18.75s | Rate: 1.12/s ------------------- Extract instagram_graph_rest_api_source -------------------- Resources: 1/2 (50.0%) | Time: 21.74s | Rate: 0.05/s media_objects: 2 | Time: 21.73s | Rate: 0.09/s media_comments: 24 | Time: 19.94s | Rate: 1.20/s ------------------- Extract instagram_graph_rest_api_source -------------------- Resources: 1/2 (50.0%) | Time: 25.37s | Rate: 0.04/s media_objects: 2 | Time: 25.37s | Rate: 0.08/s media_comments: 27 | Time: 23.57s | Rate: 1.15/s ------------------- Extract instagram_graph_rest_api_source -------------------- Resources: 1/2 (50.0%) | Time: 26.94s | Rate: 0.04/s media_objects: 2 | Time: 26.94s | Rate: 0.07/s media_comments: 30 | Time: 25.14s | Rate: 1.19/s ------------------- Extract instagram_graph_rest_api_source -------------------- Resources: 1/2 (50.0%) | Time: 27.99s | Rate: 0.04/s media_objects: 2 | Time: 27.98s | Rate: 0.07/s media_comments: 32 | Time: 26.19s | Rate: 1.22/s ------------------- Extract instagram_graph_rest_api_source -------------------- Resources: 1/2 (50.0%) | Time: 29.12s | Rate: 0.03/s media_objects: 2 | Time: 29.12s | Rate: 0.07/s media_comments: 35 | Time: 27.32s | Rate: 1.28/s ------------------- Extract instagram_graph_rest_api_source -------------------- Resources: 1/2 (50.0%) | Time: 30.41s | Rate: 0.03/s media_objects: 2 | Time: 30.40s | Rate: 0.07/s media_comments: 38 | Time: 28.61s | Rate: 1.33/s ------------------- Extract instagram_graph_rest_api_source -------------------- Resources: 1/2 (50.0%) | Time: 31.63s | Rate: 0.03/s media_objects: 2 | Time: 31.63s | Rate: 0.06/s media_comments: 41 | Time: 29.83s | Rate: 1.37/s ------------------- Extract instagram_graph_rest_api_source -------------------- Resources: 1/2 (50.0%) | Time: 35.72s | Rate: 0.03/s media_objects: 2 | Time: 35.71s | Rate: 0.06/s media_comments: 44 | Time: 33.92s | Rate: 1.30/s ------------------- Extract instagram_graph_rest_api_source -------------------- Resources: 1/2 (50.0%) | Time: 36.82s | Rate: 0.03/s media_objects: 2 | Time: 36.82s | Rate: 0.05/s media_comments: 47 | Time: 35.02s | Rate: 1.34/s ------------------- Extract instagram_graph_rest_api_source -------------------- Resources: 1/2 (50.0%) | Time: 37.91s | Rate: 0.03/s media_objects: 2 | Time: 37.91s | Rate: 0.05/s media_comments: 50 | Time: 36.11s | Rate: 1.38/s ------------------- Extract instagram_graph_rest_api_source -------------------- Resources: 1/2 (50.0%) | Time: 39.13s | Rate: 0.03/s media_objects: 2 | Time: 39.12s | Rate: 0.05/s media_comments: 53 | Time: 37.32s | Rate: 1.42/s ------------------- Extract instagram_graph_rest_api_source -------------------- Resources: 1/2 (50.0%) | Time: 40.31s | Rate: 0.02/s media_objects: 2 | Time: 40.30s | Rate: 0.05/s media_comments: 55 | Time: 38.50s | Rate: 1.43/s ------------------- Extract instagram_graph_rest_api_source -------------------- Resources: 1/2 (50.0%) | Time: 44.08s | Rate: 0.02/s media_objects: 2 | Time: 44.08s | Rate: 0.05/s media_comments: 58 | Time: 42.28s | Rate: 1.37/s ------------------- Extract instagram_graph_rest_api_source -------------------- Resources: 1/2 (50.0%) | Time: 45.32s | Rate: 0.02/s media_objects: 2 | Time: 45.31s | Rate: 0.04/s media_comments: 61 | Time: 43.52s | Rate: 1.40/s ------------------- Extract instagram_graph_rest_api_source -------------------- Resources: 1/2 (50.0%) | Time: 46.40s | Rate: 0.02/s media_objects: 2 | Time: 46.39s | Rate: 0.04/s media_comments: 64 | Time: 44.60s | Rate: 1.44/s ------------------- Extract instagram_graph_rest_api_source -------------------- Resources: 1/2 (50.0%) | Time: 47.49s | Rate: 0.02/s media_objects: 2 | Time: 47.49s | Rate: 0.04/s media_comments: 67 | Time: 45.69s | Rate: 1.47/s ------------------- Extract instagram_graph_rest_api_source -------------------- Resources: 1/2 (50.0%) | Time: 50.61s | Rate: 0.02/s media_objects: 2 | Time: 50.60s | Rate: 0.04/s media_comments: 69 | Time: 48.81s | Rate: 1.41/s ------------------- Extract instagram_graph_rest_api_source -------------------- Resources: 1/2 (50.0%) | Time: 51.66s | Rate: 0.02/s media_objects: 2 | Time: 51.66s | Rate: 0.04/s media_comments: 71 | Time: 49.86s | Rate: 1.42/s ------------------- Extract instagram_graph_rest_api_source -------------------- Resources: 1/2 (50.0%) | Time: 53.02s | Rate: 0.02/s media_objects: 2 | Time: 53.02s | Rate: 0.04/s media_comments: 74 | Time: 51.22s | Rate: 1.44/s ------------------- Extract instagram_graph_rest_api_source -------------------- Resources: 1/2 (50.0%) | Time: 58.39s | Rate: 0.02/s media_objects: 2 | Time: 58.39s | Rate: 0.03/s media_comments: 77 | Time: 56.59s | Rate: 1.36/s ------------------- Extract instagram_graph_rest_api_source -------------------- Resources: 1/2 (50.0%) | Time: 59.85s | Rate: 0.02/s media_objects: 2 | Time: 59.85s | Rate: 0.03/s media_comments: 80 | Time: 58.05s | Rate: 1.38/s ------------------- Extract instagram_graph_rest_api_source -------------------- Resources: 1/2 (50.0%) | Time: 61.03s | Rate: 0.02/s media_objects: 2 | Time: 61.03s | Rate: 0.03/s media_comments: 83 | Time: 59.23s | Rate: 1.40/s ------------------- Extract instagram_graph_rest_api_source -------------------- Resources: 1/2 (50.0%) | Time: 62.29s | Rate: 0.02/s media_objects: 2 | Time: 62.29s | Rate: 0.03/s media_comments: 86 | Time: 60.49s | Rate: 1.42/s ------------------- Extract instagram_graph_rest_api_source -------------------- Resources: 1/2 (50.0%) | Time: 63.60s | Rate: 0.02/s media_objects: 2 | Time: 63.59s | Rate: 0.03/s media_comments: 89 | Time: 61.80s | Rate: 1.44/s ------------------- Extract instagram_graph_rest_api_source -------------------- Resources: 1/2 (50.0%) | Time: 64.82s | Rate: 0.02/s media_objects: 2 | Time: 64.82s | Rate: 0.03/s media_comments: 92 | Time: 63.02s | Rate: 1.46/s ------------------- Extract instagram_graph_rest_api_source -------------------- Resources: 1/2 (50.0%) | Time: 66.13s | Rate: 0.02/s media_objects: 2 | Time: 66.12s | Rate: 0.03/s media_comments: 95 | Time: 64.33s | Rate: 1.48/s ------------------- Extract instagram_graph_rest_api_source -------------------- Resources: 1/2 (50.0%) | Time: 67.49s | Rate: 0.01/s media_objects: 2 | Time: 67.49s | Rate: 0.03/s media_comments: 98 | Time: 65.69s | Rate: 1.49/s ------------------- Extract instagram_graph_rest_api_source -------------------- Resources: 1/2 (50.0%) | Time: 68.82s | Rate: 0.01/s media_objects: 2 | Time: 68.82s | Rate: 0.03/s media_comments: 101 | Time: 67.02s | Rate: 1.51/s ------------------- Extract instagram_graph_rest_api_source -------------------- Resources: 1/2 (50.0%) | Time: 70.09s | Rate: 0.01/s media_objects: 2 | Time: 70.09s | Rate: 0.03/s media_comments: 104 | Time: 68.29s | Rate: 1.52/s ------------------- Extract instagram_graph_rest_api_source -------------------- Resources: 1/2 (50.0%) | Time: 71.42s | Rate: 0.01/s media_objects: 2 | Time: 71.42s | Rate: 0.03/s media_comments: 107 | Time: 69.62s | Rate: 1.54/s ------------------- Extract instagram_graph_rest_api_source -------------------- Resources: 1/2 (50.0%) | Time: 72.65s | Rate: 0.01/s media_objects: 2 | Time: 72.64s | Rate: 0.03/s media_comments: 109 | Time: 70.84s | Rate: 1.54/s ------------------- Extract instagram_graph_rest_api_source -------------------- Resources: 1/2 (50.0%) | Time: 73.88s | Rate: 0.01/s media_objects: 2 | Time: 73.88s | Rate: 0.03/s media_comments: 112 | Time: 72.08s | Rate: 1.55/s ------------------- Extract instagram_graph_rest_api_source -------------------- Resources: 1/2 (50.0%) | Time: 75.13s | Rate: 0.01/s media_objects: 2 | Time: 75.13s | Rate: 0.03/s media_comments: 115 | Time: 73.33s | Rate: 1.57/s ------------------- Extract instagram_graph_rest_api_source -------------------- Resources: 1/2 (50.0%) | Time: 77.58s | Rate: 0.01/s media_objects: 2 | Time: 77.58s | Rate: 0.03/s media_comments: 117 | Time: 75.78s | Rate: 1.54/s ------------------- Extract instagram_graph_rest_api_source -------------------- Resources: 1/2 (50.0%) | Time: 81.03s | Rate: 0.01/s media_objects: 2 | Time: 81.03s | Rate: 0.02/s media_comments: 119 | Time: 79.23s | Rate: 1.50/s ------------------- Extract instagram_graph_rest_api_source -------------------- Resources: 1/2 (50.0%) | Time: 82.37s | Rate: 0.01/s media_objects: 2 | Time: 82.37s | Rate: 0.02/s media_comments: 122 | Time: 80.57s | Rate: 1.51/s ------------------- Extract instagram_graph_rest_api_source -------------------- Resources: 1/2 (50.0%) | Time: 83.63s | Rate: 0.01/s media_objects: 2 | Time: 83.63s | Rate: 0.02/s media_comments: 125 | Time: 81.83s | Rate: 1.53/s ------------------- Extract instagram_graph_rest_api_source -------------------- Resources: 1/2 (50.0%) | Time: 84.85s | Rate: 0.01/s media_objects: 2 | Time: 84.85s | Rate: 0.02/s media_comments: 128 | Time: 83.05s | Rate: 1.54/s ------------------- Extract instagram_graph_rest_api_source -------------------- Resources: 1/2 (50.0%) | Time: 87.37s | Rate: 0.01/s media_objects: 2 | Time: 87.37s | Rate: 0.02/s media_comments: 129 | Time: 85.57s | Rate: 1.51/s ------------------- Extract instagram_graph_rest_api_source -------------------- Resources: 1/2 (50.0%) | Time: 88.67s | Rate: 0.01/s media_objects: 2 | Time: 88.66s | Rate: 0.02/s media_comments: 132 | Time: 86.87s | Rate: 1.52/s ------------------- Extract instagram_graph_rest_api_source -------------------- Resources: 1/2 (50.0%) | Time: 91.72s | Rate: 0.01/s media_objects: 2 | Time: 91.72s | Rate: 0.02/s media_comments: 133 | Time: 89.92s | Rate: 1.48/s ------------------- Extract instagram_graph_rest_api_source -------------------- Resources: 1/2 (50.0%) | Time: 93.07s | Rate: 0.01/s media_objects: 2 | Time: 93.06s | Rate: 0.02/s media_comments: 136 | Time: 91.27s | Rate: 1.49/s ------------------- Extract instagram_graph_rest_api_source -------------------- Resources: 1/2 (50.0%) | Time: 94.49s | Rate: 0.01/s media_objects: 2 | Time: 94.48s | Rate: 0.02/s media_comments: 139 | Time: 92.69s | Rate: 1.50/s ------------------- Extract instagram_graph_rest_api_source -------------------- Resources: 1/2 (50.0%) | Time: 95.78s | Rate: 0.01/s media_objects: 2 | Time: 95.78s | Rate: 0.02/s media_comments: 142 | Time: 93.98s | Rate: 1.51/s ------------------- Extract instagram_graph_rest_api_source -------------------- Resources: 1/2 (50.0%) | Time: 97.05s | Rate: 0.01/s media_objects: 2 | Time: 97.05s | Rate: 0.02/s media_comments: 145 | Time: 95.25s | Rate: 1.52/s ------------------- Extract instagram_graph_rest_api_source -------------------- Resources: 1/2 (50.0%) | Time: 98.30s | Rate: 0.01/s media_objects: 2 | Time: 98.30s | Rate: 0.02/s media_comments: 148 | Time: 96.50s | Rate: 1.53/s ------------------- Extract instagram_graph_rest_api_source -------------------- Resources: 1/2 (50.0%) | Time: 99.63s | Rate: 0.01/s media_objects: 2 | Time: 99.62s | Rate: 0.02/s media_comments: 151 | Time: 97.83s | Rate: 1.54/s ------------------- Extract instagram_graph_rest_api_source -------------------- Resources: 1/2 (50.0%) | Time: 101.27s | Rate: 0.01/s media_objects: 2 | Time: 101.26s | Rate: 0.02/s media_comments: 154 | Time: 99.47s | Rate: 1.55/s ------------------- Extract instagram_graph_rest_api_source -------------------- Resources: 1/2 (50.0%) | Time: 102.51s | Rate: 0.01/s media_objects: 2 | Time: 102.51s | Rate: 0.02/s media_comments: 157 | Time: 100.71s | Rate: 1.56/s ------------------- Extract instagram_graph_rest_api_source -------------------- Resources: 1/2 (50.0%) | Time: 103.53s | Rate: 0.01/s media_objects: 2 | Time: 103.52s | Rate: 0.02/s media_comments: 159 | Time: 101.72s | Rate: 1.56/s ------------------- Extract instagram_graph_rest_api_source -------------------- Resources: 1/2 (50.0%) | Time: 104.56s | Rate: 0.01/s media_objects: 2 | Time: 104.56s | Rate: 0.02/s media_comments: 161 | Time: 102.76s | Rate: 1.57/s ------------------- Extract instagram_graph_rest_api_source -------------------- Resources: 1/2 (50.0%) | Time: 105.78s | Rate: 0.01/s media_objects: 2 | Time: 105.77s | Rate: 0.02/s media_comments: 164 | Time: 103.98s | Rate: 1.58/s ------------------- Extract instagram_graph_rest_api_source -------------------- Resources: 1/2 (50.0%) | Time: 107.05s | Rate: 0.01/s media_objects: 2 | Time: 107.05s | Rate: 0.02/s media_comments: 167 | Time: 105.25s | Rate: 1.59/s ------------------- Extract instagram_graph_rest_api_source -------------------- Resources: 1/2 (50.0%) | Time: 108.46s | Rate: 0.01/s media_objects: 2 | Time: 108.46s | Rate: 0.02/s media_comments: 170 | Time: 106.66s | Rate: 1.59/s ------------------- Extract instagram_graph_rest_api_source -------------------- Resources: 1/2 (50.0%) | Time: 111.18s | Rate: 0.01/s media_objects: 2 | Time: 111.17s | Rate: 0.02/s media_comments: 172 | Time: 109.38s | Rate: 1.57/s ------------------- Extract instagram_graph_rest_api_source -------------------- Resources: 1/2 (50.0%) | Time: 115.29s | Rate: 0.01/s media_objects: 2 | Time: 115.29s | Rate: 0.02/s media_comments: 173 | Time: 113.49s | Rate: 1.52/s ------------------- Extract instagram_graph_rest_api_source -------------------- Resources: 1/2 (50.0%) | Time: 116.55s | Rate: 0.01/s media_objects: 2 | Time: 116.54s | Rate: 0.02/s media_comments: 176 | Time: 114.75s | Rate: 1.53/s ------------------- Extract instagram_graph_rest_api_source -------------------- Resources: 1/2 (50.0%) | Time: 119.50s | Rate: 0.01/s media_objects: 2 | Time: 119.49s | Rate: 0.02/s media_comments: 178 | Time: 117.69s | Rate: 1.51/s ------------------- Extract instagram_graph_rest_api_source -------------------- Resources: 1/2 (50.0%) | Time: 120.83s | Rate: 0.01/s media_objects: 2 | Time: 120.82s | Rate: 0.02/s media_comments: 181 | Time: 119.03s | Rate: 1.52/s ------------------- Extract instagram_graph_rest_api_source -------------------- Resources: 1/2 (50.0%) | Time: 122.15s | Rate: 0.01/s media_objects: 2 | Time: 122.15s | Rate: 0.02/s media_comments: 184 | Time: 120.35s | Rate: 1.53/s ------------------- Extract instagram_graph_rest_api_source -------------------- Resources: 1/2 (50.0%) | Time: 123.44s | Rate: 0.01/s media_objects: 2 | Time: 123.44s | Rate: 0.02/s media_comments: 187 | Time: 121.64s | Rate: 1.54/s ------------------- Extract instagram_graph_rest_api_source -------------------- Resources: 1/2 (50.0%) | Time: 124.88s | Rate: 0.01/s media_objects: 2 | Time: 124.87s | Rate: 0.02/s media_comments: 190 | Time: 123.07s | Rate: 1.54/s ------------------- Extract instagram_graph_rest_api_source -------------------- Resources: 1/2 (50.0%) | Time: 126.07s | Rate: 0.01/s media_objects: 2 | Time: 126.06s | Rate: 0.02/s media_comments: 193 | Time: 124.27s | Rate: 1.55/s ------------------- Extract instagram_graph_rest_api_source -------------------- Resources: 1/2 (50.0%) | Time: 127.42s | Rate: 0.01/s media_objects: 2 | Time: 127.41s | Rate: 0.02/s media_comments: 196 | Time: 125.62s | Rate: 1.56/s ------------------- Extract instagram_graph_rest_api_source -------------------- Resources: 1/2 (50.0%) | Time: 128.66s | Rate: 0.01/s media_objects: 2 | Time: 128.65s | Rate: 0.02/s media_comments: 199 | Time: 126.86s | Rate: 1.57/s ------------------- Extract instagram_graph_rest_api_source -------------------- Resources: 1/2 (50.0%) | Time: 129.89s | Rate: 0.01/s media_objects: 2 | Time: 129.89s | Rate: 0.02/s media_comments: 202 | Time: 128.09s | Rate: 1.58/s ------------------- Extract instagram_graph_rest_api_source -------------------- Resources: 1/2 (50.0%) | Time: 134.58s | Rate: 0.01/s media_objects: 2 | Time: 134.57s | Rate: 0.01/s media_comments: 203 | Time: 132.77s | Rate: 1.53/s ------------------- Extract instagram_graph_rest_api_source -------------------- Resources: 1/2 (50.0%) | Time: 135.84s | Rate: 0.01/s media_objects: 2 | Time: 135.84s | Rate: 0.01/s media_comments: 206 | Time: 134.04s | Rate: 1.54/s ------------------- Extract instagram_graph_rest_api_source -------------------- Resources: 1/2 (50.0%) | Time: 137.00s | Rate: 0.01/s media_objects: 2 | Time: 136.99s | Rate: 0.01/s media_comments: 208 | Time: 135.19s | Rate: 1.54/s ------------------- Extract instagram_graph_rest_api_source -------------------- Resources: 1/2 (50.0%) | Time: 138.25s | Rate: 0.01/s media_objects: 2 | Time: 138.25s | Rate: 0.01/s media_comments: 211 | Time: 136.45s | Rate: 1.55/s ------------------- Extract instagram_graph_rest_api_source -------------------- Resources: 1/2 (50.0%) | Time: 139.30s | Rate: 0.01/s media_objects: 2 | Time: 139.29s | Rate: 0.01/s media_comments: 213 | Time: 137.49s | Rate: 1.55/s ------------------- Extract instagram_graph_rest_api_source -------------------- Resources: 1/2 (50.0%) | Time: 140.45s | Rate: 0.01/s media_objects: 2 | Time: 140.45s | Rate: 0.01/s media_comments: 216 | Time: 138.65s | Rate: 1.56/s ------------------- Extract instagram_graph_rest_api_source -------------------- Resources: 1/2 (50.0%) | Time: 141.53s | Rate: 0.01/s media_objects: 2 | Time: 141.53s | Rate: 0.01/s media_comments: 219 | Time: 139.73s | Rate: 1.57/s ------------------- Extract instagram_graph_rest_api_source -------------------- Resources: 1/2 (50.0%) | Time: 142.85s | Rate: 0.01/s media_objects: 2 | Time: 142.85s | Rate: 0.01/s media_comments: 222 | Time: 141.05s | Rate: 1.57/s ------------------- Extract instagram_graph_rest_api_source -------------------- Resources: 1/2 (50.0%) | Time: 144.18s | Rate: 0.01/s media_objects: 2 | Time: 144.18s | Rate: 0.01/s media_comments: 225 | Time: 142.38s | Rate: 1.58/s ------------------- Extract instagram_graph_rest_api_source -------------------- Resources: 1/2 (50.0%) | Time: 145.60s | Rate: 0.01/s media_objects: 2 | Time: 145.59s | Rate: 0.01/s media_comments: 228 | Time: 143.79s | Rate: 1.59/s ------------------- Extract instagram_graph_rest_api_source -------------------- Resources: 1/2 (50.0%) | Time: 147.10s | Rate: 0.01/s media_objects: 2 | Time: 147.10s | Rate: 0.01/s media_comments: 231 | Time: 145.30s | Rate: 1.59/s ------------------- Extract instagram_graph_rest_api_source -------------------- Resources: 1/2 (50.0%) | Time: 148.48s | Rate: 0.01/s media_objects: 2 | Time: 148.47s | Rate: 0.01/s media_comments: 234 | Time: 146.67s | Rate: 1.60/s ------------------- Extract instagram_graph_rest_api_source -------------------- Resources: 1/2 (50.0%) | Time: 149.65s | Rate: 0.01/s media_objects: 2 | Time: 149.64s | Rate: 0.01/s media_comments: 237 | Time: 147.85s | Rate: 1.60/s ------------------- Extract instagram_graph_rest_api_source -------------------- Resources: 1/2 (50.0%) | Time: 150.70s | Rate: 0.01/s media_objects: 2 | Time: 150.70s | Rate: 0.01/s media_comments: 240 | Time: 148.90s | Rate: 1.61/s ------------------- Extract instagram_graph_rest_api_source -------------------- Resources: 1/2 (50.0%) | Time: 152.94s | Rate: 0.01/s media_objects: 2 | Time: 152.94s | Rate: 0.01/s media_comments: 241 | Time: 151.14s | Rate: 1.59/s ------------------- Extract instagram_graph_rest_api_source -------------------- Resources: 1/2 (50.0%) | Time: 153.97s | Rate: 0.01/s media_objects: 2 | Time: 153.97s | Rate: 0.01/s media_comments: 244 | Time: 152.17s | Rate: 1.60/s ------------------- Extract instagram_graph_rest_api_source -------------------- Resources: 1/2 (50.0%) | Time: 155.58s | Rate: 0.01/s media_objects: 2 | Time: 155.57s | Rate: 0.01/s media_comments: 247 | Time: 153.77s | Rate: 1.61/s ------------------- Extract instagram_graph_rest_api_source -------------------- Resources: 1/2 (50.0%) | Time: 156.68s | Rate: 0.01/s media_objects: 2 | Time: 156.68s | Rate: 0.01/s media_comments: 250 | Time: 154.88s | Rate: 1.61/s ------------------- Extract instagram_graph_rest_api_source -------------------- Resources: 1/2 (50.0%) | Time: 157.80s | Rate: 0.01/s media_objects: 2 | Time: 157.79s | Rate: 0.01/s media_comments: 253 | Time: 156.00s | Rate: 1.62/s ------------------- Extract instagram_graph_rest_api_source -------------------- Resources: 1/2 (50.0%) | Time: 158.88s | Rate: 0.01/s media_objects: 2 | Time: 158.88s | Rate: 0.01/s media_comments: 256 | Time: 157.08s | Rate: 1.63/s ------------------- Extract instagram_graph_rest_api_source -------------------- Resources: 1/2 (50.0%) | Time: 161.34s | Rate: 0.01/s media_objects: 2 | Time: 161.34s | Rate: 0.01/s media_comments: 257 | Time: 159.54s | Rate: 1.61/s ------------------- Extract instagram_graph_rest_api_source -------------------- Resources: 1/2 (50.0%) | Time: 162.67s | Rate: 0.01/s media_objects: 2 | Time: 162.66s | Rate: 0.01/s media_comments: 260 | Time: 160.86s | Rate: 1.62/s ------------------- Extract instagram_graph_rest_api_source -------------------- Resources: 1/2 (50.0%) | Time: 163.76s | Rate: 0.01/s media_objects: 2 | Time: 163.75s | Rate: 0.01/s media_comments: 263 | Time: 161.95s | Rate: 1.62/s ------------------- Extract instagram_graph_rest_api_source -------------------- Resources: 1/2 (50.0%) | Time: 164.76s | Rate: 0.01/s media_objects: 2 | Time: 164.76s | Rate: 0.01/s media_comments: 266 | Time: 162.96s | Rate: 1.63/s ------------------- Extract instagram_graph_rest_api_source -------------------- Resources: 1/2 (50.0%) | Time: 165.85s | Rate: 0.01/s media_objects: 2 | Time: 165.85s | Rate: 0.01/s media_comments: 269 | Time: 164.05s | Rate: 1.64/s ------------------- Extract instagram_graph_rest_api_source -------------------- Resources: 2/2 (100.0%) | Time: 166.20s | Rate: 0.01/s media_objects: 2 | Time: 166.20s | Rate: 0.01/s media_comments: 269 | Time: 164.40s | Rate: 1.64/s ------------------- Extract instagram_graph_rest_api_source -------------------- Resources: 0/1 (0.0%) | Time: 0.00s | Rate: 0.00/s ------------------- Extract instagram_graph_rest_api_source -------------------- Resources: 0/1 (0.0%) | Time: 0.00s | Rate: 0.00/s _dlt_pipeline_state: 1 | Time: 0.00s | Rate: 174762.67/s ------------------- Extract instagram_graph_rest_api_source -------------------- Resources: 1/1 (100.0%) | Time: 0.02s | Rate: 53.92/s _dlt_pipeline_state: 1 | Time: 0.01s | Rate: 71.66/s ------- Normalize instagram_graph_rest_api_source in 1788174536.1993148 -------- Files: 0/3 (0.0%) | Time: 0.00s | Rate: 0.00/s ------- Normalize instagram_graph_rest_api_source in 1788174536.1993148 -------- Files: 0/3 (0.0%) | Time: 0.05s | Rate: 0.00/s media_objects: 0 | Time: 0.00s | Rate: 0.00/s ------- Normalize instagram_graph_rest_api_source in 1788174536.1993148 -------- Files: 1/3 (33.3%) | Time: 0.05s | Rate: 18.73/s media_objects: 2 | Time: 0.00s | Rate: 414.03/s media_comments: 0 | Time: 0.00s | Rate: 0.00/s ------- Normalize instagram_graph_rest_api_source in 1788174536.1993148 -------- Files: 2/3 (66.7%) | Time: 0.09s | Rate: 21.17/s media_objects: 2 | Time: 0.05s | Rate: 43.54/s media_comments: 269 | Time: 0.04s | Rate: 6543.76/s _dlt_pipeline_state: 0 | Time: 0.00s | Rate: 0.00/s 2026-08-31 11:11:42,680|[WARNING]|937|140235198657280|dlt|validate.py|verify_normalized_table:113|In schema `instagram_graph_rest_api_source`: The following columns in table 'media_comments' did not receive any data during this load and therefore could not have their types inferred: - parent_comment_id Unless type hints are provided, these columns will not be materialized in the destination. One way to provide type hints is to use the 'columns' argument in the '@dlt.resource' decorator. For example: @dlt.resource(columns={'parent_comment_id': {'data_type': 'text'}}) ------- Normalize instagram_graph_rest_api_source in 1788174536.1993148 -------- Files: 3/3 (100.0%) | Time: 0.15s | Rate: 19.90/s media_objects: 2 | Time: 0.10s | Rate: 19.58/s media_comments: 269 | Time: 0.10s | Rate: 2763.58/s _dlt_pipeline_state: 1 | Time: 0.06s | Rate: 17.78/s ---------- Load instagram_graph_rest_api_source in 1788174536.1993148 ---------- Jobs: 0/3 (0.0%) | Time: 0.00s | Rate: 0.00/s ---------- Load instagram_graph_rest_api_source in 1788174536.1993148 ---------- Jobs: 5/5 (100.0%) | Time: 0.37s | Rate: 13.39/s Pipeline instagram_graph_pipeline load step completed in 0.37 seconds 1 load package(s) were loaded to destination postgres and into dataset instagram_graph The postgres destination used postgresql://kpiper_dlt_app:***@[/cloudsql/pacelab-487114:europe-west4:pacelab-pg18-ew4]:5432/kpiper_data location to store data Load package 1788174536.1993148 is LOADED and contains no failed jobs [2026-08-31T11:11:43.521653] Command completed successfully. [2026-08-31T11:11:43.522360] Pipeline status payload: {"backfill_complete": true, "backfill_progress_mode": "incremental", "ig_user_id": "17841406077339187", "sync_mode": "incremental"}