[2026-06-12T20:42:01.760347] Job 193225 queued by schedule:2026-06-12T20:42:00 Connection: Collistar (meta_ads) Sync template: Meta Ads - Detail Refresh Queue class: background Procrastinate queue: kpiper-background Command: python meta_ads_pipeline.py [2026-06-12T20:42:01.974128] Queued via Procrastinate as job 192075 (queue=kpiper-background, priority=10). [2026-06-12T20:42:02.052728] Starting job 193225 for connection Collistar (meta_ads) / sync template Meta Ads - Detail Refresh (type=dlt) Resolved command: cd /srv/kpiper && python meta_ads_pipeline.py Injected profile context env vars (tokens exported: 1). Pipeline env overrides applied: AD_ACCOUNT_ID, BACKFILL_CHUNK_DAYS, ENABLE_ACCOUNT_INSIGHTS, ENABLE_ADS, ENABLE_AD_ACCOUNT_OBJECTS, ENABLE_AD_INSIGHTS, ENABLE_AD_SETS, ENABLE_AD_SET_INSIGHTS, ENABLE_CAMPAIGNS, ENABLE_CAMPAIGN_INSIGHTS, INSIGHTS_FIELDS, INSIGHTS_LOOKBACK_DAYS, INSIGHT_WINDOW_DAYS, OBJECT_LIMIT, PAGE_SIZE, SOURCES__META_ADS_REST_API_SOURCE__ACCESS_TOKEN, SYNC_MODE Synced Meta system user token at 2026-06-12T20:42:02.017351. Forced unbuffered Python output for child process. /usr/local/lib/python3.11/site-packages/dlt/pipeline/progress.py:27: UserWarning: psutil dependency is not installed and memory stats will not be available. Add psutil to your environment or pass dump_system_stats=False to disable this warning. return log() ----------------------- Extract meta_ads_rest_api_source ----------------------- Resources: 0/11 (0.0%) | Time: 0.00s | Rate: 0.00/s ----------------------- Extract meta_ads_rest_api_source ----------------------- Resources: 2/11 (18.2%) | Time: 6.99s | Rate: 0.29/s ----------------------- Extract meta_ads_rest_api_source ----------------------- Resources: 2/11 (18.2%) | Time: 7.00s | Rate: 0.29/s ad_set_objects: 1 | Time: 0.00s | Rate: 93206.76/s ----------------------- Extract meta_ads_rest_api_source ----------------------- Resources: 2/11 (18.2%) | Time: 10.00s | Rate: 0.20/s ad_set_objects: 1 | Time: 3.00s | Rate: 0.33/s ad_objects: 1 | Time: 0.00s | Rate: 79137.81/s Meta Ads adset insights window 2026-06-10..2026-06-12 failed (The read operation timed out). Retrying with smaller windows 2026-06-10..2026-06-10 and 2026-06-11..2026-06-12. ----------------------- Extract meta_ads_rest_api_source ----------------------- Resources: 6/11 (54.5%) | Time: 150.60s | Rate: 0.04/s ad_set_objects: 1 | Time: 143.60s | Rate: 0.01/s ad_objects: 1 | Time: 140.60s | Rate: 0.01/s ----------------------- Extract meta_ads_rest_api_source ----------------------- Resources: 6/11 (54.5%) | Time: 150.62s | Rate: 0.04/s ad_set_objects: 1 | Time: 143.61s | Rate: 0.01/s ad_objects: 1 | Time: 140.61s | Rate: 0.01/s ad_set_insight_values: 1 | Time: 0.00s | Rate: 97541.95/s ----------------------- Extract meta_ads_rest_api_source ----------------------- Resources: 7/11 (63.6%) | Time: 208.79s | Rate: 0.03/s ad_set_objects: 1 | Time: 201.79s | Rate: 0.00/s ad_objects: 1 | Time: 198.79s | Rate: 0.01/s ad_set_insight_values: 1 | Time: 58.17s | Rate: 0.02/s ----------------------- Extract meta_ads_rest_api_source ----------------------- Resources: 7/11 (63.6%) | Time: 208.80s | Rate: 0.03/s ad_set_objects: 1 | Time: 201.79s | Rate: 0.00/s ad_objects: 1 | Time: 198.79s | Rate: 0.01/s ad_set_insight_values: 1 | Time: 58.18s | Rate: 0.02/s fetch_skips: 1 | Time: 0.00s | Rate: 62601.55/s ----------------------- Extract meta_ads_rest_api_source ----------------------- Resources: 11/11 (100.0%) | Time: 208.93s | Rate: 0.05/s ad_set_objects: 250 | Time: 201.93s | Rate: 1.24/s ad_objects: 250 | Time: 198.93s | Rate: 1.26/s ad_set_insight_values: 7 | Time: 58.32s | Rate: 0.12/s fetch_skips: 1 | Time: 0.14s | Rate: 7.29/s ----------- Normalize meta_ads_rest_api_source in 1781296927.5442784 ----------- Files: 0/4 (0.0%) | Time: 0.00s | Rate: 0.00/s ----------- Normalize meta_ads_rest_api_source in 1781296927.5442784 ----------- Files: 0/4 (0.0%) | Time: 0.02s | Rate: 0.00/s ad_set_objects: 0 | Time: 0.00s | Rate: 0.00/s ----------- Normalize meta_ads_rest_api_source in 1781296927.5442784 ----------- Files: 1/4 (25.0%) | Time: 0.09s | Rate: 11.73/s ad_set_objects: 250 | Time: 0.06s | Rate: 4090.17/s ad_objects: 0 | Time: 0.00s | Rate: 0.00/s ----------- Normalize meta_ads_rest_api_source in 1781296927.5442784 ----------- Files: 2/4 (50.0%) | Time: 0.11s | Rate: 18.36/s ad_set_objects: 250 | Time: 0.08s | Rate: 2947.59/s ad_objects: 250 | Time: 0.02s | Rate: 10547.89/s ad_set_insight_values: 0 | Time: 0.00s | Rate: 0.00/s ----------- Normalize meta_ads_rest_api_source in 1781296927.5442784 ----------- Files: 3/4 (75.0%) | Time: 0.11s | Rate: 26.32/s ad_set_objects: 250 | Time: 0.09s | Rate: 2782.38/s ad_objects: 250 | Time: 0.03s | Rate: 8699.42/s ad_set_insight_values: 7 | Time: 0.01s | Rate: 1388.19/s fetch_skips: 0 | Time: 0.00s | Rate: 0.00/s ----------- Normalize meta_ads_rest_api_source in 1781296927.5442784 ----------- Files: 4/4 (100.0%) | Time: 0.18s | Rate: 22.16/s ad_set_objects: 250 | Time: 0.16s | Rate: 1599.21/s ad_objects: 250 | Time: 0.10s | Rate: 2625.67/s ad_set_insight_values: 7 | Time: 0.07s | Rate: 97.88/s fetch_skips: 1 | Time: 0.07s | Rate: 15.04/s ------------- Load meta_ads_rest_api_source in 1781296927.5442784 -------------- Jobs: 0/4 (0.0%) | Time: 0.00s | Rate: 0.00/s ------------- Load meta_ads_rest_api_source in 1781296927.5442784 -------------- Jobs: 7/8 (87.5%) | Time: 1.10s | Rate: 6.37/s ------------- Load meta_ads_rest_api_source in 1781296927.5442784 -------------- Jobs: 8/8 (100.0%) | Time: 1.17s | Rate: 6.85/s Pipeline meta_ads_pipeline load step completed in 1.17 seconds 1 load package(s) were loaded to destination postgres and into dataset meta_ads The postgres destination used postgresql://kpiper_dlt_app:***@[/cloudsql/pacelab-487114:europe-west4:pacelab-pg18-ew4]:5432/kpiper_data location to store data Load package 1781296927.5442784 is LOADED and contains no failed jobs [2026-06-12T20:45:38.519146] Command completed successfully. [2026-06-12T20:45:38.519633] Pipeline status payload: {"ad_account_id": "1813776638873121", "backfill_complete": true, "backfill_progress_mode": "incremental", "requested_end_date": "2026-06-12", "requested_start_date": "2026-06-10", "sync_mode": "incremental"}