Metadata
Target
netflixit
Sync template
Instagram Graph - Webhook Reconcile
Status
success
Started
2026-05-12 22:19:22.930561
Finished
2026-05-13 04:02:32.645172
Error
—
Log
17179 | Time: 20545.81s | Rate: 0.84/s
------------------- Extract instagram_graph_rest_api_source --------------------
Resources: 1/2 (50.0%) | Time: 20551.66s | Rate: 0.00/s
media_objects: 24 | Time: 20551.66s | Rate: 0.00/s
media_comments: 3 | Time: 20550.73s | Rate: 0.00/s
media_comment_replies: 17180 | Time: 20547.22s | Rate: 0.84/s
------------------- Extract instagram_graph_rest_api_source --------------------
Resources: 2/2 (100.0%) | Time: 20551.72s | Rate: 0.00/s
media_objects: 24 | Time: 20551.71s | Rate: 0.00/s
media_comments: 3 | Time: 20550.78s | Rate: 0.00/s
media_comment_replies: 17180 | Time: 20547.27s | Rate: 0.84/s
------------------- Extract instagram_graph_rest_api_source --------------------
Resources: 0/1 (0.0%) | Time: 0.00s | Rate: 0.00/s
------------------- Extract instagram_graph_rest_api_source --------------------
Resources: 0/1 (0.0%) | Time: 0.00s | Rate: 0.00/s
_dlt_pipeline_state: 1 | Time: 0.00s | Rate: 149796.57/s
------------------- Extract instagram_graph_rest_api_source --------------------
Resources: 1/1 (100.0%) | Time: 0.02s | Rate: 50.59/s
_dlt_pipeline_state: 1 | Time: 0.02s | Rate: 66.38/s
-------- Normalize instagram_graph_rest_api_source in 1778624392.403687 --------
Files: 0/4 (0.0%) | Time: 0.00s | Rate: 0.00/s
-------- Normalize instagram_graph_rest_api_source in 1778624392.403687 --------
Files: 0/4 (0.0%) | Time: 0.02s | Rate: 0.00/s
media_comment_replies: 0 | Time: 0.00s | Rate: 0.00/s
-------- Normalize instagram_graph_rest_api_source in 1778624392.403687 --------
Files: 0/4 (0.0%) | Time: 1.07s | Rate: 0.00/s
media_comment_replies: 5000 | Time: 1.05s | Rate: 4748.73/s
-------- Normalize instagram_graph_rest_api_source in 1778624392.403687 --------
Files: 0/4 (0.0%) | Time: 2.49s | Rate: 0.00/s
media_comment_replies: 10000 | Time: 2.47s | Rate: 4050.50/s
-------- Normalize instagram_graph_rest_api_source in 1778624392.403687 --------
Files: 0/4 (0.0%) | Time: 3.78s | Rate: 0.00/s
media_comment_replies: 15000 | Time: 3.76s | Rate: 3991.29/s
-------- Normalize instagram_graph_rest_api_source in 1778624392.403687 --------
Files: 1/4 (25.0%) | Time: 4.24s | Rate: 0.24/s
media_comment_replies: 17180 | Time: 4.22s | Rate: 4071.44/s
media_objects: 0 | Time: 0.00s | Rate: 0.00/s
-------- Normalize instagram_graph_rest_api_source in 1778624392.403687 --------
Files: 2/4 (50.0%) | Time: 4.25s | Rate: 0.47/s
media_comment_replies: 17180 | Time: 4.23s | Rate: 4065.07/s
media_objects: 24 | Time: 0.01s | Rate: 3621.89/s
media_comments: 0 | Time: 0.00s | Rate: 0.00/s
-------- Normalize instagram_graph_rest_api_source in 1778624392.403687 --------
Files: 3/4 (75.0%) | Time: 4.25s | Rate: 0.71/s
media_comment_replies: 17180 | Time: 4.23s | Rate: 4061.05/s
media_objects: 24 | Time: 0.01s | Rate: 2221.31/s
media_comments: 3 | Time: 0.00s | Rate: 716.81/s
_dlt_pipeline_state: 0 | Time: 0.00s | Rate: 0.00/s
2026-05-13 04:02:28,651|[WARNING]|6301|140502122787584|dlt|validate.py|verify_normalized_table:113|In schema `instagram_graph_rest_api_source`: The following columns in table 'media_comments' did not receive any data during this load and therefore could not have their types inferred:
- parent_comment_id
Unless type hints are provided, these columns will not be materialized in the destination.
One way to provide type hints is to use the 'columns' argument in the '@dlt.resource' decorator. For example:
@dlt.resource(columns={'parent_comment_id': {'data_type': 'text'}})
-------- Normalize instagram_graph_rest_api_source in 1778624392.403687 --------
Files: 4/4 (100.0%) | Time: 4.36s | Rate: 0.92/s
media_comment_replies: 17180 | Time: 4.34s | Rate: 3956.36/s
media_objects: 24 | Time: 0.12s | Rate: 195.52/s
media_comments: 3 | Time: 0.12s | Rate: 25.83/s
_dlt_pipeline_state: 1 | Time: 0.11s | Rate: 8.93/s
---------- Load instagram_graph_rest_api_source in 1778624392.403687 -----------
Jobs: 0/4 (0.0%) | Time: 0.00s | Rate: 0.00/s
---------- Load instagram_graph_rest_api_source in 1778624392.403687 -----------
Jobs: 5/7 (71.4%) | Time: 1.57s | Rate: 3.19/s
---------- Load instagram_graph_rest_api_source in 1778624392.403687 -----------
Jobs: 6/7 (85.7%) | Time: 3.24s | Rate: 1.85/s
---------- Load instagram_graph_rest_api_source in 1778624392.403687 -----------
Jobs: 7/7 (100.0%) | Time: 3.29s | Rate: 2.13/s
Pipeline instagram_graph_pipeline load step completed in 3.29 seconds
1 load package(s) were loaded to destination postgres and into dataset instagram_graph
The postgres destination used postgresql://kpiper_dlt_app:***@[/cloudsql/pacelab-487114:europe-west4:pacelab-pg18-ew4]:5432/kpiper_data location to store data
Load package 1778624392.403687 is LOADED and contains no failed jobs
[2026-05-13T04:02:32.631880] Command completed successfully.
[2026-05-13T04:02:32.632398] Pipeline status payload: {"backfill_complete": true, "backfill_progress_mode": "incremental", "ig_user_id": "17841401286038439", "sync_mode": "incremental"}