Deliver crawler results to callback and mark processed
Deliver crawler results to callback and mark processed
Your crawler runs finish with no delivery confirmation, leaving requests unclear. It sends datasets to the configured callback and marks requests processed so coordinators can reconcile same day.
Overview
When crawler runs produce content but deliveries aren't confirmed, coordinators and platform engineers spend time reconciling requests. This workflow delivers the dataset to the recorded callback and marks the request processed so teams can reconcile and report same day.