1.Catches evaluation payload
Integrate Webhooks by Zapier and parsing tools to extract summary and full details into variables for downstream steps.
Create eval run records from incoming webhook reports
Automatically monitor incoming evaluation payloads across Webhooks by Zapier and Slack. Create and update run records when evaluation payloads arrive, run markers appear, or permalinks are shared—so you can post summaries, thread details, and log structured runs without manual logging noise.
How this automation logs eval run records
When evaluation payloads arrive, delays can break audit trails and analysis timelines. This automation captures message context and creates structured run records by posting Slack summaries, threading full details, and writing to Zapier Tables—so your team can review runs reliably.
Webhooks by Zapieror swap with your favorite app
2.Sends channel summary
Integrate Slack and messaging workflows to post the extracted summary and capture the message timestamp.
Slackor swap with your favorite app
3.Posts threaded details
Integrate Slack and threaded replies to send full details as a reply using the original message timestamp.
4.Filters by run marker
Integrate Filter by Zapier and validation rules to continue only when the payload includes a run marker or qualifier.
Filter by Zapieror swap with your favorite app
5.Creates run record
Integrate Zapier Tables and database tooling to create a structured run record with marker, permalink, summary, and reporter.
Zapier Tablesor swap with your favorite app
Automate your work, your way
Build custom automations across your tools in minutes. Describe what you need, connect your apps, and create workflows without the manual effort.
Trusted by 3.4 million companies
Related automations
- Apps: Zapier Forms, Code by Zapier, Webhooks by Zapier, ChatGPT (OpenAI), Zapier TablesSwap with your favorite apps.
Create structured prompt test records from form submissions
Your prompt tests arrive as free text, preventing engineers from comparing predictions with gold labels. You get structured evaluation records and key metrics so teams can iterate on prompts same day.
- View all
Explore all experiment tracking automations
Improve experiment visibility with automated run logging, metric alerts, and results documentation
Set up in minutes
Zapier connects your tools, triggers actions from real-time data, and streamlines workflows so your team can focus on what matters most.
Step 1
Connect your tools
Bring your apps together so information can move automatically between the tools your team already uses.
Step 2
Define the trigger
Choose the events that should start your workflow, like a new submission, updated record, completed task, or customer action.
Step 3
Automate and measure
Let your workflow handle follow-ups, updates, notifications, and reporting so your team can track progress and act faster.
See how teams are automating with Zapier (and loving it!)
Without Zapier, we would have needed well over 100 employees today just to do what we're doing. We would have been out of business by now.
David Laderberg, VP of Sales
Without having automation, we would have to at least be double our size. Doubling is a bit of a euphemism — I think we would have died or fallen back into oblivion.
Marcelo Lebre, Co-Founder
Zapier helps us close far above 50% more deals than we would without it. It is a key element of our overall strategy and, therefore, of our sales pitch.
Raphael Bochner, Founder and CIO
Zapier gives us unlimited flexibility and creativity. With Zapier, you're like an artist with a blank canvas. I don't know what we'd do without it.
Rishi Shah, CEO and Co-Founder
We don't just want to patch holes; we want to build scalable, future-proof systems. Zapier is helping us do that.
Allen Lai, Head of Customer Experience
We've been able to scale our operations while staying lean. Zapier lets us do more without needing more people.
Jacob Sirrs, Marketing Operations Specialist
Ready to automate your workflow securely?
Streamline processes, uncover new opportunities, and respond faster to change. Empower your team to get more done, without the manual work.