Matt Doughty

Big launch coming in four weeks.

Most agent tooling stops at the classic Observe - Evaluate loop. You can stop, pause, insert a human into your flows. But it mostly happens in development. Once agents hit production they're on their own, and engineers lean on Sentry or PostHog to find out something broke. Then improvement is you, by hand: digging through traces, tuning a prompt, redeploying, hoping.

We have had a lot of fun since the PH launch and making it to number 1. Such a great experience and everyone who got involved and helped us I am insanely grateful to.

As we move on from PH into helping teams evaluate their agents in real time, I'm looking to understand how everyone is doing it. Are you using static evals and running a hit and hope approach? Are you using off the shelf agent evals from OSS? Are you using a tool?

I'd love to know so we can improve what we have to make it the world class solution you don't have to think twice about when building your agents.

Prefactor finished #1 Product of the Day, and the response has been ridiculous.

To celebrate, anyone who signs up by Sunday and connects an agent will receive 1 million free spans.