Big launch coming in four weeks.
Most agent tooling stops at the classic Observe - Evaluate loop. You can stop, pause, insert a human into your flows. But it mostly happens in development. Once agents hit production they're on their own, and engineers lean on Sentry or PostHog to find out something broke. Then improvement is you, by hand: digging through traces, tuning a prompt, redeploying, hoping.
Congratulations on the launch! Runtime enforcement is a really interesting direction. One challenge I've been thinking about is that agents are evolving quickly, so evaluation itself needs to evolve as well? Looking forward to seeing where the platform goes.
Voquill
I like that this is built around production instead of just benchmarks. That's where things usually get interesting. Congrats on the launch!
Prefactor
@henry_habib Thanks Henry, and thanks for the comment. Benchmarks are great in controlled envs. Agents don't operate in hermetically sealed containers. They exist in the wild. We needed to meet that challenge.
Voquill
@matt_doughty Exactly. That's where you find the issues you'd never catch in a controlled environment.
Prefactor
@henry_habib Thank you! Yes, production is where things tend to get real pretty quickly. Understanding how your benchmarks/evals translate to the real world is super important.
Prefactor
@henry_habib thanks for the comment, Henry! We agree, an agent demo on a developers laptop is one thing, but once it hits a production environment that where the fun really begins. Are you deploying anything into production currently?
Voquill
@joshgillies Couldn't agree more. Yeah, hoping to get our first deployment live soon.
Prefactor
@henry_habib great to hear! Let us know how you go getting it going, and any issues we're here to help!
Prefactor
@henry_habib Thanks for the support Henry and yes 100% agreed. Evals and testing shouldn't stop the moment it hits prod.
Are you building much agents?
Voquill
@ethan_lee8 Yeah, working on an app right now.
Prefactor
@henry_habib Nice whats the app?
Intent by Upflowy
Fantastic product and team, very excited to see them launch here, congratulations on the successful launch of the product!
Prefactor
@matthew_browne1 Thanks Matt. It means a lot coming from you! Thanks for all of the support. To the moon!!!!!!
FuseBase
we're all out here shipping agents with our eyes closed and calling it deployment 😅 congrats on a great launch @ethan_lee8 @matt_doughty
Prefactor
@matt_doughty @kate_ramakaieva thanks so much Kate for your help!
Prefactor
Novu
Great product, and very much in need these days!
Prefactor
@tomer_barnea1 thanks, Tomer! We believe it's an essential platform for anyone building production agents. How are you managing your agents at scale currently?
Prefactor
@tomer_barnea1 Thank you Tomer. I owe you a callback.
Prefactor
@tomer_barnea1 Thanks for the support Tomer!
Awesome product team!
Prefactor
@ethan_lee14 Thanks Ethan! Appreciate the support!
Prefactor
Dumb Phone
fantastic work guys, looking forward to weaving in these kinds of alerts!
Prefactor
@teeeeeegz thanks for the support! The video we put out is all the better from your early feedback! ♥️
Lets get your agents cooking on Prefactor ASAP!