Simon Spurrier

Simon Spurrier

cto.newcto.new
48 points
All activity
Most AI benchmarks are built backwards. Someone sits down, dreams up hard problems, and then measures how well agents solve them. The results are interesting, sure. But they don't always tell you what matters: how agents perform on the actual work that's sitting in your queue. That's why we built cto.bench. Instead of hypothetical tasks, we're building our benchmark from real work. Every data point on cto bench comes directly from how cto.new users are actually using our platform.
cto bench
cto benchThe ground truth code agent benchmark
Code with the latest frontier models from Anthropic, OpenAI and more. No credit card or API keys required. Get started for free at https://cto.new/product-hunt PS if you need an invite code, message someone on the team here on PH or on our Discord and tell 'em you came from PH
cto.new
cto.newCompletely free AI code agent