RepoGym
p/repogym
Validate the task before you benchmark the coding agent
0 reviews1 follower
Start new thread
trending

3h ago

RepoGym - Validate the task before you benchmark the coding agent

Turn repository tasks into repeatable coding-agent evaluations. Define a task, check that doing nothing fails and the reference fix passes, then inspect scores and trajectories. Includes Python and JavaScript examples, composable graders, task mining and HTML reports. Free, MIT-licensed Python library. Start from the source checkout; local execution is for trusted code.