Revalvo
Run prompts on every model at once. Score. Version. Ship.
Start new thread

Revalvo - Run prompts on every model at once. Score. Version. Ship.

by
•
Revalvo is a local-first workbench for prompt engineering and LLM evaluation. Run the same prompt against every model in parallel, score responses with 40 built-in evaluators, version prompts like code, and batch-test on datasets — before anything hits production. No account, no hosted database: your API keys stay in your browser.

Add a comment

Replies

Best
Maker
📌
We built Revalvo because chat playgrounds are fast but leave no receipt, and hosted eval platforms are rigorous but slow and server-side. Revalvo sits in the middle: sub-minute setup, side-by-side multi-model runs, git-style versioning, and batch eval in one local-first app. Try it: revalvo.com — paste an OpenRouter/any OpenAI Compatible providers key or run fully offline with Ollama. What we’d love feedback on: evaluator coverage, GitHub sync workflow, and which providers you want next. Built with BYOK — we never touch your keys or markup your API spend.

40 evaluators is the number I'd push on. Most eval suites I've used come down to another model grading the output, so the eval inherits the same failure mode as the thing it's grading. For each of those 40 I'd want to know upfront whether it's deterministic or a judge model, because I trust those two very differently. BYOK with no markup on API spend is the right call though.