LLMTest
Use the right LLMs in your apps. Setup fallbacks. Be happy.
Start new thread
Tom Jacquesson

LLMTest - Use the right LLMs in your apps. Setup fallbacks. Be happy.

by
Taplio
•
"OpenRouter + Intelligence" LLMTest helps devs and vibe coders automatically: ✅ Pick better models for AI-powered features (faster, cheaper, better, sometimes all 3 combined) ↪️ Automatically add fallbacks when LLM providers fail (API is overloaded or JSON format isn't respected) All through one single API and MCP functions so you can just tell Claude or Codex to optimize everything.

Add a comment

Replies

Best
Tom Jacquesson
Maker
📌
Hey PH! I'm Tom and I created LLMTest to solve one of my own problems. I was constantly trying to figure out which LLM models to choose to power AI features in my products. So I was using OpenRouter and Claude to create custom webapps for each use case. But all the tests were still "manual" and I had to decide for myself which of 300+ models I would end up using. I thought others might be facing the same issue. So I created LLMTest: an API and MCP server that lets anyone (coder or vibe coder) just run automatic tests on their own AI flows and pick winners. And I added automatic fallbacks so that even if an API is down or not returning a JSON like requested, my apps don't break in production. To sum things up: ✅ One API. One invoice. 300+ models available, refreshed daily. 🤖 Ask Claude Code / Codex to optimize AI features using LLMTest 🏆 Use better, faster and/or cheaper models in your apps ↪️ Smart fallbacks: forget timeouts, overloads, and bad JSON output 💰 Pay per use. Start with $5. Top-up anytime. I'd love to get your feedback on this ❤️
Farrukh Butt

The automatic fallback part is the strongest hook for me. Choosing the right model is useful, but making sure an AI feature does not break when a provider times out or returns bad JSON feels even more important in production.