Launching today
Inferock Bench
An independent receipt for every LLM API call
434 followers
An independent receipt for every LLM API call
434 followers
Inferock-bench is a local proxy that sits between your app and OpenAI, Anthropic, Gemini, or OpenRouter shaped calls. It captures per-call token usage, failures, and retries, then generates an independent receipt showing what you were billed and how much you're actually overpaying for.
The retry tracking caught my attention. I’ve seen failed requests become surprisingly expensive, so being able to trace each call would be useful to me.
changing the baseURL and apiKey instead of rewriting the application is a nice touch. makes this much easier to test on an existing project.
Which API call actually cost me this money? is a question every AI app eventually needs to answer.
Bababot
I like that Inferock Bench focuses on evidence rather than simply showing another dashboard. Having a separate record of every API call could make unexpected billing much easier to investigate.