Launching today
Inferock Bench
An independent receipt for every LLM API call
569 followers
An independent receipt for every LLM API call
569 followers
Inferock-bench is a local proxy that sits between your app and OpenAI, Anthropic, Gemini, or OpenRouter shaped calls. It captures per-call token usage, failures, and retries, then generates an independent receipt showing what you were billed and how much you're actually overpaying for.
Tracking retries alongside failures is a smart addition. Those hidden retries can quietly become a big part of the bill.
@desire_waterman Thank you! That matches our experience, no single retry looks expensive, it's the accumulation that stings. Glad that part stood out to you.
Love that this sits as a local proxy instead of asking me to route traffic through another cloud service. Keeps my API keys and data where they belong.
Inferock Bench
@peter_victor everything stays on your machine, we never see it.
The retry tracking caught my attention. I’ve seen failed requests become surprisingly expensive, so being able to trace each call would be useful to me.
Inferock Bench
@rahul_manjhi1 Failed requests being the expensive ones is such a strange truth of this stuff, you pay and get nothing usable back. Hope it earns a spot in your setup!
changing the baseURL and apiKey instead of rewriting the application is a nice touch. makes this much easier to test on an existing project.
Inferock Bench
@upendra_kumar17 that was a rule we set for ourselves, if trying it takes more than a minute nobody will ever find out what their calls really cost. Two settings in, and your app never knows the difference. Would be curious how it goes on your existing project.
Which API call actually cost me this money? is a question every AI app eventually needs to answer.
Inferock Bench
@santosh__kumar9 exactly, every team hits that question sooner or later. We just want the answer already sitting there when it happens.
Bababot
I like that Inferock Bench focuses on evidence rather than simply showing another dashboard. Having a separate record of every API call could make unexpected billing much easier to investigate.
Inferock Bench
@aarav_pittman thank you! Dashboards summarize, and summaries are where the weird stuff goes to hide. We wanted something closer to a paper trail, boring on purpose, there for the day you need to investigate.
The two setting setup makes this feel unusally easy to try.
Inferock Bench
@jordan_bulk thank you! Hopefully the receipts earn it the permanent spot.