Launching today
Inferock Bench
An independent receipt for every LLM API call
369 followers
An independent receipt for every LLM API call
369 followers
Inferock-bench is a local proxy that sits between your app and OpenAI, Anthropic, Gemini, or OpenRouter shaped calls. It captures per-call token usage, failures, and retries, then generates an independent receipt showing what you were billed and how much you're actually overpaying for.
@etiennegarcia Thank you! The retries and weird token counts are the bits that never show up on the bill. Really appreciate the kind words on launch day!
The independent receipt idea is really practical. It's nice to have a way to verify token usage instead of relying only on provider dashboards.
@athar_jatoi Thank you! It always felt a little odd that the only record of what we bought came from the company selling it, so now you can keep your own. Glad it's practical!
Buffup.AI
The retry tracking caught my eye. silent retries are probably one of the easiest ways for API costs to creep up without anyone noticing.
@sansa_grey Right, retries are the sneakiest of the bunch: the answer still arrives, everything looks fine, and the bill just grows. Making those visible was one of the first things we wanted for ourselves.
Tracking retries alongside failures is a smart addition. Those hidden retries can quietly become a big part of the bill.
@desire_waterman Thank you! That matches our experience, no single retry looks expensive, it's the accumulation that stings. Glad that part stood out to you.
I like the positioning here, it's not trying to replace the provider's billing system, just verify it. That's a smarter pitch than "cost optimization," which every tool claims.
I've been burned by silent retries inflating my OpenAI bill before. Having an independent receipt for that would've saved me a painful invoice conversation.
Love that this sits as a local proxy instead of asking me to route traffic through another cloud service. Keeps my API keys and data where they belong.