Launching today
Auriko
Trading desk for LLM calls
286 followers
Trading desk for LLM calls
286 followers
Auriko treats LLM providers as trading venues and arbitrages the spread. Built by ex-quant traders, Auriko’s cost-arbitrage engine calibrates to each user’s request patterns and selects optimized inference paths based on token price, cache behavior, latency, reliability, and request quality. Auriko benchmarks show average 30% cost reduction against industry peers and direct providers. See the source: https://www.auriko.ai/reports/llm-cost-arbitrage
Can developer set their own priorities, like preferring lower latency over lower cost, or is the routing fully automatic?
How do you measure quality when routing across models? Do you use developer feedback, user behavior, retries, or some kind of evaluation layer?
Congrats on the launch! , Doesn't cheapest-per-request routing fight with caching though? If you hop providers to save on one call you lose the warm cache you built at the last one, and the next 20 calls cost more. Curious if the router accounts for that or just prices each call on its own.
The 30% cost reduction number, is that on top of what you'd already save by using OpenRouter or similar, or is that the comparison baseline?
The quality bar for production AI apps is high, so cache aware routing needs good observability.
I like that the focus is not just more models, but using the right route for each request.