Launching today
Antirion

Antirion

Your AI gateway should add 0.5 ms, not 20

2 followers

Antirion sits between your apps and every LLM provider, and it is built to never be the slow part. One Rust binary with the console built in: point any OpenAI or Anthropic SDK at it and get fallbacks across providers, budgets per team and key, PII and secrets redaction, caching, and a log of every request with its route and cost. On 4 vCPUs it adds 0.5 ms at 5,000 RPS and holds 14,000 RPS, 4x Bifrost. Open source and self-hosted.

Antirion makers

Here are the founders, developers, designers and product people who worked on Antirion