trending
•

5h ago

Antirion - Your AI gateway should add 0.5 ms, not 20

Antirion sits between your apps and every LLM provider, and it is built to never be the slow part. One Rust binary with the console built in: point any OpenAI or Anthropic SDK at it and get fallbacks across providers, budgets per team and key, PII and secrets redaction, caching, and a log of every request with its route and cost. On 4 vCPUs it adds 0.5 ms at 5,000 RPS and holds 14,000 RPS, 4x Bifrost. Open source and self-hosted.