Hi folks I m Pratham, an engineer, former founder, and a full-time infra nerd.
I ve been building since college, when I founded a startup called Interact, which scaled to more than 7000 active users in just 3 months and since then, I ve stayed obsessed with backend systems that are fast, stable, and scale effortlessly. Lately, I ve been working on Bifrost, an open-source, and the latest LLM gateway written in Go.
If you're building LLM apps and running into bottlenecks with tools like LiteLLM, Bifrost might be worth a look. It s fully self-hosted, adds only ~11 s mean overhead at 5K RPS, and supports providers like OpenAI, Anthropic, Mistral, Groq, Bedrock, and more. It also comes with built-in monitoring, real-time configuration, governance, MCP support, and a clean web UI to manage it all.
