Pranay Batta

Pranay Batta

AI Evals | Growth Marketing
#88019042 followers8 following

Badges

Tastemaker
Tastemaker
Gone streaking 10
Gone streaking 10
Gone streaking
Gone streaking
Gone streaking 5
Gone streaking 5

Recently Supported

Meet-Ting
Meet-TingAI that gives your schedule a brain.
RightNow AI Code Editor
RightNow AI Code EditorThe first GPU-native code editor with AI
Vireel
VireelAI Reels from Proven Viral Formulas
Haimeta
HaimetaCreate stunning images, vivid videos, and lifelike 3D assets
Shipper.now
Shipper.nowBuild full-stack apps by talking to AI
Bifrost
BifrostThe fastest LLM gateway in the market
Equip AI Interview
Equip AI InterviewAsk any question. Natural language response. Instant results
SellibleThe sales gym for founders

Forums

Pratham Mishra•

9mo ago

Hello PH, I am Pratham and we are launching the fastest LLM Gateway out there!

Hi folks I m Pratham, an engineer, former founder, and a full-time infra nerd.

I ve been building since college, when I founded a startup called Interact, which scaled to more than 7000 active users in just 3 months and since then, I ve stayed obsessed with backend systems that are fast, stable, and scale effortlessly. Lately, I ve been working on Bifrost, an open-source, and the latest LLM gateway written in Go.

If you're building LLM apps and running into bottlenecks with tools like LiteLLM, Bifrost might be worth a look. It s fully self-hosted, adds only ~11 s mean overhead at 5K RPS, and supports providers like OpenAI, Anthropic, Mistral, Groq, Bedrock, and more. It also comes with built-in monitoring, real-time configuration, governance, MCP support, and a clean web UI to manage it all.

View more