Open Source AI Gateway

Open Source AI Gateway

Talk to multiple LLMs thru a unified API

8 followers

Visit website
A configurable API gateway for multiple LLM providers (OpenAI, Anthropic, Gemini, Ollama, Mistral and Cohere) with built-in analytics, guardrails, rate limiting, caching and administrative controls. HTTP and gRPC interfaces
Open Source AI Gateway gallery image
Open Source AI Gateway gallery image
Open Source AI Gateway gallery image
Open Source AI Gateway gallery image
Free
Launch tags:API•Artificial Intelligence•GitHub
Launch Team / Built With
Universal-3 Pro by AssemblyAI
Universal-3 Pro by AssemblyAI
Speech-to-text that finally understands context
Promoted

What do you think? …

Chintana Wilamuna
Maker
📌
I built this open source AI gateway to act as a standard interface between multiple LLM providers. There's a OpenAI API compatible HTTP interface as well as a gRPC interface. Start using the gateway with a docker command! Let me know what you like, dislike or what you like to see as additional features!