All activity
Chintana Wilamunaleft a comment
I built this open source AI gateway to act as a standard interface between multiple LLM providers. There's a OpenAI API compatible HTTP interface as well as a gRPC interface. Start using the gateway with a docker command! Let me know what you like, dislike or what you like to see as additional features!
Open Source AI GatewayTalk to multiple LLMs thru a unified API
A configurable API gateway for multiple LLM providers (OpenAI, Anthropic, Gemini, Ollama, Mistral and Cohere) with built-in analytics, guardrails, rate limiting, caching and administrative controls. HTTP and gRPC interfaces
Open Source AI GatewayTalk to multiple LLMs thru a unified API