Open Source AI Gateway

Talk to multiple LLMs thru a unified API

8 followers

Talk to multiple LLMs thru a unified API

8 followers

A configurable API gateway for multiple LLM providers (OpenAI, Anthropic, Gemini, Ollama, Mistral and Cohere) with built-in analytics, guardrails, rate limiting, caching and administrative controls. HTTP and gRPC interfaces

Overview
Launches1
Reviews
Team
More

Free

Launch tags:API•Artificial Intelligence•GitHub

Launch Team / Built With

Unblocked AI Code Review — High-signal comments based on your team's context

High-signal comments based on your team's context

Promoted

Maker

📌

I built this open source AI gateway to act as a standard interface between multiple LLM providers. There's a OpenAI API compatible HTTP interface as well as a gRPC interface. Start using the gateway with a docker command! Let me know what you like, dislike or what you like to see as additional features!

Report

12mo ago