Sivaprakash Kumar

Sivaprakash Kumar

Building Agnostic LLM gateway

Badges

Tastemaker
Tastemaker
Gone streaking
Gone streaking

Maker History

  • Agnos LLM gateway
    Agnos LLM gatewayContain LiteLLM, Bifrost, Portkey.. behind one control plane
    Aug 2026
  • 🎉
    Joined Product HuntMarch 28th, 2024

Forums

Agnos LLM gateway - a gateway agnostic control plane that contains LiteLLM, Bifrost and Portkey

Hi folks,

I'm excited to share Agnos Proxy - an open-source (MIT) LLM governance gateway I've been working on.

Agnos LLM gateway - Contain LiteLLM, Bifrost, Portkey.. behind one control plane

Agnos is an OpenAI-compatible control plane that wraps the LLM gateway you already run. Keys stay in your encrypted vault (the gateway gets one per request and stores none); you get budgets, guardrails, routing, cost attribution and audit, and you can swap or combine gateways (litellm, bifrost, portkey etc) with a config change. MIT, self-hosted. Live demo, https://agnos-llm-gateway.site https://github.com/siva010928/ag...
View more