SentinelGateway is a fast, zero-dependency Go proxy that eliminates LLM downtime, compliance leaks, and token waste. • Drop-In: 1-line OpenAI base_url swap. • Auto-Failover: Routes across Claude, Groq, and Gemini in <25ms on 5xx/429 errors. • In-Flight Privacy: Strips PII with zero data retention. • Smart Caching: Sub-15ms Redis semantic hits. • Telemetry: Real-time cost, error, and latency tracking.
Hey Product Hunt! 👋
We built SentinelGateway out of frustration with single-provider fragility in production. Whenever OpenAI throws a 503 or Anthropic hits a 529 overload, client apps crash. On top of that, sending raw customer prompts to third-party APIs without sanitization is a compliance liability.
Rather than forcing teams to install heavy wrapper SDKs or deal with high proxy overhead, we engineered SentinelGateway in Go:
Zero SDK changes: Swap your base_url in standard OpenAI clients.
Resilience: Auto-failover across Claude, GPT-4o, Groq, and Gemini in <25ms.
Privacy first: Zero-retention, in-flight PII redaction in memory.
Speed & cost: Atomic Redis semantic caching to slash repeat token costs.
We are live with a free tier so you can test failover routing in your staging environment right away.
Would love your feedback on the routing performance, proxy latency, or features you’d like to see next!