Self-hostable gateway between your app and any LLM provider. Built after Helicone went into maintenance mode.
What makes it different:
- Verifies RAG responses against source documents
- Flags hallucinations with zero latency added
- Traces multi-agent sessions visually
- Masks PII before storage
- Costs attributed by user, feature, agent step
9 providers. docker-compose up. MIT license. No data leaves your server.