Trace, evaluate, and protect every LLM call your app makes. Drop-in TypeScript SDK for OpenAI, Anthropic, Gemini and more. Evals, PII redaction, cost tracking. Open-source. EU-hosted.
No reviews yetBe the first to leave a review for Grepture
Maker
📌
Hey Product Hunt 👋
I'm Ben, founder of Grepture.
I work as a tech lead at an AI startup and wanted one place to see every AI call our app made, score whether the answers were any good, redact the PII before it left my network, and track what it was costing us. Plenty of tools did one of those things. None did all four on the request path itself.
So I built Grepture: An AI gateway that sits between your app and any LLM provider. However, you get to decide whether you add a proxy-hop and tinker with requests and responses in the hot path, or just track observability async in trace-mode.
Some of the highlights:
• Full traces of every request, including multi-step conversations
• LLM-as-a-judge evals running on live traffic and automatic dataset creation
• Automatic PII detection + redaction and rehydration before data hits the LLM
• Per-request cost and token analytics
• A zero-retention mode where prompt bodies never hit our DB (we're EU-hosted)
• CLI to pipe full dev sessions through the proxy
The proxy, CLI and SDK are open source already and the plan is to make the app available to self-host as well eventually. Right now we're focussed on making everything more useful for AI heavy products and optimize for developer experience.
Happy to hear what y'all think. You can also shoot me an email at ben@grepture.com – I try to read and reply to every mail, always.