Chinmay Singh

Chinmay Singh

TrueFoundry AI GatewayTrueFoundry AI Gateway
Building TrueFoundry
All activity
TrueFoundry’s AI Gateway is the production-ready, control plane to experiment with, monitor and govern your agents. Experiment with connecting all agent components together (Models, MCP, Guardrails, Prompts & Agents) in the playground. Maintain complete visibility over responses with traces and health metrics. Govern by setting up rules/limits on request volumes, cost, response content (Guardrails) and more. Being used in production for 1000s of agents by multiple F100 companies!
TrueFoundry AI Gateway
TrueFoundry AI GatewayConnect, observe & control LLMs, MCPs, Guardrails & Prompts
Chinmay Singhstarted a discussion

Learnings from shipping MCPs to production. Also, we go live tomorrow 🎉

MCPs are winning the protocol race. As a result, we have seen multiple F500 enterprises go live with them. For every company, this has brought the same rough edges to light. Our repeatable learnings are: Identity first: Decide who can call which tool, with what scope, and how tokens rotate. OAuth and role-based access stop approval chaos. Stop config sprawl: As servers grow, clients should not...

Chinmay Singhstarted a discussion

AI Gateways: from “just a proxy” to the GenAI control plane

A year ago, an “AI/LLM Gateway” felt like a thin layer: auth + simple routing across a few model providers. That era’s over. As teams ship agentic apps with many moving parts (models, tools via MCP, prompts, guardrails) the complex problems are now control, standardization, and observability. What a modern gateway really does: Unified interface & routing: Swap models/providers without code...