Launching Tomorrow!
Your engineers are already using AI all day. Claude Code in the terminal, LangChain inside the app, an OpenClaw session nobody mentioned in standup, and some script from March that still calls the OpenAI API directly.
None of it routes through anything and there's no front door. So three problems pile up at once and you can't fix any one of them on its own.
You can't see it. Nobody can answer "what did we send to an LLM last week, and who sent it" without a spreadsheet and a genuinely bad afternoon.
You can't control it. PII and secrets go out, toxic content comes back, and nothing along the way is looking. Your AI policy lives in a Confluence page rather than in the request.
You can't budget for it. Token spend grows on its own and no one person owns the number.
The usual response is to buy a gateway for routing, an observability tool for reporting, and a governance platform for the paperwork. Three tools, three bills, three dashboards that don't talk to each other, and still nothing enforcing anything where the traffic actually is.
Replies