We use OpenRouter to optimize for maximum uptime for all of the third-party models that power Olive. We built Olive around many models across Anthropic, OpenAI, Google, including even open weight models without sacrificing valuable engineering time.
We use Cloudflare Workers for Platforms & Containers to run AI generated code in secure, isolated environments while still giving us flexibility to handle authentication, permissioning, and audit logging for our customers.