KubeAI: Private Open AI on K8s

KubeAI: Private Open AI on K8s

Serve LLMs privately with an OpenAI API compatible API

20 followers

✅️ Drop-in replacement for OpenAI with API compatibility 🚀 Serve OSS LLMs on CPUs or GPUs ⚖️ Autoscaling with scale from 0 🛠️ Zero dependencies (no Istio, Knative, etc.) 🤖 Operates OSS model servers (vLLM and Ollama) 🔋 Chat UI included
KubeAI: Private Open AI on K8s gallery image
KubeAI: Private Open AI on K8s gallery image
KubeAI: Private Open AI on K8s gallery image
KubeAI: Private Open AI on K8s gallery image
Free
Launch Team
Render Sandboxes: a computer for every agent
Render Sandboxes: a computer for every agentGive every agent its own machine. Starts in under a second
Promoted