Nick Stogner

Nick Stogner

Nick
3 points
All activity
Unleash your AI agents ... in a sandbox! SandboxAI is an open source runtime for securely executing AI-generated Python code and shell commands in isolated sandboxes.
SandboxAI: Run AI Generated Code Safely
SandboxAI: Run AI Generated Code SafelyRun AI generated code in isolated sandboxes
✅️ Drop-in replacement for OpenAI with API compatibility
🚀 Serve OSS LLMs on CPUs or GPUs
⚖️ Autoscaling with scale from 0
🛠️ Zero dependencies (no Istio, Knative, etc.)
🤖 Operates OSS model servers (vLLM and Ollama)
🔋 Chat UI included
KubeAI: Private Open AI on K8s
KubeAI: Private Open AI on K8sServe LLMs privately with an OpenAI API compatible API