trending

6h ago

ModelPointer - Open-source AI Gateway for enterprise LLM infrastructure

Unlike traditional API gateways or simple LLM proxies, ModelPointer is an enterprise AI Gateway built in Rust for high performance. It is designed natively for LLM traffic with model-aware routing, API key management, RPM/TPM rate limiting, and observability. Hybrid-cloud ready, it can automatically burst traffic from self-hosted models to cloud providers when local capacity is exhausted.