Launching today
ModelPointer
Open-source AI Gateway for enterprise LLM infrastructure
3 followers
Open-source AI Gateway for enterprise LLM infrastructure
3 followers
Unlike traditional API gateways or simple LLM proxies, ModelPointer is an enterprise AI Gateway built in Rust for high performance. It is designed natively for LLM traffic with model-aware routing, API key management, RPM/TPM rate limiting, and observability. Hybrid-cloud ready, it can automatically burst traffic from self-hosted models to cloud providers when local capacity is exhausted.
