Launching today
ngrok AI Gateway
One private gateway for every AI model
653 followers
One private gateway for every AI model
653 followers
ngrok AI Gateway provides one hosted gateway for every model: public providers, custom endpoints, and the models you run yourself. Use one key and one URL to route across OpenAI, Anthropic, and self-hosted models with observability, access control, and fallbacks built in. Your private models connect through ngrok’s network, so they sit beside hosted providers without being exposed to the public internet.
Payment Required
Launch Team / Built With
Many companies struggle with switching models during outages. The built-in fallbacks seem useful, especially if users can define custom failover rules.
ngrok AI Gateway
@khaildnaseem A big +1 on custom failover rules! Seems like that's the big undercurrent of what people are looking for here. We had a version of this before, but it was too complex and we wanted to look at it again from first principles. I'll pass this to the team... any other thoughts on how we could design these custom rules to be most useful to you?
Tabstack by Mozilla
@khaildnaseem thanks for the support! if you get a chance to give ngrok.ai a spin, make sure to add your review here: producthunt.com/products/ngrok-ai-gateway/reviews/new
Bababot
THe build in fallback feature sounds reassuring. It's alwaus nice to have something that keeps things running if one provider has issues. 👌
ngrok AI Gateway
@aarav_pittman And given how yellow-and-red the status pages look like for these providers (and hasn't gotten better over time), this is a problem that isn't going away.
Appreciate your support!
Serand
I like that security seems to be part of the design instead of an afterthought. Keeping private models protected while using public ones is a smart balance.
ngrok AI Gateway
@maali_baali Exactly, we see a ton of people still very much wanting to stick with the public providers because it's simple, (mostly) dependable, and relatively affordable, but don't want to commit themselves to architectures that they'd have to rip and replace completely if they eventually wanted to self-host everything on prem or in a neocloud. Future-proofing!
Thanks for your support!
Tabstack by Mozilla
for further details, read this guide on securing endpoints and how access keys provide built-in authZ here: ngrok.com/docs/ai-gateway/guides/securing-endpoints
Premarket Bell
Having one gate way for both hosted and self hosted models sounds really useful. It feels like it could simplify a lot of infrastructure work.
Tabstack by Mozilla
spot on. "simplicity" is a recurring adjective when it comes to describing @ngrok. "easy", "amazing", "awesome" also work. see their wall of love
Managing different AI providers can get messy pretty quickly. A single endpoint with build in routing makes a lot of sense.
Hello Niji, congratulations on the launch. I like that you are making it easier to switch between different AI providers without rewriting everything. That sounds like it could save me a lot of effort as projcts grow.
The support for both cloud and self hosted models really caught my attention. That flexibilty feels valuable as projets grow.