Launched this week
ngrok AI Gateway
One private gateway for every AI model
777 followers
One private gateway for every AI model
777 followers
ngrok AI Gateway provides one hosted gateway for every model: public providers, custom endpoints, and the models you run yourself. Use one key and one URL to route across OpenAI, Anthropic, and self-hosted models with observability, access control, and fallbacks built in. Your private models connect through ngrok’s network, so they sit beside hosted providers without being exposed to the public internet.
Payment Required
Launch Team / Built With
I've had so many requests to build this exact solution in house and rejections keep coming back. Most teams can't afford to build/manage these things. Great job solving this problem!
ngrok AI Gateway
@yazan_barakat
haha yep, it's a surprising amount of work for something that seems simple on the surface. we're hoping that users feel that using it is saving them a meaningful amount of time and/or avoided friction compared to going without it or building their own in-house solution :)
ngrok AI Gateway
@yazan_barakat Oh, we'd love to chat with you about what those requests look like and why they haven't stuck. We're here if you're interested!
The support for both cloud and self hosted models really caught my attention. That flexibilty feels valuable as projets grow.
Kilo Code
lfg! if you get a chance to give ngrok.ai a spin, make sure to add your review here: producthunt.com/products/ngrok-ai-gateway/reviews/new
Bababot
THe build in fallback feature sounds reassuring. It's alwaus nice to have something that keeps things running if one provider has issues. 👌
ngrok AI Gateway
@aarav_pittman And given how yellow-and-red the status pages look like for these providers (and hasn't gotten better over time), this is a problem that isn't going away.
Appreciate your support!
Serand
I like that security seems to be part of the design instead of an afterthought. Keeping private models protected while using public ones is a smart balance.
ngrok AI Gateway
@maali_baali Exactly, we see a ton of people still very much wanting to stick with the public providers because it's simple, (mostly) dependable, and relatively affordable, but don't want to commit themselves to architectures that they'd have to rip and replace completely if they eventually wanted to self-host everything on prem or in a neocloud. Future-proofing!
Thanks for your support!
Kilo Code
for further details, read this guide on securing endpoints and how access keys provide built-in authZ here: ngrok.com/docs/ai-gateway/guides/securing-endpoints
Premarket Bell
Having one gate way for both hosted and self hosted models sounds really useful. It feels like it could simplify a lot of infrastructure work.
Kilo Code
spot on. "simplicity" is a recurring adjective when it comes to describing @ngrok. "easy", "amazing", "awesome" also work. see their wall of love
Hello Niji, congratulations on the launch. I like that you are making it easier to switch between different AI providers without rewriting everything. That sounds like it could save me a lot of effort as projcts grow.
I've learned that infrastructure decisions matter more as products scale. This looks designed with long-term maintainability in mind.