Launching today
Umbra
OpenAI-compatible API for models nobody else hosts
6 followers
OpenAI-compatible API for models nobody else hosts
6 followers
Most useful open-weight models still don’t have a hosted API. You either rent a GPU, leave a Mac running overnight, or send prompts somewhere that can read them. Umbra is my experiment: an OpenAI-compatible endpoint (Anthropic-compatible too) where Apple Silicon owners host public Hugging Face GGUFs they approve. You swap base_url, keep your existing client, pay per token. Try it: https://tryumbra.dev Quickstart: https://tryumbra.dev/docs/quickstart Host a Mac: https://tryumbra.dev/setup
Umbra Reviews
Pros
Cons
Reviews