Umbra - OpenAI-compatible API for models nobody else hosts
by•
Most useful open-weight models still don’t have a hosted API. You either rent a GPU, leave a Mac running overnight, or send prompts somewhere that can read them.
Umbra is my experiment: an OpenAI-compatible endpoint (Anthropic-compatible too) where Apple Silicon owners host public Hugging Face GGUFs they approve. You swap base_url, keep your existing client, pay per token.
Try it: https://tryumbra.dev
Quickstart: https://tryumbra.dev/docs/quicks...
Host a Mac: https://tryumbra.dev/setup

Replies
the OpenAI and Anthropic compat layer is a nice touch, means i can swap base_url and actually use my existing client instead of writing a wrapper. love that you sidestepped the GPU rental trap