Most useful open-weight models still don’t have a hosted API. You either rent a GPU, leave a Mac running overnight, or send prompts somewhere that can read them.
Umbra is my experiment: an OpenAI-compatible endpoint (Anthropic-compatible too) where Apple Silicon owners host public Hugging Face GGUFs they approve. You swap base_url, keep your existing client, pay per token.
Try it: https://tryumbra.dev
Quickstart: https://tryumbra.dev/docs/quicks...
Host a Mac: https://tryumbra.dev/setup
