Spinning up local LLM stacks with Harbor? Explore contenders:
Ollama for dead-simple local runs,
Mistral AI for open, portable models,
liteLLM to unify dozens of APIs,
opencode for a terminal-native agent, and
Eden AI to aggregate top providers behind one API.