setup was a breeze with pip install and a three-line client to call GPT-4, Gemini, or Mistral. Automatic failover kicked in flawlessly when I hit a rate limit. Fully open-source and rock solid.
What's great
open source (1)easy setup (1)supports multiple LLMs (2)automatic failover (1)
Report
1 view