liteLLM
One library to standardize all LLM APIs
5.0•23 reviews•194 followers
One library to standardize all LLM APIs
5.0•23 reviews•194 followers
Simplify using OpenAI, Azure, Cohere, Anthropic, Replicate, Google LLM APIs. TLDR Call all LLM APIs using the chatGPT format - completion(model, messages) Consistent outputs and exceptions for all LLM APIs Logging and Error Tracking for all models
liteLLM Reviews
The community submitted 23 reviews to tell us what they like about liteLLM, what liteLLM can do better, and more.
5.0
Based on 23 reviews
Review liteLLM?
Reviewers describe liteLLM in a focused, practical way: it helps teams work across multiple model providers through one consistent interface, making it easier to switch models, add fallbacks, and avoid rebuilding integrations. A user says it works well as an LLM proxy, with caching, load balancing across services like Groq and OpenRouter, local use with Ollama, and compatibility with OpenAI-style APIs. Makers of Budibase and SellerClaw also credit it with reducing integration complexity and adding routing, retries, and usage tracking.
+20
Summarized with AI
Pros
Cons
Reviews
All Reviews
Most Informative