liteLLM
One library to standardize all LLM APIs
5.0•22 reviews•192 followers
One library to standardize all LLM APIs
5.0•22 reviews•192 followers
Simplify using OpenAI, Azure, Cohere, Anthropic, Replicate, Google LLM APIs. TLDR Call all LLM APIs using the chatGPT format - completion(model, messages) Consistent outputs and exceptions for all LLM APIs Logging and Error Tracking for all models
liteLLM Reviews
The community submitted 22 reviews to tell us what they like about liteLLM, what liteLLM can do better, and more.
5.0
Based on 22 reviews
Review liteLLM?
Reviewers describe liteLLM as a practical way to sit between apps and multiple model providers, mainly to avoid vendor lock-in and cut integration work. Users say it works well as an LLM proxy, with caching, load balancing across services like Groq, OpenRouter, and local Ollama, plus compatibility with OpenAI-style APIs and Langfuse-based monitoring. Founders from Budibase and SellerClaw echo that, highlighting a clean abstraction layer, easy model switching and fallbacks, and built-in routing, retries, and usage tracking.
+19
Summarized with AI
Pros
Cons
Reviews
All Reviews
Most Informative