liteLLM
One library to standardize all LLM APIs
5.0•24 reviews•205 followers
One library to standardize all LLM APIs
5.0•24 reviews•205 followers
Simplify using OpenAI, Azure, Cohere, Anthropic, Replicate, Google LLM APIs. TLDR Call all LLM APIs using the chatGPT format - completion(model, messages) Consistent outputs and exceptions for all LLM APIs Logging and Error Tracking for all models
liteLLM Reviews
The community submitted 24 reviews to tell us what they like about liteLLM, what liteLLM can do better, and more.
5.0
Based on 24 reviews
Review liteLLM?
Reviewers mostly describe liteLLM as a practical abstraction layer for teams using several model providers. The clearest user feedback highlights it as an LLM proxy with caching, load balancing, local model support through Ollama, and an OpenAI-compatible API that works across many apps when the base URL is configurable. Founders from Budibase, SellerClaw, and ARBR echo that it reduces integration work, speeds switching and fallback between providers, and helps avoid vendor lock-in.
+21
Summarized with AI
Pros
Cons
Reviews
All Reviews
Most Informative