liteLLM

One library to standardize all LLM APIs

5.0•23 reviews•

204 followers

One library to standardize all LLM APIs

5.0•23 reviews•

204 followers

Visit website

Unified API

•

AI Infrastructure Tools

Simplify using OpenAI, Azure, Cohere, Anthropic, Replicate, Google LLM APIs. TLDR Call all LLM APIs using the chatGPT format - completion(model, messages) Consistent outputs and exceptions for all LLM APIs Logging and Error Tracking for all models

Free

Launch tags:API•Open Source•Developer Tools

Launch Team

Viktor.comAn AI coworker that actually does the work

Promoted

liteLLM

Maker

📌

Hi Producthunt, @krrish_dholakia and I are super excited to be launching 🚅 liteLLM An Open Source Python library to standardize LLM Inputs/Outputs for 50+ models (OpenAI, Anthropic, Cohere etc) :https://github.com/BerriAI/litellm 🚨Why did we build liteLLM We needed simplicity Our code started to get extremely complicated managing & translating calls between Azure, OpenAI, Cohere, Anthropic, Replicate LLM APIs. 🚀How does it work liteLLM is a Python package that enables calling 50+ LLM API models using a consistent input/output interface - in the chatGPT format here’s an example of how liteLLM works response = completion(model="gpt-3.5-turbo", messages=messages) response = completion("claude-2", messages) response = completion("command-nightly", messages) 📞 Interested in using liteLLM? You can try out liteLLM today for free: https://github.com/BerriAI/litellm/ If you're interested in liteLLM you can meet with me https://calendly.com/d/4mp-gd3-k... or reach me on Twitter: https://twitter.com/ishaan_jaff

Report

3yr ago

Product Hunt Launch Checklist

@krrish_dholakia @ishaan_jaffer Amazing work guys! Congratulations on the launch.

Report

3yr ago

Congrats on the launch! Litellm is really useful for reliably and easily calling LLM APIs.

Report

3yr ago

liteLLM

Maker

@kaushik_s Thank you !

Report

3yr ago

liteLLM

Maker

@krrish_dholakia @falak_sher Thank you !

Report

3yr ago

Congrats on your launch.

Report

3yr ago

liteLLM

Maker

@daniel_oreson Thank you !

Report

3yr ago

LFG

Report

3yr ago

liteLLM

Maker

@yi_ding Thanks for the support❤️

Report

3yr ago

CloudFunnels AI

The product looks good, will check it out

Report

3yr ago

liteLLM

Maker

@cyriljeet Thank you !

Report

3yr ago

LLM Gateway

A better alternative: https://www.producthunt.com/products/llm-gateway

Report

3mo ago

5.0

Based on 23 reviews

Review liteLLM?

Reviewers describe liteLLM as a practical abstraction layer for teams juggling multiple model providers. The clearest praise is consistency: users say it works well as an OpenAI-compatible proxy for caching, load balancing, local models via Ollama, and monitoring setups like Langfuse. Founder feedback from the makers of Budibase, SellerClaw, and Zro echoes that, highlighting easier provider switching, fallbacks, routing, retries, and reduced integration work. The review set is thin and almost entirely positive, with no concrete downsides mentioned.

+20

Summarized with AI

Pros

Cons

Reviews

All Reviews

Most Informative

liteLLM

One library to standardize all LLM APIs

One library to standardize all LLM APIs

What's great

What's great