resillm
p/resillm
Production-ready resilience for LLM applications
0 reviews1 follower
Start new thread
trending

resillm - Production-ready resilience for LLM applications

resillm is a resilience proxy for LLM applications. Add automatic retries, provider fallbacks, circuit breakers, budget controls, and Prometheus metrics to any LLM app. Works with OpenAI, Anthropic, Azure, Ollama. Zero code changes.