Evidently AI - Open-source evaluations and observability for LLM apps

by•
Evidently is an open-source framework to evaluate, test and monitor AI-powered apps.

šŸ“š 100+ built-in checks, from classification to RAG.
🚦 Both offline evals and live monitoring.
šŸ›  Easily add custom metrics and LLM judges.

Add a comment

Replies

Best
Cracked team solving one of the hardest problems in LLMs today. If anyone is going to solve it, it's them.
Thanks for the support!
Amazing team with a fantastic product that's solving real-need. Congrats team Evidently.
Thanks for your support, Mona! ā¤ļø
nice
Congrats on the launch! Have you found that Evidently's suggestions are pretty consistent across solutions, or does it really depend on the application at hand? For example, does it always recommend ChatGPT over Claude (or vice versa), or does it depend on the use case? (And if you can share two use cases where the answer is different, that'd be super cool!)
How does Evidently AI handle complex datasets?