Evidently AI

Evidently AI

Collaborative AI observability platform

5.0•2 reviews•

391 followers

Visit website
•
•
Evidently helps evaluate, test and monitor your AI-powered products. From ML-based classifiers to LLM chatbots and agents. Built on top of the leading open-source library with over 20 million downloads: https://github.com/evidentlyai/evidently
This is the 2nd launch from Evidently AI. View more
Evidently AI

Evidently AI

Open-source evaluations and observability for LLM apps
Evidently is an open-source framework to evaluate, test and monitor AI-powered apps.

📚 100+ built-in checks, from classification to RAG.
🚦 Both offline evals and live monitoring.
🛠 Easily add custom metrics and LLM judges.
Evidently AI gallery image
Evidently AI gallery image
Evidently AI gallery image
Evidently AI gallery image
Evidently AI gallery image
Evidently AI gallery image
Free
Launch tags:Open Source•Developer Tools•Artificial Intelligence
Launch Team / Built With
AppSignal
AppSignal
Built for dev teams, not Fortune 500s.
Promoted

What do you think? …

Alex
Congrats on the launch, @elenasamuylova! 🎉 It's amazing to see Evidently evolving into the realm of LLMs with such robust features. The focus on a quality workflow is crucial for us as we develop AI-powered applications. I love the idea of easily integrating custom metrics and having that interactive summary for evaluations. Looking forward to exploring the new capabilities and contributing to the community! Keep up the great work!
Elena Samuylova
Evidently AI
Maker
@zanereed596 Thank you! 🚀
Vasili Shynkarenka
congrats with the launch! love the video :)
Elena Samuylova
Evidently AI
Maker
@flreln Open-source production! :)
bunga
ou explain how LLM judge templates empower users to define custom evaluation criteria and create tailored prompts.
Elena Samuylova
Evidently AI
Maker
@bunga_trisnulia We make it easy for the user to focus only on the evaluation's contents (for example, write that "I want to label responses as concise or verbose") without thinking about how to write the rest of the evaluation prompt. We automatically add all the other parts, such as formatting prompts as JSON to get structured output, asking LLM to provide the reasoning before outputting the label, etc. Basically, we help the users to define only what's strictly necessary but do all the boilerplate on the background.
Eugene Ter-Avakyan
Congrats on the launch, Elena and Emeli! It's nice to see it released in open source!
Elena Samuylova
Evidently AI
Maker
@eugene_ter_avakyan Thank you! We are looking forward to the community input 🚀
Bryan
Congrats on this launch, Elena! The transition from traditional ML to LLMs is a game changer. The ability to customize metrics and have a monitoring dashboard will definitely help many makers in evaluating their AI apps. Can't wait to see how the community uses Evidently! 🚀
Elena Samuylova
Evidently AI
Maker
@dance17219 Thank you! 🚀
Ema Elisi
Elisi : AI-powered Goal Management App
Hey @elenasamuylova! Exciting stuff with Evidently stepping into the LLM space! The challenges you've outlined around evaluating generative AI are real. Love the
Elena Samuylova
Evidently AI
Maker
@ema_elisi Thanks for the support!
Hamza Tahir
GitTrends
Amazing team + product. Been using evidently for years now and can confidently say its one of the best in the market!
Elena Samuylova
Evidently AI
Maker
@hamza_tahir Thanks for the support ❤️
First
Previous
12345
Next
Last