LLMonitor

Open source monitoring and production toolkit for AI apps

168 followers

Open-source observability and evaluation toolkit for AI developers. Log queries and improve your app's quality.
LLMonitor gallery image
LLMonitor gallery image
LLMonitor gallery image
LLMonitor gallery image
LLMonitor gallery image
LLMonitor gallery image
LLMonitor gallery image
Free Options
Launch Team
AppSignal
AppSignal
Built for dev teams, not Fortune 500s.
Promoted

What do you think? …

Vince Loewe
👋 Hi Product Hunt, My name is Vince, and together with my friend Hugh we've been building LLMonitor, an open-source observability toolkit for builders of AI apps. If you’re using OpenAI or LangChain, the integration takes seconds to start recording data. Main Features: ⚡ Log full queries & errors 💸 Metrics into costs, tokens & latency 👨‍👩‍👧‍👦 Track users and their usage 💬 Record chat conversations & user feedback 🕹️ Prompt playground to iterate on prompts 🐾 Traces to easily debug agents 🧪 Evaluations of outputs quality 🧑‍💻 You can Self-host it on your own servers. Or use our cloud-hosted version (free up to 1k events /day.) I started building LLMonitor as an internal tool at my previous startup. We had no insight into how users interacted with our chatbots and needed a way to monitor chats and LLM queries easily. 
If you’re building a conversational app powered by AI, we’d love to hear what you think and how we can make it better! Also, we'd be reaaally happy if you can support us with a ⭐ star on GitHub: https://github.com/llmonitor/llm... Thankss 🙏
Raju Singh
@vincelwt Hey Vince. Congrats on the launch. For sure AI apps need a lot of quality safeguarding. This tool seems to be a great aid to developers for that. Keep up the good work!
M James K
Congrats!!!
Vince Loewe
@mjamesk Thanks a lot James :)
Vrushank Vyas
No-nonsense OSS LLM Monitoring tool - one of the best out there! Congratulations on the launch!
Vince Loewe
@vrv18 Thank you Vrushank :) Love what you're doing as well.
Gerardo Mcdomart
Simple yet powerful. Exactly what I needed.
Vince Loewe
@gerardo_mcdomart Thanks Gerardo let us know what you think :)
Edvaldo Gjonikaj
I think this is a must have if you're developing LLM products, it's so easy to integrate and gives a lot of value to devs and also other team members. congrats again guys!
Vince Loewe
@valdozzz1 Thank you Edvaldo for the support and thank you for trusting Textyess with LLMonitor 🙏
Prabir Vora
We've been using LLMonitor in our production app for quite some time now and the experience has been great. The team has been quick in assisting for any issues as well as considerate in taking inputs for their roadmap. Keep up the great work and congrats on the launch @vincelwt !
Vince Loewe
@prabir_30 Thanks Prabir for the kind comment, it's been great working with you and love what you're doing with Alayna.
Matija Sosic
Congrats on the launch!
Vince Loewe
@matijash Thank you!
123
•••
Next
Last