LLMonitor

Open source monitoring and production toolkit for AI apps

168 followers

Open source monitoring and production toolkit for AI apps

168 followers

Visit website

Data analysis tools

•

LLMs

Open-source observability and evaluation toolkit for AI developers. Log queries and improve your app's quality.

Free Options

Launch tags:Open Source•Developer Tools•Artificial Intelligence

Launch Team

Fin Startups get Fin free for a year + 93% off Intercom

Promoted

LLMonitor

Maker

📌

👋 Hi Product Hunt, My name is Vince, and together with my friend Hugh we've been building LLMonitor, an open-source observability toolkit for builders of AI apps. If you’re using OpenAI or LangChain, the integration takes seconds to start recording data. Main Features: ⚡ Log full queries & errors 💸 Metrics into costs, tokens & latency 👨‍👩‍👧‍👦 Track users and their usage 💬 Record chat conversations & user feedback 🕹️ Prompt playground to iterate on prompts 🐾 Traces to easily debug agents 🧪 Evaluations of outputs quality 🧑‍💻 You can Self-host it on your own servers. Or use our cloud-hosted version (free up to 1k events /day.) I started building LLMonitor as an internal tool at my previous startup. We had no insight into how users interacted with our chatbots and needed a way to monitor chats and LLM queries easily.  If you’re building a conversational app powered by AI, we’d love to hear what you think and how we can make it better! Also, we'd be reaaally happy if you can support us with a ⭐ star on GitHub: https://github.com/llmonitor/llm... Thankss 🙏

Report

2yr ago

@vincelwt Hey Vince. Congrats on the launch. For sure AI apps need a lot of quality safeguarding. This tool seems to be a great aid to developers for that. Keep up the good work!

Report

2yr ago

Leets

I think this is a must have if you're developing LLM products, it's so easy to integrate and gives a lot of value to devs and also other team members. congrats again guys!

Report

2yr ago

LLMonitor

Maker

@valdozzz1 Thank you Edvaldo for the support and thank you for trusting Textyess with LLMonitor 🙏

Report

2yr ago

We've been using LLMonitor in our production app for quite some time now and the experience has been great. The team has been quick in assisting for any issues as well as considerate in taking inputs for their roadmap. Keep up the great work and congrats on the launch @vincelwt !

Report

2yr ago

LLMonitor

Maker

@prabir_30 Thanks Prabir for the kind comment, it's been great working with you and love what you're doing with Alayna.

Report

2yr ago

CopilotKit

Hey @vincelwt, congratulations on the launch. This looks like a great product, I can’t wait yo try it out!

Report

2yr ago

apideck

Hey @vincelwt congratulations on your launch. Amazing an and interesting product that you've been working on. It will help increase AI Teams monitor their LLM usage.

Report

2yr ago