LLMonitor

Open source monitoring and production toolkit for AI apps

168 followers

Open source monitoring and production toolkit for AI apps

168 followers

Visit website

Data analysis tools

•

LLMs

Open-source observability and evaluation toolkit for AI developers. Log queries and improve your app's quality.

Free Options

Launch tags:Open Source•Developer Tools•Artificial Intelligence

Launch Team

Unblocked AI Code Review — High-signal comments based on your team's context

High-signal comments based on your team's context

Promoted

LLMonitor

Maker

📌

👋 Hi Product Hunt, My name is Vince, and together with my friend Hugh we've been building LLMonitor, an open-source observability toolkit for builders of AI apps. If you’re using OpenAI or LangChain, the integration takes seconds to start recording data. Main Features: ⚡ Log full queries & errors 💸 Metrics into costs, tokens & latency 👨‍👩‍👧‍👦 Track users and their usage 💬 Record chat conversations & user feedback 🕹️ Prompt playground to iterate on prompts 🐾 Traces to easily debug agents 🧪 Evaluations of outputs quality 🧑‍💻 You can Self-host it on your own servers. Or use our cloud-hosted version (free up to 1k events /day.) I started building LLMonitor as an internal tool at my previous startup. We had no insight into how users interacted with our chatbots and needed a way to monitor chats and LLM queries easily.  If you’re building a conversational app powered by AI, we’d love to hear what you think and how we can make it better! Also, we'd be reaaally happy if you can support us with a ⭐ star on GitHub: https://github.com/llmonitor/llm... Thankss 🙏

Report

2yr ago

@vincelwt Hey Vince. Congrats on the launch. For sure AI apps need a lot of quality safeguarding. This tool seems to be a great aid to developers for that. Keep up the good work!

Report

2yr ago

New Year Resolutions AI

Congrats!!!

Report

2yr ago

LLMonitor

Maker

@mjamesk Thanks a lot James :)

Report

2yr ago

No-nonsense OSS LLM Monitoring tool - one of the best out there! Congratulations on the launch!

Report

2yr ago

LLMonitor

Maker

@vrv18 Thank you Vrushank :) Love what you're doing as well.

Report

2yr ago

Simple yet powerful. Exactly what I needed.

Report

2yr ago

LLMonitor

Maker

@gerardo_mcdomart Thanks Gerardo let us know what you think :)

Report

2yr ago

Leets

I think this is a must have if you're developing LLM products, it's so easy to integrate and gives a lot of value to devs and also other team members. congrats again guys!

Report

2yr ago

LLMonitor

Maker

@valdozzz1 Thank you Edvaldo for the support and thank you for trusting Textyess with LLMonitor 🙏

Report

2yr ago

We've been using LLMonitor in our production app for quite some time now and the experience has been great. The team has been quick in assisting for any issues as well as considerate in taking inputs for their roadmap. Keep up the great work and congrats on the launch @vincelwt !

Report

2yr ago

LLMonitor

Maker

@prabir_30 Thanks Prabir for the kind comment, it's been great working with you and love what you're doing with Alayna.

Report

2yr ago

Open SaaS

Congrats on the launch!

Report

2yr ago

LLMonitor

Maker

@matijash Thank you!

Report

2yr ago

1 2 3

•••