Langfuse 2.0 - the open source LLM engineering platform

Langfuse is the open source LLM Engineering Platform. It provides observability, tracing, evaluations, prompt management, playground and metrics to debug and improve LLM apps. Langfuse is open. It works with any model, framework and you can export all data.

Add a comment

Replies

Best
Hi Product Hunt 👋👋👋 I’m Clemens, co-founder of Langfuse (with and ). We are so excited to be live on Product Hunt again today launching Langfuse 2.0! We originally launched Langfuse right here in late August 2023 and made it to #1 Product of the Day. Earlier this year we were lucky enough to be awarded a Golden Kitty in the AI Infra category for 2023! Product Hunt holds a special place in our heart and company history. Langfuse has come a long way. Last year, we set out to build open source observability and analytics for LLM apps. We saw a need and gap for a dev-focussed, open source and self-hostable product that allows for complex tracing and nesting of LLM and other workloads. We are excited to introduce Langfuse 2.0 today. We have moved from an observability tool to a platform for LLM engineering. The scope is now wider and the core product has matured so much since last year. A few things you should know about: 👣 Tracing: TS & Python (new: decorator) + OpenAI, Llama Index, Langchain, Litellm + more 🤨 Eval Service: Automatically run evals against all new incoming traces 💾 Datasets: Collect, test and run fine-tuning, testing, and golden datasets in Langfuse 💯 Metrics: Dashboards and analytics on cost, latency and quality 🤖 Prompt Management: Version and deploy prompts from within Langfuse 🕹️ LLM Playground: Engineer your prompts with context in Langfuse 🏎️ Export & Fine Tune: Open GET API and csv/JSON exports to build downstream use cases 🚄 Scale: We’ve invested significantly in scaling and resilience as we’ve scaled to thousands of users and handle millions of events a day 🧑‍🤝‍🧑 Community: Join our thousands of users on GitHub Discussions and Discord See for yourself: ⭐ GitHub: ⏯️ Demo (includes data, no credit card): 📚 Docs: We’re excited to launch the all-new Langfuse on Product Hunt today. We will be in the comments the whole day and can’t wait to hear your thoughts & feedback!
Amazing product, congrats on the PH launch!!
thank you, Juliet :)
opensourcing LLM engineering platform is great thing in the AI space. Keep up the good work. Congratulations
Really amazing product, best in class, Congratulations langfuse team!
💎 Pixel perfection
We were notified automatically about the new launch. It triggered a Slack discussion of our AI infra experts: 'a very nice alternative to langsmith, and it's also cheaper since it isn't per user :+1: It's also open source, so if we don't want to pay for the service we can host it ourselves.' 'We want to remove langchain anyway next week so it kinda fits' Next steps: we check out if the API works for us. Congrats to the Product(hunt)-led growth! :)
Thank you, Marc! have a look at the API at + feel free to have your team reach out to me, we're always happy to add endpoints.
thanks Marc (hi from Marc to Marc) 🙏 Please reach out any time if you have questions or feedback, I'd love to chat! For more context on Langfuse 2.0, the recording of our launch week town hall might be interesting:
Some more links: We have noted down why we build Langfuse here (open, no framework/llm lock-in, great API to build custom workflows around it): Public roadmap: Public roadmap discussions: Thanks again, appreciate your support!
Congrats Langfuse team on the milestone!! Been following your progress. Shipping nonstop :)
Thank you 🚢🚢🚢 We're excited about this release and the evaluations launch today. Really looking forward to the feedback today!
Congratulations to Clemens, Marc, and Max on the launch of Langfuse 2.0 on Product Hunt! 🎉 It's incredible to see how Langfuse has evolved into a comprehensive LLM Engineering Platform, providing vital tools like tracing, evaluations, metrics, prompt management, and more for developers. The dedication to building an open source platform that caters to the needs of LLM apps is truly commendable. The enhancements in Langfuse 2.0, from new tracing capabilities to prompt management and dataset functionalities, showcase a significant leap in empowering developers to debug and enhance their applications efficiently. I'm curious about the community engagement aspect you mentioned. How has the interaction been with users on GitHub Discussions and Discord influenced the development of Langfuse? Looking forward to exploring Langfuse 2.0 and witnessing the impact it creates in the developer community! 👩‍💻🚀
thank you! GitHub Discussions have been essential (next to bug reports via GitHub issues) to build a useful product. Our community has been super awesome and you can have a look at all the discussion that has been going on around langfuse here:
So great to see you become more holistic! 🤘🏽
🙏🙏🙏
thanks for your support since day -1 🙏
Congrats on the launch! Really enjoying the product since day 1 🚀
Thank you timon and the whole team fastgen!
love that you guys actually built your own golang wrapper
Congrats guys! Insane shipping speed 🚢🚢🚢
let's go!
thank you! really excited to finally launch many of the new features 🪢
Building an LLM solution without langfuse is unreasonable. The product gives visibility on all our traces. The team is always ready to lend a hand as well. Keep building!
Thank you, Pablo. It's been an immense pleasure working for you for such a long time now!
your feedback has been invaluable, thanks team throxy!
Probably one of the best LLM platforms out there!!
Nice to (sort of) run into you yesterday!
Congrats on the launch guys!! Keep shipping 🚢
thank you, you guys are an inspiration!
123
•••
Next