Clemens Rawert

Langfuse 2.0 - the open source LLM engineering platform

Langfuse is the open source LLM Engineering Platform. It provides observability, tracing, evaluations, prompt management, playground and metrics to debug and improve LLM apps. Langfuse is open. It works with any model, framework and you can export all data.

Add a comment

Replies

Best
Clemens Rawert
Hi Product Hunt 👋👋👋 I’m Clemens, co-founder of Langfuse (with @marc_klingen and @max_deichmann). We are so excited to be live on Product Hunt again today launching Langfuse 2.0! We originally launched Langfuse right here in late August 2023 and made it to #1 Product of the Day. Earlier this year we were lucky enough to be awarded a Golden Kitty in the AI Infra category for 2023! Product Hunt holds a special place in our heart and company history. Langfuse has come a long way. Last year, we set out to build open source observability and analytics for LLM apps. We saw a need and gap for a dev-focussed, open source and self-hostable product that allows for complex tracing and nesting of LLM and other workloads. We are excited to introduce Langfuse 2.0 today. We have moved from an observability tool to a platform for LLM engineering. The scope is now wider and the core product has matured so much since last year. A few things you should know about: 👣 Tracing: TS & Python (new: decorator) + OpenAI, Llama Index, Langchain, Litellm + more 🤨 Eval Service: Automatically run evals against all new incoming traces 💾 Datasets: Collect, test and run fine-tuning, testing, and golden datasets in Langfuse 💯 Metrics: Dashboards and analytics on cost, latency and quality 🤖 Prompt Management: Version and deploy prompts from within Langfuse 🕹️ LLM Playground: Engineer your prompts with context in Langfuse 🏎️ Export & Fine Tune: Open GET API and csv/JSON exports to build downstream use cases 🚄 Scale: We’ve invested significantly in scaling and resilience as we’ve scaled to thousands of users and handle millions of events a day 🧑‍🤝‍🧑 Community: Join our thousands of users on GitHub Discussions and Discord See for yourself: ⭐ GitHub: https://github.com/langfuse/lang... ⏯️ Demo (includes data, no credit card): https://langfuse.com/demo 📚 Docs: https://langfuse.com/docs We’re excited to launch the all-new Langfuse on Product Hunt today. We will be in the comments the whole day and can’t wait to hear your thoughts & feedback!
Juliet Bailin
@marc_klingen @max_deichmann @clemo_sf Amazing product, congrats on the PH launch!!
Clemens Rawert
@julietroseb thank you, Juliet :)
Marc Klingen
Sathish Nagarajan (SNR)
@marc_klingen @max_deichmann @clemo_sf opensourcing LLM engineering platform is great thing in the AI space. Keep up the good work. Congratulations
Oliver Montes
@marc_klingen @max_deichmann @clemo_sf Really amazing product, best in class, Congratulations langfuse team!
Marc Mengler
💎 Pixel perfection
We were notified automatically about the new launch. It triggered a Slack discussion of our AI infra experts: 'a very nice alternative to langsmith, and it's also cheaper since it isn't per user :+1: It's also open source, so if we don't want to pay for the service we can host it ourselves.' 'We want to remove langchain anyway next week so it kinda fits' Next steps: we check out if the API works for us. Congrats to the Product(hunt)-led growth! :)
Clemens Rawert
@marc_mengler Thank you, Marc! have a look at the API at https://api.reference.langfuse.com/ + feel free to have your team reach out to me, we're always happy to add endpoints.
Marc Klingen
@marc_mengler thanks Marc (hi from Marc to Marc) 🙏 Please reach out any time if you have questions or feedback, I'd love to chat! For more context on Langfuse 2.0, the recording of our launch week town hall might be interesting:
Some more links: We have noted down why we build Langfuse here (open, no framework/llm lock-in, great API to build custom workflows around it): https://langfuse.com/why Public roadmap: https://langfuse.com/roadmap Public roadmap discussions: https://langufse.com/ideas Thanks again, appreciate your support!
Clemens Rawert
Fengjiao Peng
Congrats Langfuse team on the milestone!! Been following your progress. Shipping nonstop :)
Marc Klingen
Thank you @fengjiao_peng1 🚢🚢🚢 We're excited about this release and the evaluations launch today. Really looking forward to the feedback today!
Albert
Congratulations to Clemens, Marc, and Max on the launch of Langfuse 2.0 on Product Hunt! 🎉 It's incredible to see how Langfuse has evolved into a comprehensive LLM Engineering Platform, providing vital tools like tracing, evaluations, metrics, prompt management, and more for developers. The dedication to building an open source platform that caters to the needs of LLM apps is truly commendable. The enhancements in Langfuse 2.0, from new tracing capabilities to prompt management and dataset functionalities, showcase a significant leap in empowering developers to debug and enhance their applications efficiently. I'm curious about the community engagement aspect you mentioned. How has the interaction been with users on GitHub Discussions and Discord influenced the development of Langfuse? Looking forward to exploring Langfuse 2.0 and witnessing the impact it creates in the developer community! 👩‍💻🚀
Marc Klingen
@mashy thank you! GitHub Discussions have been essential (next to bug reports via GitHub issues) to build a useful product. Our community has been super awesome and you can have a look at all the discussion that has been going on around langfuse here: https://langufse.com/ideas
Viet Le
So great to see you become more holistic! 🤘🏽
Clemens Rawert
@viet_le 🙏🙏🙏
Marc Klingen
@viet_le thanks for your support since day -1 🙏
Timon Christiansen
Congrats on the launch! Really enjoying the product since day 1 🚀
Clemens Rawert
@timon_christiansen Thank you timon and the whole team fastgen!
Marc Klingen
@timon_christiansen love that you guys actually built your own golang wrapper
Justus Mattern
Congrats guys! Insane shipping speed 🚢🚢🚢
Clemens Rawert
@justus_mattern let's go!
Marc Klingen
@justus_mattern thank you! really excited to finally launch many of the new features 🪢
Pablo Jimenez De Parga
Building an LLM solution without langfuse is unreasonable. The product gives visibility on all our traces. The team is always ready to lend a hand as well. Keep building!
Clemens Rawert
@pablo_jimenez_de_parga Thank you, Pablo. It's been an immense pleasure working for you for such a long time now!
Marc Klingen
@pablo_jimenez_de_parga your feedback has been invaluable, thanks team throxy!
Mathias Nestler
Probably one of the best LLM platforms out there!!
Clemens Rawert
@mathias_n Nice to (sort of) run into you yesterday!
Tobias Kemkes
Congrats on the launch guys!! Keep shipping 🚢
Marc Klingen
@tobiaskemkes thank you, you guys are an inspiration!
123
•••
Next
Last