Langtail 1.0 - The low-code platform for testing AI apps

by•
LLM testing made easy with a spreadsheet-like interface. Score tests with natural language, pattern matching, or code. Optimize LLM apps by experimenting with models, parameters, and prompts. Gain insights from test results and analytics.

Add a comment

Replies

Best
Saurav from Apify here, congratulations on the launch. Looking forward to see the growth <3
Thanks . We love Apify. We use it to scrape everything. šŸ˜€
Congrats on the launch! A big fan of spreadsheets so this hits just right :)
Thanks. Spreadsheets are really the universal tool for everything. :)
Nice product, solving a real pain point! How does integrate with a product in production? Is there a sdk that we put in our codebase in certain segments and it listens the outputs?
For integration, we have SDK or OpenAPI. You can also use us as a Proxy - all data goes through us, or asynchronously - you send data from your codebase to Langtail. Additionally, you can use us just for development if you want to develop prompts and test them in the UI environment.
I’m one of the engineers on this project! Very excited to launch 1.0 after months of working on it. Our team has thought deeply (and talked to other companies much larger than us) about testing LLM-based apps. AMA.
Hey! I'm Tomas, co-founder and CTO of Langtail. šŸš€ Quick update on our LLM provider support! During beta launch, we only supported OpenAI. Now with Langtail 1.0, we've added all major providers: - Anthropic Claude - Google Gemini (includes video support!) - Open Source models like LLama on Groq - And more! šŸ¤– This means more flexibility for you to test and compare different models in one place. Looking forward to hearing your thoughts! šŸ’¬
Awesome product you've built with Langtail, and Team! I think this has great potential as building apps based on LLMs is not that trivial. I hope this launch boosts you!
It's deceptively tricky to build a production-grade app using LLMs. Thank you so much for your support, Samuel!
Testing AI powered apps is really challenging. Excited to try this!
That's true, best practices are missing and the whole community is figuring out how to do it properly.
Favourite thing: How the cost to performance metrics. Absolute Banger
Thanks Maru!
Huge congrats to the Langtail team on the 1.0 launch! I love how you've simplified LLM testing with a spreadsheet-like interface - who wouldn't want to tame AI complexity with a familiar feel? Quick question: Can you share an example of a surprising insight or optimization that a beta tester achieved using Langtail's analytics?
Hi! Thanks for support. There are several ways to enhance the consistency of LLM responses through testing, especially when you're evaluating multiple models to optimize for performance and cost. Not all models deliver consistent results for specific requirements. You can explore our case study with our customer, Deepnote, to see how they improved their AI features using Langtail. Check it out here: . Let me know if you have any further questions. Martin
That sounds Amazing!
Thanks for your support, Tom! Are you building an LLM-powered app?