Humanloop

Humanloop

Humanloop is the LLM evals platform for enterprises

5.0
β€’1 reviewβ€’

94 followers

Humanloop is the LLM evals platform for enterprises. Teams at Gusto, Vanta and Duolingo use Humanloop to ship reliable AI products. We enable you to adopt best practices for prompt management, evaluation and observability.
Humanloop gallery image
Humanloop gallery image
Humanloop gallery image
Humanloop gallery image
Launch Team
Migma AI
Migma AI
Lovable for Email
Promoted

What do you think? …

Raza Habib
Hi everyone! Peter, Jordan and Raza here. We're really excited to share what we've been building over the last few months and get your feedback. πŸ˜… We're a team of AI engineers and researchers from University College London who have worked on AI projects at Google, Amazon and Microsoft. We built Humanloop to make the breakthroughs in natural language understanding we were seeing in the lab, accessible to everyone. Getting NLP models into production still requires annotating a huge number of examples and a lot of specialist expertise. The Humanloop platform takes care of model training, data selection and deployment for you. You upload your data and we provide an annotation interface for you to teach a classifier. As you label we train a model, work out what data is most valuable and then deploy the model for you. Some of our early customers are using Humanloop to automatically route support tickets, understand twitter data and moderate user generated content. We use new techniques in active learning to dramatically reduce how much labelled data is needed to train language AI. This removes one of the biggest costs and barriers for teams wanting to build their own machine learning models. We'd love to hear your thoughts and ideas for how you might use your own natural language AI!
Zeena Qureshi
Congratulations! This looks perfect and could really save us on time for our voice datasets.
Raza Habib
@z_qureshi Would love to help. I worked on some TTS projects when I interned at Google so I'm super excited by what you're building.
Zeena Qureshi
Thanks @raza_habib, that's awesome to hear :)
Matthew Johnson
Nice work @jordnb and team! Excited to try it out.
Raza Habib
@mattcrail Thanks!, I'd love to give you a demo
Jordan Burgess
@mattcrail we've been following your guide producthunt.taskable.com of course!
Matthew Johnson
@jordnb πŸ€— awesome
Matthew Johnson
@raza_habib yeah let's do it - would love to see if it fits our use case. Lmk when you have some time matt[at]taskablehq.com
Lisha Li
Congrats, looking forward to trying this on future projects!
Raza Habib
@lisha_li1 Thanks Lisha, I'm a big fan of Rosebud so would love to help :)
Wai-chuen Cheung
Just been playing around with it, it's awesome! Really nice to use
Raza Habib
@waichuen glad you liked it! Any ideas for what you might want to build with it?
Wai-chuen Cheung
@raza_habib We do a fair amount of NER so if we could annotate individual spans of text, we'd be all over this! We've had to make our own internal labelling tool, but it's way less slick and doesn't have predictions built in
Raza Habib
@raza_habib @waichuen That's great to hear! We are building the sequence level annotation functionality right now, I'll send you an email. R
Abhinav Venigalla
Congrats on the launch! Out of curiosity, what NLP models are you training? Is it like a pretrained BERT with a classification head?
Raza Habib
@aveni Hey Abhinav, we've actually wrapped a few of the major NLP libraries so we can choose between quite a lot of models. By default its a pre-trained distilbert model but we also have lighter models (lstm/gru + linear layer) and more powerful models (full bert etc) At the moment you get a fixed default model and we work with customers to set the most appropriate option but we're working hard behind the scenes to implement automatic model selection.
Robert Thelen
Very cool. Do you have plans to create integrations with databases/data sets? Very cool user experience.
Raza Habib
@robert_thelen We're building out connections in response to user demand. If you have a specific use case in mind please ping me and I'd be happy to discuss
123
Next
Last