Kern AI refinery

Treating training data as if it was source code

5.0•1 review•

188 followers

Treating training data as if it was source code

5.0•1 review•

188 followers

Visit website

refinery is the data-centric sibling of your favorite programming IDE. It provides an easy-to-use interface for weak supervision and data management, neural search, and monitoring to ensure that the quality of your training data is as good as possible.

Free

Launch tags:Open Source•Developer Tools•Artificial Intelligence

Launch Team

Framer AI AgentsDesign and publish professional sites with AI

Promoted

Kern AI refinery

Maker

Hey ProductHunt community, I'm Johannes, a data engineer + co-maker of refinery. We've built refinery with the belief that working on training data should, at some point, feel like you're programming. Why? Because we believe that otherwise, engineers and scientists with great ideas (and businesses with core processes, too) are limited in what they can build. When we think of natural language interfaces of the future, we're sure they simply can't be built with today's tools. And this is what we aim to change. What does that mean? - We believe that developers should be able to debug and document training data - Building training data must be easy and quick, such that you can build prototypes with ease - On the other hand, if you see that your use case is working, building training data is no one-time job, so you should be able to improve the data in a structured manner We believe in open-source and communities, so we've published the source code on GitHub, and we have a community on Discord. Also, we have an online playground. Check it out :) We're getting there step-by-step, with the goal to, at some point, not only treat training data as if it was source code but to essentially make complex NLP problems easier. Community, we're so excited to share this with you today. Feel free to leave a comment below or on GitHub, join our Discord, or reach out via Twitter. Cheers! 🙏🏻

Report

4yr ago

@johannes_hoetter Congrats on the launch 🚀

Report

4yr ago

Kern AI refinery

Maker

@fares_aktouf Thanks so much! It's been a hell of a ride so far :)

Report

4yr ago

@johannes_hoetter you're welcome

Report

4yr ago

Kern AI refinery

Maker

Hello everyone 👋 I'm Jens, the CTO of kern.ai. Johannes and I met about two jobs back in a totally different environment - SAP Data Migration. Fun times indeed, however, as life goes we went our different paths after a few years of pushing data from left to right. He to study and start his first company - me working as a lecturer and creating one or two games you might find online. Back then we wouldn't or better couldn't even imagine where we are now. So enough about the foreplay, let's talk about the product 🙂 With the app, you have many possible applications. One option: you can optimize your AI label workflow. Let me give you an example: I always wanted to have a personalized newsfeed of different sources matched to my specific taste. But who has the time to scroll through 1.000s of articles every day? So let's slap some AI on that problem, right? Now some of you might know: AI works best with a lot of training data. But again... who has the time to label a bunch of old articles? I didn't so no dice I guess. Enter refinery. Not only did it help me to get a better overview of my data points (e.g. by using embedding-based similarity) but it also helped me to extrapolate the given information through a combination of heuristics, active learning, and weak supervision. I know, I know a lot of technical terms to throw around but it's an application for you, the data scientist. To keep it simple: Instead of manually labeling 2.500 articles, I scraped from different websites I achieved good results after the first 50 manual labels or so. Even better after some data exploration but that's going a bit too far for now. If you have further questions please don't hesitate to reach out 😀 So please let us know what your favorite features are (or what you'd love to see added) in the comments 👇 Bonus points for the first to find the easter egg I've hidden in the application. Without spoiling too much in our team the current high score on medium difficulty is 81 😉

Report

4yr ago

Kern AI refinery

Maker

Hey people! My name is Lina and I am a developer at kern.ai with a primary focus on the front-end. My main focus at kern is working with Angular,Typescript and Tailwind and with those skills I love turning even the craziest Figma mockup into reality and placing every element perfectly. At Kern I work on the software’s design, general front-end issues and constantly try to improve the code quality. Besides that I love to broaden my skill set by learning Python and deepen my understanding of programming. And guess what? Kern constantly gives me that opportunity to learn more and expand my knowledge, so recently I had the chance to write my first lines of Python. The refinery product gives the users an option to use an IDE for data-centric NLP, label their data, write their labeling functions, active learning and run a zero-shot classification. The refinery goes in a really good direction, and if I were you I would “stay tuned” for the upcoming features and possibilities. Looking forward to your feedback!

Report

4yr ago

Kern AI refinery

Maker

Hi, my name is Anton and I have been with Kern since the company's founding. In my bachelor's, I studied economics and transitioned to business for my master's. During my time at Kern I have worked on a wide variety of topics regarding the sales and marketing side of things. Over the past few months, my primary role was community manager, which entails interacting with our community on discord or in our comment sections, as well as organizing the newsletter. I am going to leave the company soon, but it was a great tourney up to this point!

Report

4yr ago

ossjobs.dev

At crowd.dev we‘ve been loving using refinery for managing our test data! Congrats to the whole team 👏

Report

4yr ago

Kern AI refinery

Maker

@jonathan_reimer1 Thanks Jonathan, always a pleasure to have your support 😊

Report

4yr ago

I'm an ML Engineer at Behold AI. I used refinery to label a dataset of 200K radiology reports. The UI is incredibly simple to use, and felt like what I wanted to build. NLP is ready for automation and refinery provides you the tools to do it.

Report

4yr ago