Lilac

Better data, better AI.

60 followers

Better data, better AI.

60 followers

Visit website

Data analysis tools

•

Data visualization tools

•

LLMs

Lilac is an open-source tool that enables data and AI practitioners improve their products by improving their data.

Free Options

Launch tags:Open Source•Artificial Intelligence•Data Science

Launch Team

Lilac

Maker

📌

We're so excited to release Lilac Garden, our hardware accelerated cloud platform for data transformations. Lilac is open-source, so you can try it for free on your device! If you want your transformations to go much faster, sign up for our waiting list! We believe that data quality will be the critical component of the next wave of progress in AI systems, and we think that a hybrid approach of human-in-the-loop and fully-automated will be the best strategy for improving data quality. Make sure to check our the live demo of clusters on a logs dataset of 1M conversations in Chatbot Arena linked from the blog post: https://docs.lilacml.com/blog/in...

Report

2yr ago

PixelFree Studio

Congratulations on your launch! I'm glad I came across your tool, it's going to be very helpful for my current research. Easy upvote for me. I'm eager to take a close look. Since, I'm working on highly multilingual data, I see you have lang detection signals which is great. Is there also a possibility to find semantically similar data (across say, a column)? Or maybe the possibility to use custom models that can aid in such a task

Report

2yr ago

Product Hunt

Pandas was transformational in data processing pre-LLMs, and it seems like in an LLM world, the way we process, and refactor training data should be seriously re-examined. @nsthorat what's a typical use case? e.g. how does Lilac help with, say, clustering and editing?

Report

2yr ago

Lilac

Maker

@rajiv_ayyangar A typical use case for AI application is first taking your data, and clustering it, and using clusters to curate the data in a more organized way. Clustering will give you a birds-eye view of the shape of your data. Often we'll realize that some clusters are over-represented, and some are under-represented. For example, in a very popular coding dataset, 7% of the data is failure to order a pizza! Once in Lilac, we can curate at the cluster level, removing most of the pizza cluster, keeping a few representative points, and reducing the size of the dataset and thus fine-tuning costs. Here's a walkthrough for more details:

Report

2yr ago

I've been beta-testing Garden and let me tell you - it really changes the way you think and work with data! Being able to compute embeddings and clusters in ~1 minute means that you try lots of new ways to slice and dice your data, and you find a lot more interesting subsets that way.

Report

2yr ago