DataFuel.dev
Scraping made easier for developer!
Start new thread
fmerian

DataFuel.dev - Turn websites into LLM-ready data.

by
Humans in the Loop
•
DataFuel API scrapes entire websites and knowledge bases in a single query. Get clean, markdown-structured web data instantly for your RAG systems and AI models. No complex scraping code needed.

Add a comment

Replies

Best
Ayoub Amine
Awesome! I need that. The result, converted to Markdown, is really impressive!
Sacha Dumay
AIThumbnail.so
Maker
@ayoubamine happy that you like it! enjoy it !
Benjamin Cherion
Kudos to you Sacha !
Sacha Dumay
AIThumbnail.so
Maker
@balibou thanks a lot for the support
Melvin
Congrats on the launch, Sacha! DataFuel for scraping gated content is such a promising feature!
Sacha Dumay
AIThumbnail.so
Maker
@melvin_vd glad you like it! and I hope you can use it soon in production!
Alex Dulub
Hi Sacha! DataFuel sounds like a game-changer for anyone dealing with web data. The feature to scrape behind logins is particularly impressive. How did you manage to simplify such a complex process? Looking forward to trying it out!
Sacha Dumay
AIThumbnail.so
Maker
@web3_antivirus Thanks a lot Alex! The main processes that I tried to tackle are: - handle retries - handle automatic discovery of sub urls without sitemap - handle login - handle status and heavy background job I hope It helps users feel scraping is getting easier at the least
Huzaifa Shoukat
Congrats on the launch! DataFuel sounds like a game-changer for anyone working with web data. How do you see it being used in conjunction with other AI tools and platforms?
Sacha Dumay
AIThumbnail.so
Maker
@ihuzaifashoukat yes I think using RAG or fine-tuning in combination with DataFuel can be super useful ! Think knowledge based, chatbot builder, new LLM model to train, etc
Arkim Phiri
Good luck on the launch sir. DataFuel is surely a game changer.
Sacha Dumay
AIThumbnail.so
Maker
@arkim_phiri thanks for the support! I ll keep working to improve it and give more value
Muhammad Furqan
The Access Gated Content feature looks promising! Truly innovative, and I’m keen to see how far this will go.
Sacha Dumay
AIThumbnail.so
Maker
@furqanramzan Thanks a lot ! yes It is definitely promising, I am thinking to add SSO login too!
Rami
Go Mail Merge
looks good, does it compete with firecrawl . dev?
Sacha Dumay
AIThumbnail.so
Maker
@kingromstar Here’s the corrected version: Yes, it does. I'm still trying to figure out how to differentiate more. Do you have any suggestions or features you'd like to see?
Max Comperatore
sweet for that azure search and else. Will try.
Sacha Dumay
AIThumbnail.so
Maker
@maxcompe looking forward your feedback!!
David Lonjon
Impressive evolution of the product! No doubt it can become an essential tool for anyone looking to train AI models without the hassle of sourcing data
Sacha Dumay
AIThumbnail.so
Maker
@david_lonjon1 exactly your welcome to RAG and fine-tuning
First
Previous
123
Next
Last