Featured

Never write another web scraper

Featured comment

Dru Wynings
@druwynings · Head of Business Development, Diffbot
Hey ProductHunters! Crawly is a free tool I built that uses Diffbot's automatic article extraction api to turn web content into structured data. I've used it for creating a centralized database of all of our content, but you could also use it to do content audits / migrations or analyze your competitor's content. It's currently limited to 200 pages and onl… See more

Discussion

Kumar Thangudu
@datarade · 2X Saas Founder + Angel Investor
I love this for its uniqueness ability to specify parameters. Hugely useful! Adding this to my running list of Scraping and Crawling Technologies! http://scrapinghub.com http://www.outwit.com/products/hub/ http://webroots.io http://kimonolabs.com http://grabby.io http://fullcontact.com http://emailhunter.co http://clearbit.com http://toofr.com http://i… See more
M
Dru Wynings
@druwynings · Head of Business Development, Diffbot
Hey ProductHunters! Crawly is a free tool I built that uses Diffbot's automatic article extraction api to turn web content into structured data. I've used it for creating a centralized database of all of our content, but you could also use it to do content audits / migrations or analyze your competitor's content. It's currently limited to 200 pages and onl… See more
Matt Gardner
@thatmattgardner · Co-Founder, RouteThis.com
Awesome!!! Looking for a replacement for Kimono (https://www.kimonolabs.com/) since they got acquired by Palantir. Need something to power my Slack menu bot ;)
Eric Iannaccone
@iannaccone15 · Software Engineer, Priceline.com
I would love to be able to scrape sports stats easily!
Neil Cocker
@neilcocker · Founder
Looks great. Congrats on the launch! I can see some nice applications for this. One suggestion - I understand that it might take a while to scrape the data, but an instant email to say it will be X minutes, or just a notification after email input would be good, to manage expectations. I used it 10 mins ago, and am on the verge of tears that I still have no … See more