Diffbot
No more wasted time tracking down data
Start new thread

Crawly - Never write another web scraper

by•

Turn websites into data in seconds. Crawly spiders and extracts complete structured data from an entire website.

Add a comment

Replies

Best
love the name! Nothing else to add. Just love the name. Great movie.
Is there a way to customize what data gets scraped? The ability to mouse over elements and select/de-select them would be ideal.
Maker
Not at the moment within Crawly. That's something that we fully support using our Custom Api ()
Any student access at a cheaper price? love this kinda stuff but don't have the money for it
wow, great! My fav is apifier ofcourse.
Just tried not so great. 1. does not capture the actual URL, it captures root/ folder 2. We can save as json and csv? what's the use of that? We need to call the API each time right? is it only onetime getting?
Love it! Great job
Hello there Please can it be used to collect data from websites into airtable
Seems, like a suitable solution for small data scraping tasks, I am going to make a little testing to it right now! However, for more extended tasks, it is reasonable to go for professional services on request, like this one , for instance. This guys can also develop a custom tool for specific needs, by the way.
Looks great. Scraping data from sites is a pain. Well done.
First
Previous
12