Diffbot
No more wasted time tracking down data
Start new thread
Dru Wynings

Crawly - Never write another web scraper

by
Sensible Instruct
•

Turn websites into data in seconds. Crawly spiders and extracts complete structured data from an entire website.

Add a comment

Replies

Best
Mat Newton
love the name! Nothing else to add. Just love the name. Great movie.
Dave Lynam
Bookmark OS
Is there a way to customize what data gets scraped? The ability to mouse over elements and select/de-select them would be ideal.
Dru Wynings
Sensible Instruct
Maker
@drlynam Not at the moment within Crawly. That's something that we fully support using our Custom Api (http://www.diffbot.com/products/...)
Christopher Leach
@druwynings Any student access at a cheaper price? love this kinda stuff but don't have the money for it
abdullah m. ceylan
@datarade wow, great! My fav is apifier ofcourse.
Surjith S M
Just tried not so great. 1. does not capture the actual URL, it captures root/ folder 2. We can save as json and csv? what's the use of that? We need to call the API each time right? is it only onetime getting?
🚀 Pierre-Henry 💡
Lifyzer
Love it! Great job
Julius Muraguri
Hello there Please can it be used to collect data from websites into airtable
Andrey Demchenko
Seems, like a suitable solution for small data scraping tasks, I am going to make a little testing to it right now! However, for more extended tasks, it is reasonable to go for professional services on request, like this one https://data-ox.com/webscraping-..., for instance. This guys can also develop a custom tool for specific needs, by the way.
Dara
Looks great. Scraping data from sites is a pain. Well done.
First
Previous
12