Spider Pro is the easiest tool to scrape the internet. Simply point and click to turn websites into organized data and download them as JSON/CSV. No coding or configurations required.
@amiechen01 This looks great. I am keen to try the pro version, as others have said, to have a trial before purchase would be cool. I did try the free version but when selecting elements that are links it just clicks through to the linked page and resets the crawl params. If that worked I would have just purchased the paid version. I'm holding out at the moment. Do you know when the update will be out that includes a trial?
@beesum Thank you so much and I'm working on the trial! The free version isn't a great representation of the pro version as I completely rewrote it, so the click-through issue shouldn't exist in the pro anymore. To answer your question, please sign up on the tryspider.com (promise no frequent emails cause I really dislike writing them) or just follow me on twitter. I will announce the update when it's ready on both channels!
Report
Looks like a ton of fixes are incoming in the next update.. exciting! Any ETA on when that will drop?
Who here would like this app to simply hit a directory page full of links, click each name, and go their profile where all the personal data scraping really needs to be done?
*2-level scraping~*
Report
For some reason I encounter this message on Google Chrome when I try to install it through the Chrome Extensions "Apps, extensions, and user scripts cannot be added from this website", please advise.
@chriscisneros85 do you still have issues? There's a bug in Chrome's dashboard, so make sure you follow the "How to install" steps on gum.co/spiderpro. Let me know!
Report
@amiechen01 Ok I see the "How to install" documentation was updated and now the new steps worked! Thank you! If others are reading this, please note that I had to reload the Chrome Extensions page a few times to get it to work.
Report
Great demo! I tried web scraping with Selenium however I received a lot of flak from websites banning the driver. Are you concerned about the legal issues that you may encounter with a product that actively violates some websites' TOS?
Report
There's 154 Google Search result scrapers out there but i'm always hesitant because of Google's policy of banning IP addresses (without connecting/$$ to their API) that ping google too much
Just tried the free version and it worked perfectly so bought Pro now! Very good work mate, makes scraping 10x easier without having to write custom scripts :)
PDF Flip Books
Spider Pro
VisualSitemaps 3.0
Spider Pro
Fluent
Spider Pro