Spider Pro

The easiest way to scrape the internet.

14 followers

The easiest way to scrape the internet.

14 followers

Data analysis tools

•

Data visualization tools

•

Automation tools

Spider Pro is the easiest tool to scrape the internet. Simply point and click to turn websites into organized data and download them as JSON/CSV. No coding or configurations required.

Launch tags:Productivity•Marketing•Developer Tools

Launch Team

Zendesk for StartupsUp to 2 years free for startups + AI Agents & Copilot

Promoted

Signaturely

Congrats on the launch, the product seems interesting! Is there a trial (even for 1 day)? I had been using scrapers for years, and would love to test it before purchasing. If it works OK, would definitely get it as the pricing is quite good :)

Report

7yr ago

Spider Pro

Maker

@maurosicard Yup, I'm working on getting the trial in place. Will be updating here when it's ready!

Report

7yr ago

@amiechen01 Any chance to get trial before discount ends?

Report

7yr ago

Spider Pro

Maker

@maurosicard The trial is live! Check it out on tryspider.com

Report

7yr ago

Congrats on the launch!! I got to try the free version months ago and was interested but it didn't work well at all and needed lots of fixing to handle all the edge cases. I'm sure it's 10x better now 3 months later. Since there's currently no trial, can I send you some sites so that you can test if the scraping works well? Or maybe you could make a page on your website with a long list of tested pages where Spider Pro performs exactly. In any case, if Spider turns out not to work on a particular page, can we count on you to fix it promptly? Or maybe you can offer some alternative way to test drive it In any case I'm very interested!

Report

7yr ago

Spider Pro

Maker

@vesper8 Valid concern! Just DM you on ProductHunt for more specifics.

Report

7yr ago

@vesper8 what are those sites? Can you name one?

Report

6yr ago

Sounds like a cool product! I look forward to checking it out. I am wondering if there are plans to support some type of recursion, whereby the spider would crawl the initial page plus any pages it links to?

Report

7yr ago

Spider Pro

Maker

@noah_pedrini I'd love to! However, I'm resisting to run any server for Spider Pro, thus having a recurring or schedule feature would be an interesting challenge :)

Report

7yr ago

@noah_pedrini @amiechen01 Your a smart cookie.. Don't get involved with a backend. I worked with crawlera, lumi, 80 legs, mozenda, Content Grabber, Semantics3, Octoparse.. and the list goes on. When you start running a backend that's when you start losing money.

Report

7yr ago

Hey! How does this work for sites that are password protected or where the DOM structure changes from one page to the next?

Report

7yr ago

Spider Pro

Maker

@kobestarr good question! Because it's a browser extension, the password protected content does not affect Spider Pro (e.g. like scraping linkedin email/names) as long as you are logged in. However, if the DOM structure changes from pages to pages, Spider Pro is not going to run well. In that case, I'd recommend you scrape each structure separatly. Would this answer your question?

Report

7yr ago

Product Hunt Regular

@kobestarr @amiechen01 Came here for this answer, sweet.

Report

7yr ago

Hi Amie, Don't know what happened to my post I just wrote, but here I go again :) I love the interface - it is very intuitive & clean. I just tested it bit and had an issue - might be that I missed something, but when you do a google search some of the URLs are displayed the following way https://moz.com › SEO Learning Center Is it possible to scrap the actual URL which can be found in the source code? Also an auto next feature would be awesome! Take care & GLWS, Robert

Report

7yr ago

Spider Pro

Maker

@rfussi Thanks for letting me know the issue! I will add that to the next update. Would you mind DM me the exact string you are getting that's problematic? That'd be very useful.

Report

7yr ago

Spider Pro

Maker

@rfussi Also, there's an advanced setting you could use when scraping google results (I haven't had the time to put in documentation.) If you click the gear button in Spider, and put in div.g in the input. That will override the automatically generated selector with div.g as the selector and have better result. I find that useful when scraping google results.

Report

7yr ago

Spider Pro

Maker

Hi there! I made Spider Pro, an easy-to-use web scraping tool that turns websites into organized data. It requires 0 configurations or programming experience, simply starts clicking to collect data! I made this tool because I couldn't find a simple and cheap solution to collect data. Most solutions out there are too complicated, too expensive and too feature-rich. I wanted something more friendlier than what was existing. Therefore, earlier this year I released Spider (the free version) and 6000+ users have tried and loved it. Since then I've been working on Spider Pro, a more robust version that answers to lots of Spider's user feedback and requests. Some key features: + Unobtrusive user interface design + Scrape paginated content with a single click + Scrape ajax loaded content + No server involved (👉zero subscription fee!) + Improved selector logic for better results + Custom selector for quirky website structures Did I mention to celebration of the launch, there's a 25% off discount till 8/31? Use "spiderbuddy" on checkout. Also, please feel free to let me know if you have any question!

Report

7yr ago