Spider is a smart point & click web scraping tool. With it, you can turn websites into organized data without code. Simply start clicking and download the JSON/CSV when ready.
Hi hunters!
I made Spider, an easy-to-use web scraping tool that turns websites into organized data. It requires 0 configuration or programming experience, simply just start clicking!
I was trying to gather a specific set of data that was scattered among blog posts and websites. Most of the scraping tools out there focus on recurring scraping of multi-page mega sites like Yelp. Although they do provide analytic data around the scraped results, it was not what I needed. I need something that allows me to easily scrap multiple webpages as I browse (like websites I only visit once), 0 friction (no upfront configuration needed), and persists the data (so I can keep growing the list as I scrape), and then generates a CSV. Also cheap.
Hence the building of Spider, and it really did solve my problem!
If you constantly find yourself scraping data, I hope this tool helps you too! I'm working on some new features so please sign up here(https://spider.amie-chen.com/) and let me know your use case. I'd love to make it useful for everyone.
Just tried this out and was skeptical at first, but it really works as promised. Keep it up, and keep this part of it free! Maybe make a live-updating hosted JSON feed that you'd have to pay for? ;-)
@boetter Thanks Jacob! We have the same ideas - I absolutely want to keep this part free because I think it should. Still working on the next phase -- which may be a hosted thing-- depends on the feedbacks from this launch.
Report
This looks great Are you able to scrape from pages that you have logged into? Or just public pages? Thanks!
Report
Great Product Amie, super impressed! I'll give more feedback once I get to use it on a client's project.
Feature request:
*Detachable window/new tab.
*Auto forward pages & collect column data.
*Rearrange columns both vertically & horizontally.
*Should be able to delete specific items from a column.
Overall great product. My best wishes.
Hey @amiechen01,
great tool that comes in so handy :) I've flipped you a message on Twitter with something I've noticed 👍️ Keep the great work up!
-- Peter
Hey Amie! really useful little tool. We use scrapers in SEO a lot, but there were mainly not that easy to operate. Yours comes really handy for small analysis projects. Kudos!
@neadoodigital Thanks! I'm so glad it's helpful to you guys. Please do not hesitate to give me feedback/wishes (Twitter DM @hyper_yolo would be the easiest). I want to continue to polish this tool!
Spider Pro
UNBOSS
Spider Pro
Spider Pro
Feature request: *Detachable window/new tab. *Auto forward pages & collect column data. *Rearrange columns both vertically & horizontally. *Should be able to delete specific items from a column. Overall great product. My best wishes.
Pros:+ZERO experience needed, easy to use. +Intelligent column identification & selection. +Nice UI.
Cons:-Tool appears as overlay, hiding bottom page contents (including next page button !!😞 ) -Some false positives -json button didn't work
ClubLink
Spider Pro
Spider Pro