ScrapingBee (formerly ScrapingNinja)

The easiest web scraping API on the web

#2 Product of the DayAugust 26, 2019
Web Scraping is hard, scraping at scale can be very challenging.
ScrapingBee is a simple API that does many things for you so can just focus on the data you want to extract and the product you wan to build.
Would you recommend this product?
6 Reviews4.2/5
Hello Product Hunt! I'm super excited to show you ScrapingBee (formerly ScrapingNinja) 🕷! One year ago, with my partner @sahinkevin we decided to leave our full-time job to go the entrepreneurship way 😎. Being both huge fans of the indie-hacker/shipping/entrepreneurship culture promoted by people such a @levelsio or @marckohlbrugge we wanted to see if we could make it. Fast forward 1 year, and after many ups and downs, we have finally something that currently brings us enough 💵 to 🍜, and although the battle is far from being won, we are proud to show you ScrapingNinja today. Web Scraping is hard, scraping at scale can be very challenging. You have to handle: - Javascript rendering 💻 - Chrome headless 🛠 - Captcha 🤖 - Proxy 🕵️‍♀️ ScrapingBee is a simple API that does all the above for you. We quickly realized that there was a need for less technical users for ready-made APIs that returns formatted data from the most common websites. That’s why we just launched our API-store: - The idea is to be able to turn every website into a usable API, we currently only support Instagram, but more are coming soon!
Hey, is this really legally safe to do?
@pierre_dwf Pierre has built an awesome product. Pulling in data through a headless browser using a proxy helps get around issues that makes most scrapers completely useless. It’s a great product. Glad I joined the beta.
@francisco_ramos Thank you very much!
What differentiate you from ?
@pierre_dwf .. I am using scraperapi along with a few other proxy services .. would love to know how it compares to scraperapi?
@musab better proxy, real premium proxies, render js available for all plan, Api store :)
@pgordon please let me know how it went ;)
@pierre_dwf thanks .. yeah i noticed they moved their JS Rendering to the $99 plan .. mine still works as I am on a a grandfathered plan .. will signup soon and take a look
@pierre_dwf sorry .. that was the $249/m plan
Easiest and most reliable scrapping API I have used yet, good job!