ScrapingBee
Easiest Web Scraping API
Start new thread

ScrapingBee (formerly ScrapingNinja) - The easiest web scraping API on the web

by•
Web Scraping is hard, scraping at scale can be very challenging.
ScrapingBee is a simple API that does many things for you so can just focus on the data you want to extract and the product you wan to build.

Add a comment

Replies

Best
Maker
Hello Product Hunt! I'm super excited to show you ScrapingBee (formerly ScrapingNinja) 🕷! One year ago, with my partner we decided to leave our full-time job to go the entrepreneurship way 😎. Being both huge fans of the indie-hacker/shipping/entrepreneurship culture promoted by people such a or we wanted to see if we could make it. Fast forward 1 year, and after many ups and downs, we have finally something that currently brings us enough 💵 to 🍜, and although the battle is far from being won, we are proud to show you ScrapingNinja today. Web Scraping is hard, scraping at scale can be very challenging. You have to handle: - Javascript rendering 💻 - Chrome headless 🛠 - Captcha 🤖 - Proxy 🕵️‍♀️ ScrapingBee is a simple API that does all the above for you. We quickly realized that there was a need for less technical users for ready-made APIs that returns formatted data from the most common websites. That’s why we just launched our API-store: - The idea is to be able to turn every website into a usable API, we currently only support Instagram, but more are coming soon!
Hey, is this really legally safe to do?
Pierre has built an awesome product. Pulling in data through a headless browser using a proxy helps get around issues that makes most scrapers completely useless. It’s a great product. Glad I joined the beta.
Maker
Thank you very much!
Can it download things like audio files and such from websites as well?
Maker
Hey David thanks for asking. Unfortunately at the moment ScrapingNinja API only returns the raw HTML from websites, or JSON formatted data if you use the ready made APIs. What would be your use case ?
Hello there, congrats on launching ! Why should i pay for ninja when spiders is free ? I only want to scrapp data from ecommerce once a day and apply some logic to the result to ping me (or not) IF some rule. Is your product right for me ?
Maker
, hello, the product you linked is meant to be used by a real human with its browser open, it does not allow you to scrape all day long, multiples pages at the same time for example. And about the thing you asked, ScrapingNinja can definetely help you, but you’d need to setup the alerting thing yourself :)
we built a tool that extract product data from both category and product pages automatically. No selectors, no rules. We started working on alerting features. Try it out
Maker
Hey Alexandru, great job on quantati. Just a few questions, Is quantati supposed to work on every website or only on a certain list of websites? I tried to extract data from Zalando of this url: on your demo page, and it did not work, it only returned me "Type, url, humanlangage, resolvedpageurl'
What differentiate you from scraperapi.com ?
.. I am using scraperapi along with a few other proxy services .. would love to know how it compares to scraperapi?
Maker
better proxy, real premium proxies, render js available for all plan, Api store :)
Maker
please let me know how it went ;)
thanks .. yeah i noticed they moved their JS Rendering to the $99 plan .. mine still works as I am on a a grandfathered plan .. will signup soon and take a look
sorry .. that was the $249/m plan
Easiest and most reliable scrapping API I have used yet, good job!
Congrats on your indie way! It's really helpful.
Maker
Thanks :)
Maker
Hey, yes it does, we still have little problems with LinkedIn but we are working on it. The websites work fines
Thanks for your reply Pierre!
Can it help me scrape twitter followers?
Maker
Yes it can 😉
what would you charge me to scrape Twitter hashtags and facebook groups?
Maker
Please send me your required volume, concurrency at , I'll answer to you ASAP :)
will do this week
12
Next
Last