Featured

Web scraper that works on every website

Featured comment

Jan Čurn
@jancurn · Co-founder, Apifier
@passingnotes Hey David, thanks! We're considering using a similar model as GitHub - all free accounts have to make their crawlers public and only paid accounts can have them private. Do you think people would be okay with that?

Discussion

M
Jan Čurn
@jancurn · Co-founder, Apifier
@passingnotes Hey David, thanks! We're considering using a similar model as GitHub - all free accounts have to make their crawlers public and only paid accounts can have them private. Do you think people would be okay with that?
David Carpe
@passingnotes · Thinker & Layabout
nice! would love to see a community driven collection of custom crawlers (to simply recycle or emulate)
Kat Manalac
@katmanalac · Partner, Y Combinator
Apifier is a web scraper that extracts structured data from any website using a few simple lines of JavaScript. For example, imagine you found a website selling shoes and want to get a spreadsheet with all the shoe sizes, colors, prices etc. You could create such a spreadsheet manually using copy and paste, but that would take you a lot of time and frustrati… See more
M
Jan Čurn
@jancurn · Co-founder, Apifier
Hi Hunters, we’re Jan and Jakub, the makers of Apifier. About a year ago we looked for a web scrapper for one of our consulting projects but none of the existing ones actually worked for websites that we needed. So we decided to build a new one. Unlike the point-and-click web scrapers, Apifier doesn't run into troubles with complicated or dynamic websites a… See more
M
Jan Čurn
@jancurn · Co-founder, Apifier
@gerbz, yeah absolutely, we're actually rotating a number of proxies. We can also arrange for people to use their own list of proxies if they want.