What is the best tool to extract data from a website?

I'm looking for a tool that can extract headlines, abstracts, authors, etc. I was impressed with kimono labs, but then it got acquired by Palantir.
Sebastian RumbergI do things at Ballou PR · Asked

7 recommended

7
Import.io

Scrape the web, sans manual scripting

Ryan Hoover44Founder, Product Hunt · Written
Import is slick. Use its WYSWYG editor to select elements of the page/site you want to track and it'll turn it into an API you can use elsewhere.
CommentsTweet
It's not perfectly intuitive but it's always my go-to for scraping when I don't/can't write a script.
CommentsTweet
2
Artoo

The client-side scraping companion

Nicolas Le RouxGrowth marketer, blogger · Written
Love Artoo as it's really simple to use.
CommentsTweet
1
Kimonify chrome extention

Graham Campbell3🚀 new ventures, faster · Written
You can still download the "kimonify" chrome extension by following this link, and you can still build CSV tables and output scraped data in JSON format on many sites. The only thing is that you can't schedule routine crawls, or automate pagination. But to get the data from any given page, just click on the <> icon for the "raw data view" and then click either JSON or CSV, and then highlight the data, copy it, and paste it into your Google sheet/Airtable base etc. It's admittedly a clumsy process, but it still saves me a ton of time.
CommentsTweet
I have been using this for a few years. It is awesome!
CommentsTweet
1
Crawly

Never write another web scraper

Solid tool for scraping data from a website.
CommentsTweet
1
Google Spreadsheets

Just use ImportXML in Google Spreadsheet. Works great if you are not importing too much data. On top of that you get the power of being inside a spreadsheet already. And..it's free!
CommentsTweet
I still have the Chrome extension and desktop app if you would want to use it. I can easily share it with you, just let me know.
CommentsTweet