Wibbly

Browser automation API

1 follower

Browser automation API

1 follower

Extract any content from any website in a JSON format! Main features: - Grab HTML meta, JSON-LD and Open Graph in a normalized fashion. - Grab custom content from any URL using custom rules - Take screenshots of any webpage - Generate PDF of any webpage

Free Options

Launch tags:Productivity•API•Developer Tools

Launch Team

Tines — The intelligent workflow platform

The intelligent workflow platform

Promoted

This looks like a very interesting concept, I like the idea of getting structured data from websites! Will you include some out of the box logic to extract and structure data from HTML tables going forward (seeing these are still common on financial websites)? On a very different note, the "copy key" on my dashboard added a leading space to the actual API key. It took me a minute to understand my requests were failing because of this. Maybe you could remove this? Either way, keep it going, I can definitely see some use cases for a product like this!

Report

4yr ago

Wibbly

Maker

@mutedjam thank you so much for the feedback! I will get the copy button fixed asap. I like the idea of structuring tables, I will have a think about it, in the meantime you can extract data from tables simply using custom query to point to td or tr tags.

Report

4yr ago

Wibbly

Maker

Hi Product Hunt community, Wibbly is a Browser Automation API which can extract both metadata and custom content from any website in a scalable and reliable way. The API can grab metadata like title, description, featured image, language.. inspecting HTML, JSON-LD and Open Graph and returns them in a normalized JSON format. Since every website is different, it is also possible to provide custom selection rules which allow to extract custom content from a web page simply providing CSS Selectors and Attributes straight into the API request. More info here: https://www.wibbly.co/docs#selec... It can also detect media content like audio and video. Wibbly returns the real state of any web page since it uses headless browser technics making the interaction with the browser completely transparent to the user. Wibbly has been designed to leverage the power of cloud infrastructure being completely running on Microsoft Azure and Cloudflare. The pricing is highly competitive and.... free plan is available!

Report

4yr ago

Where is automation here? I remember I did the same project to extract prices from local stores with push notifications to telegram while page changes (or specifically the price).

Report

4yr ago

Awesome product! I'm not a developer myself but work closely with them, love the idea of getting data from websites. How did you came up with this? cheers!

Report

4yr ago