Subscribe
Sign in
Tidalwaves API
p/tidalwaves-apiAnalyze breaking news from around the world
Start new thread
Alexander Klos

Tidalwaves API - Analyze breaking news from around the world

by•

The TidalWaves API provides an easy to use schema for breaking news, so you can build apps that perform in-depth data mining and robust visualizations, without spending months finding and sanitizing your data.

Add a comment

Replies

Best
Alexander Klos
Maker
Hi Hunters :) I made this API to help solo devs and small teams easily create visualizations and data mining applications using live online news article data. The data pipeline handles 90% of what most people would like to extract from news articles for data mining purposes. It's a sanitized, standardized, and clean data feed that updates with the latest articles every 15 minutes. Some notable features include: - Global news coverage. See all articles revolving around geopolitics, big tech news, and cultural discourse. - Machine learning topic modeling. Every batch of articles is run through the model to identify the top breaking stories. - Accurate, sanitized data. Our data pipeline cleans and transforms the raw data from GDELT to make it easy to use and salient. - Hundreds of thousands of categorized keywords. Search for themes, people, organizations, or anything else. - Geographical locations tied to each article. Pinpoint breaking stories to locations with coordinates, tags, and country codes. - Updated every 15 minutes. As close to real-time as you can get with this vast range of sources. My goal is to create an API that makes "big" news metadata accessible to indie developers, saving them time and headaches, and allowing them to make cool apps. Thanks!
Raza Rafaideen
Nice one, How we can get the App keys..
Alexander Klos
Maker
@raza_rafaideen_ The API is currently available through Rapid API: https://rapidapi.com/prohobo/api...
Laura Smith
Congratulations Alexander! The dashboard looks incredibly sleek! And the API key tracking/graphs etc. are super useful! Would love to know behind-the-scenes details of what your experience was like building an API product. E.g. Did you implement API key generation/credits/monitoring/graphs etc. yourself or did you use some external API gateway solution?
Alexander Klos
Maker
@essaygirlsdaily Hey Laura, thanks :) I built the data pipeline in Python, the API is running on a Node server, and all of the visualizations I made using d3.js and react-vis. Actually, the marketing site was the easiest part, because the data is well defined and easy to put into graphs. I'm hosting it on RapidAPI currently because they handle subscriptions, give access to a marketplace, and are generally quite good to work with - but I may self-host it in the future.
Mary Samovol
wow! looks great!
Jake Creps
How am I just now finding out about this? 😂
Yannick
This is a cool project. A friend and I did the exact same thing at the beginning of this year but stopped due to the lack of interest from other devs. I wish you more luck :)
Bookface
Looks smart. What is the difference between this and the GDELT API ?