How We Keep 5,700 YC Companies Fresh Without Paying for an API

YC doesn't have a public API. But Algolia powers their search.

Every night at 2am UTC, our GitHub Actions cron job hits YC's Algolia endpoint, diffs the response against yesterday's snapshot, and surfaces any new companies or job listings.

The whole pipeline is open source:

If you're building a data product on top of public APIs, happy to share the full architecture - ask below.

41 views

Add a comment

Replies

Best

Nice approach. I always like seeing simple solutions to problems that people assume need an expensive API.

Using a nightly sync instead of trying to keep everything real-time also feels like a practical tradeoff.