Antoine Ross

Thanks everyone for the feedback so far. A quick update on this release: This release is focused on making Supacrawler fully open source. Over the next month, we’ll be wrapping up beta. After that, Supacrawler will move into general availability. The biggest change is the new Parse endpoint. It lets you extract structured content from any website and return it in JSON, CSV, or Markdown. Instead...

Hi all! Happy to share that I'm releasing the second part of this release: Here are the SDKs! https://github.com/Supacrawler/supacrawler-py https://github.com/Supacrawler/supacrawler-js I've included examples on how to use the SDK for every api route we have and will add more guides for more use cases soon! Stay tuned for that in the docs and the blog as well! See how to install here:...

Hi ProductHunt! I originally built Supacrawler for myself. I needed a reliable way to scrape web data for a project, and when I looked at the existing tools, I noticed a pattern: they were all priced for enterprise. That pricing model doesn't work if you're a student, a researcher, or a small company. So, I built Supacrawler to fix this. It's a powerful scraping engine designed for builders,...

The inspiration for this project is Taxonomy, which is a modern starter template for Nextjs.13. Initially, I used Taxonomy as a way to understand Next.js — I loved how the design was simple and clean. After using Taxonomy for a while, I discovered it lacked certain features and the level of customization I desired. For instance: 1. Documentation: Contentlayer, which was a crucial component for...