Firecrawl
The Web Data API for AI Agents and Developers
5.0•12 reviews•2.2K followers
The Web Data API for AI Agents and Developers
5.0•12 reviews•2.2K followers
The API to search, scrape, and interact with the web at scale.
This is the 7th launch from Firecrawl. View more
/monitor by Firecrawl
Launching today
/monitor notifies your agent via webhook the moment pages or sites change. Use up to 90% fewer LLM tokens by only ingesting what changes on a page.
Free Options
Launch Team
Firecrawl
Firecoach AI
Congrats Eric, Caleb, and Nick! 🔥
Love this build. The 90% token cut is wild. That's the number every team running AI products is quietly desperate for.
We pull buyer-side data into FireCoach all day long for sales prospect profiles, and the re-scrape vs. monitor tradeoff is exactly the thing we keep fighting. Going to share this with our engineering team.
Quick question: does the diff get summarized in natural language before hitting the webhook, or does the receiving agent still have to interpret the raw diff?
Either way, this is one of those "obvious in hindsight" products. Nice work!
Firecrawl
@midori_verity That's incredible. Thank you! Right now it's just the raw diff and the receiving agent has to interpret that raw diff, which they are pretty good at.
mailX by mailwarm
Can you set rules for what counts as a meaningful change, like only when certain sections or selectors update?
Firecrawl
@naimz Yeah, so it actually depends on the goal you set. If you set a specific goal about a specific selector, then it will only notify you around that. Vice versa for entire pages!
mailX by mailwarm
@ericciarla Grand, thanks
@ericciarla @caleb_peffer @nickscamara Congrats on launching /monitoring!
The shift from "blind polling" to "intelligent diffing" is exactly what dev teams need to keep AI agent costs under control. I’ve lost count of how many tokens I’ve burned re-scraping unchanged docs.
How does /monitor handle dynamic content (like JS-heavy dashboards) vs. static text? Does it ignore irrelevant UI changes (like ad rotations or timestamps) to ensure the webhook only fires for meaningful data shifts?
🕸️
Been waiting for something like this. Setting up custom polling logic to watch external data sources is one of those tasks that eats 2-3 hours and nobody talks about
Been doing the "scrape on a cron + diff manually" thing for competitor tracking for months. The webhook approach is cleaner. One question/ does it handle pages that hydrate content via JS after first render?
How does the tool bypass advanced anti-scraping blocks like Cloudflare or CAPTCHAs?
Can the system detect and highlight a single word change within a text?
agents re scraping entire pages every hour just to check if one price changed is such a waste of tokens and money. only ingesting the diff is how it should've always worked
Firecrawl
@tina_chhabra 100% this is overdue!