Firecrawl

Firecrawl

Turn entire websites into LLM-ready data

4.8•6 reviews•

1.7K followers

Visit website
Firecrawl is the easiest way to extract data from the web. Developers use us to reliably convert URLs into LLM-ready markdown or structured data with a single API call.
This is the 5th launch from Firecrawl. View more

/agent by Firecrawl

Gather structured data wherever it lives on the web
Firecrawl /agent is a magic API that searches, navigates, and gathers data from even the most complex websites. Describe what data you want and agent handles the rest. Find information in hard-to-reach places, return single datapoints or entire datasets at scale.
/agent by Firecrawl gallery image
/agent by Firecrawl gallery image
/agent by Firecrawl gallery image
/agent by Firecrawl gallery image
/agent by Firecrawl gallery image
Free Options
Launch tags:Developer Tools•Artificial Intelligence•Data
Launch Team
NMI Payments
NMI Payments
Don’t Integrate Payments Until You Read This Guide
Promoted

What do you think? …

Eric Ciarla
Firecrawl
Maker
📌
Hey Product Hunt 👋 We're Eric, Caleb, and Nick from Firecrawl. Today we're launching /agent, an API that can gather data wherever it lives on the web. Traditional web extraction requires exact URLs and only scrapes what's on that page. But real data is scattered. It lives across sites, buried in paginated catalogs, hidden in multi-step flows, and you rarely know the exact URLs upfront. We built /agent to handle this autonomously. Just describe what data you need, with or without a URL, and it figures out the rest. It searches, navigates, and gathers information from the widest range of websites, reaching data no other API can. Whether you need one data point or entire datasets at scale, it just works. It's live now in the Firecrawl API and SDKs, and coming soon to n8n, Zapier, and our MCP. You can try it out in our playground: https://www.firecrawl.dev/app/agent Would love to hear what you think. P.S. Launching in research preview, expect improvements as we gather feedback.
Olga Scry

@ericciarla congrats on the launch! when will it be available via n8n?

Jay Song
Shadow

@ericciarla I still remember spending days writing and testing web scraping code. The younger generation is lucky they'll never know that struggle! haha. Can't wait to try this out. Congrats!

Malek Moumtaz

@ericciarla This is compelling! How do you balance autonomy vs. control for developers, specifically, how can users constrain scope, cost, and sources when the agent is discovering paths and URLs on its own at scale?

Jed White

@ericciarla Congrats on the launch. What a cap to the year! In awe of the useful features you've all shipped this year.

David Kaufman

Awesome stuff Eric! We've been using the structured data in the single URL scraping data for a while with great results so excited to checking out how much deeper /agent can go and what info we can unlock

Ivan Xu

Just tried the playground on a gnarly site — got usable Markdown fast and it saved me time. Excited for the n8n/Zapier hookups you mentioned. Keep shipping! 🔥

Eric Ciarla
Firecrawl
Maker

@_ivan1 amazing! n8n is live and zapier is coming soon

Chilarai M
Swytchcode

Really interesting. I would love to use it.
Where is the scraped data stored and how do you chunk it?

Eric Ciarla
Firecrawl
Maker

@chilarai It is stored wherever you want it to be stored like in Supabase and you can chunk it yourself

Chilarai M
Swytchcode

@ericciarla I have a real use case. Anyway I was about to look for a tool like this. Glad that I found a good one

Zeth Lee
CodeBanana

Huge fan!

Eric Ciarla
Firecrawl
Maker

@zethleezd Thanks Zeth! Hope you enjoy it

Jorge Alcántara
Nice! Any way to pass login data?
Vrijraj Singh
Lamatic.ai

Congrats team

Eric Ciarla
Firecrawl
Maker

@vrijraj Thank you!

1234
Next
Last