Firecrawl
The Web Data API for AI Agents and Developers
5.0•13 reviews•2.6K followers
The Web Data API for AI Agents and Developers
5.0•13 reviews•2.6K followers
The API to search, scrape, and interact with the web at scale.
This is the 9th launch from Firecrawl. View more
Firecrawl Research Index
Launching today
AI/ML research moves fast, and the work that matters is split between new papers and the code that implements them. Most search providers omit or misrank key papers, leaving you to review sources by hand without ever being sure you've caught everything.
So we built an index for it. Firecrawl's index includes all 3M+ arXiv papers, as well as GitHub artifacts from top research repos, refreshed daily so agents always stay current.
Free Options
Launch Team
Firecrawl
Hey Product Hunt 👋 Eric, Caleb, and Nick from Firecrawl here. Today we're launching the Firecrawl Research Index, a specialized index for agents pushing the frontier of AI/ML research.
AI/ML research moves fast, and the work that matters is split between new papers and the code that implements them. Most search providers omit or misrank key papers, leaving you to review sources by hand without ever being sure you've caught everything.
So we built an index for it. Firecrawl's index includes all 3M+ arXiv papers, as well as GitHub artifacts from top research repos, refreshed daily so agents always stay current.
On arXivQA, the index has state-of-the-art recall, 18% above the next best provider at similar cost. It also scores 0.750 MRR, meaning the correct paper lands in the top two results. Your agent finds the right papers, right away.
Plus, the index ships with a complete research toolset. Agents can retrieve papers, verify claims against the full text, and pull code for implementation - running the full research loop end-to-end. An agent training a model overnight could pull an optimizer from a recent paper and a stability fix from a related GitHub issue, then test both in its next run.
Firecrawl Research Index is available now in the API via /search/research, CLI, MCP, and SDKs, and plugs into any harness you already run (Codex, Claude Code, or Grok Build).
Try it here: https://docs.firecrawl.dev/features/research
We'd love to see what you build with it.
Elentaria
@ericciarla congrats! Will definitely try it
Build Check
Hey Eric! IT's truly impressive. 3M+ papers is more than enough to make researches that actually matter. Love to see you helping on this and wish you all the best!