All activity
CrawlAPI turns any URL into clean markdown and structured data, built for LLM pipelines, AI agents, and RAG systems.
3 endpoints:
ā¢ /scrape ā single URL to markdown + metadata
ā¢ /batch ā up to 10 URLs in parallel
ā¢ /search ā search query ā scrape top results
Ships with OpenAPI spec + LangChain/CrewAI tool manifests. Drop it straight into your agent.
Free tier available. $9.99/mo for 5,000 calls.
CrawlAPIWeb scraping API for AI agents ā URL to markdown
Jason Wolfleft a comment
Hey PH! š I built CrawlAPI after getting frustrated with the existing options ā Firecrawl and ScrapingBee are great but start at $19-49/month, which is steep if you're just adding browsing to a side project or prototype. The "agent-native" angle was the key insight: instead of making developers figure out how to integrate a generic scraping API, CrawlAPI ships with copy-paste tool manifests for...
CrawlAPIWeb scraping API for AI agents ā URL to markdown