All activity
Ben Caulfieldleft a comment
As the developer of a web crawler myself, I struggled to connect to crawled data with MCP in a practical manner. Generalized solutions sort of worked, but needed guidance and/or a few queries just to get warmed up to the schema. They always seemed a bit behind the curve. mcp-server-webcrawl works with WARC, wget, InterroBot, Katana, and SiteOne. It understands it is a query engine on top of...

mcp-server-webcrawlMCP server for web crawl data
AI search and retrieval for web crawlers

mcp-server-webcrawlMCP server for web crawl data
