AgentSurge - Is your site invisible to ChatGPT and Claude?
by•
AgentSurge makes websites visible and actionable for AI agents through structured diagnostics, WebMCP readiness, and continuous monitoring.
Replies
Best
Maker
📌
Hey PH! I built AgentSurge because I noticed a weird gap: we spend months optimizing for Google, but completely ignore whether AI assistants can even access our sites.
I tested 50+ sites and found that nearly half block AI crawlers without knowing — usually a robots.txt rule from a security plugin, or a CDN setting that challenges bot traffic.
AgentSurge started as a simple checker for myself, then grew into a full audit tool covering robots.txt, llms.txt, JSON-LD schema, crawler access, and content structure.
The scanner is completely free, no signup needed. Just paste a URL and see your score. Would love your feedback on what's useful and what's missing.
Replies