Launching today
AI Crawler Checker
See what your robots.txt says to 15 AI crawlers
1 follower
See what your robots.txt says to 15 AI crawlers
1 follower
Per-bot verdicts (allowed, partial, blocked, no rules) for GPTBot, ClaudeBot, Google-Extended, PerplexityBot, Bytespider, CCBot and 9 more, following RFC 9309. Includes a block snippet generator and an llms.txt checker. Free, no LLM calls.
AI Crawler Checker Reviews
Reviews