Launching today
AI Crawler Checker

AI Crawler Checker

See what your robots.txt says to 15 AI crawlers

1 follower

Per-bot verdicts (allowed, partial, blocked, no rules) for GPTBot, ClaudeBot, Google-Extended, PerplexityBot, Bytespider, CCBot and 9 more, following RFC 9309. Includes a block snippet generator and an llms.txt checker. Free, no LLM calls.
AI Crawler Checker gallery image
AI Crawler Checker gallery image
AI Crawler Checker gallery image
Launch Team