Badges

Tastemaker
Tastemaker
Gone streaking
Gone streaking

Forums

•

3h ago

AI Crawler Checker - See what your robots.txt says to 15 AI crawlers

Per-bot verdicts (allowed, partial, blocked, no rules) for GPTBot, ClaudeBot, Google-Extended, PerplexityBot, Bytespider, CCBot and 9 more, following RFC 9309. Includes a block snippet generator and an llms.txt checker. Free, no LLM calls.
View more