Launching today
AI Crawler Access Checker
Check AI search and training rules in robots.txt
2 followers
Check AI search and training rules in robots.txt
2 followers
Check robots.txt permissions for a specific page across ChatGPT search, Claude, Perplexity, Google and Bing. Compare search crawlers with training agents, including OAI-SearchBot and GPTBot. Fetch the public file or paste your own, then see the matching rule for each crawler. Free, with no signup or email required. This checks declared rules, not firewall access, indexing or citations.
