Agent Directory | Rankly
Largest Catalog of 4000+ Agents, Bots and Crawlers in web
Start new thread
Rankly

Agent Directory | Rankly - Largest Catalog of 4000+ Agents, Bots and Crawlers in web

by•
The complete public catalog of AI agents, search crawlers, scrapers, and bots active on the web. Browse by operator (OpenAI, Anthropic, Google, Perplexity, and more), filter by type, see traffic share, identification patterns, recommended robots.txt rules, and how each bot behaves on your site.

Add a comment

Replies

Best
Rankly
Maker
📌
Introducing Rankly Agent Directory. It has 4000+ agents, crawlers, and bots from 1300+ operators. See agent-level information like: - UA Strings - IP-range JSONs to verify sources - Type and purpose - Safety + SEO impact classification - Block rate across top sites - Traffic share - Crawl-to-click ratio - Operator-level bot lists You can also test whether an agent can access your website using the URL Inspection tool. This makes it one of the most comprehensive repositories of agents, crawlers and bots in the internet.