Launching today
Known Agents
Track the bots and AI agents crawling your website
18 followers
Track the bots and AI agents crawling your website
18 followers
Known Agents is "Google Analytics for bots". AI agents, crawlers, and scrapers are now half of your website's traffic, and they're becoming more important to your business every day. They're silently buying your products, reading your docs, and researching your company. Known Agents gives you realtime visibility into all of this activity. You can see which bots are visiting your site, the pages they’re most interested in, where they’re coming from, and which humans they're referring to you.
Known Agents
Hi everyone 👋
Almost half of your website's traffic isn't human anymore. It's bots and AI agents. (source)
Bots aren't new, but AI just made their activity a lot more meaningful. AI agents are now doing things like:
🛍️ Buying your products and booking reservations
💻 Reading your docs to implement your tools and code
📖 Scraping your content to train models
🔬 Researching your business for competitors
The problem is that they're completely hidden from you right now. You're blind to half of your visitors if you're only using a human analytics platform, and you can't optimize what you can't see.
Known Agents is "Google Analytics for bots". It lets you see exactly what they're doing on your pages, and how they're referring real humans from AI chat and search platforms. This is a new type of user that's only going to get more important.
It's free for the vast majority of websites, and takes 5 minutes to set up.
Check it out: https://knownagents.com
Let me know what you see in your realtime feed. Which bots are visiting, and what surprised you?
Feedback is appreciated!
@ghking Congrats 🙌
Once people see all these AI bots in their feed, what are your early users actually doing with the info? Blocking them, optimising for them, or just watching? Curious where this goes 👀
Known Agents
@francesco2689 thank you! Right now, it’s a mix of all three.
Every website now needs basic visibility into AI agents and LLM referrals, which are becoming a new category of traffic source and distribution channel, similar to search or social.
What you do with that information depends on your industry. For example, publishers and content creators can use these insights to control access with robots.txt and firewall rules. E-commerce companies can see where shopping agents are getting stuck before completing a purchase, then optimize their UI and checkout flows to improve conversion.