dear robots - The public record of who blocks AI, and who doesn't

Hey Everyone, I built this to easily identify websites rules on their robots.txt file to help with my own development. type in any website, be it one you want to crawl on or audit your own website and how crawlers interact. API available to integrate in your dev tooling and pull information live. Let me know what you think, Thanks