Hey Product Hunt! 👋 I've been losing my mind lately trying to feed messy, JS-bloated websites to my local agents. I've been following the push for the new llms.txt standard (giving AI crawlers a clean markdown version of a site's structure), but almost nobody has actually implemented it yet. I ended up writing a custom extraction script to automatically generate an llms.txt file from any URL just to save my own sanity while building an Answer Engine Optimization platform. I realized other developers might need this, so I detached the logic and hosted it as a free utility. There is no sign-up required. I did have to hard-cap it at 10 free reports per user just to protect myself from getting bankrupted by server costs, but that should be plenty to test your main domains. I'd love to know where the extraction logic fails. Throw your heaviest, most complex websites at it and let me know what breaks!

llms.txt Architect

Standardize your website for AI agents and LLM crawlers.

Standardize your website for AI agents and LLM crawlers.