Should you make /llms.txt or is it all hype?
Hey, fellow founders, CEOs, and other unemployed people of Product Hunt 👋
We all saw that three of our website viewers in a month came across our vibe-coded piece of AI slop mostly from ChatGPT.
That means that for a website to be viewed and listed by an AI crawler is as important as it was for Google. Not only that, but it is also important to feed these AI models the right information about our AI slop.
As nearly all major AI companies said, they don't prioritize llms.txt, and it does very little job to get listed in AI answers, but will it be so in the future? I see that more and more websites still make llms.txt pages and there is a feeling inside me that sooner rather than later it will be a "priority" page to scan by AI crawler.
So what do you think? Is it all hype, or will it actually become something to think about right now?
Replies
Not sure this is needed yet.
half convinced either way tbh. crawlers mostly ignore llms.txt right now, but writing content in clean, direct-answer blocks helps regardless, that's literally the shape citation engines like perplexity pull from. so even if the file itself never becomes a real signal, the habit of writing scannable answers pays off on its own.