Does llms.txt do anything?

The idea is reasonable. Give models a clean, plain-text map of your site so they do not have to reconstruct it from navigation and markup. Webflow added an upload field for it. Most AEO checklists list it near the top.

The numbers

Ahrefs looked at 137,210 domains receiving traffic in May 2026. Two findings, and the second is the one that matters:

• 28% publish an llms.txt. Adoption is real and fast.
• 97% of those files received zero fetches in the month measured.

Not low traffic. Zero. The file is being written and not read.

Google's John Mueller has been about as direct as a search advocate gets, saying no AI system currently uses llms.txt and describing it as a temporary crutch for coding agents rather than something built for search. No major vendor has documented reading it. Not OpenAI, not Anthropic, not Perplexity, not Google.

Meanwhile robots.txt, sitemap.xml and the actual HTML of your pages are demonstrably fetched by all of them, constantly.

So why does this site have one

Three reasons, and none of them is that it will get me cited.

It costs nothing. Mine is a few hundred bytes, generated from the same list of pages as the sitemap. It cannot fall out of date independently because there is one source.

It is a cheap option on a standard that might land. If a vendor starts reading these files, the file is already there. If none ever does, I have spent a few hundred bytes.

Writing it is a useful exercise. Compressing a site to one plain-text page forces you to say what each page is for in one line. Every time I have done this I have found a page I could not describe, which is always a page that should not exist.

What I do not do is tell a client that llms.txt will make ChatGPT cite them, or bill for it as a deliverable, or put it in a proposal above the things that are measurably read.

The measurement trap

Here is the part that makes this hard to check yourself, and it is worth knowing. On Webflow, you do not get server logs unless you are on Enterprise. So you cannot see whether anything fetched your llms.txt, your sitemap or your pages, by user agent, at all.

The workaround is to put the site behind Cloudflare and read the edge logs. Then you can answer the only question that matters: did anything ask for this file, and which bot was it?

Until you can see that, every claim about what AI crawlers do on your site is somebody else's data.

What actually earns the fetch

Ordered by how much of my time each is worth:

• Content in the served HTML. Nothing downstream matters if the words are not in the response.
• One URL per idea. A thing that can be cited needs an address.
• robots.txt that does not block what you want read. I still find sites blocking the crawlers they are paying someone to court.
• A sitemap that matches reality. The most-cited study in this space found roughly a third of AI crawler fetches hitting 404s and could not explain why. Nobody has followed that up in twenty months, which tells you where the unclaimed ground is.
• llms.txt. Last, cheap, honest about its odds.

Ship the file. Just do not confuse shipping it with being read.