AI search

Does llms.txt matter for SEO?

For Google, no. Google says its Search, including AI Overviews and AI Mode, doesn’t use llms.txt files, so adding one won’t help you rank or appear in its AI answers. It can still be useful for other tools that read it, and it does no harm. For most small businesses, it’s a low priority compared with the pages it would point to.

Clients ask me about llms.txt more than almost any other AI search topic, usually because a tool or a sales email has told them their site “fails” without one. This post sets out what it is, what the platforms say, and how to decide.

What llms.txt is

llms.txt is a proposed plain-text file, written in Markdown and placed at the root of a website, that gives AI tools a short summary of the site and links to its most useful pages. It was proposed by Jeremy Howard in September 2024 as a way to help language models find the right content without reading every page.

The idea is simple. A site publishes a file at /llms.txt with a title, a brief description and a curated list of links, often to plain Markdown versions of key pages. An AI agent or tool that knows to look for the file can read it quickly instead of working through menus, scripts and adverts.

The llms.txt proposal was updated in August 2026. Its author says thousands of sites now publish one, and that documentation platforms generate them automatically. It’s still a proposal, not a web standard, and no search engine or AI company is obliged to use it.

What Google says about llms.txt

Google says llms.txt isn’t needed to appear in Google Search or its AI features, because Google Search doesn’t use these files. Its AI optimisation guide lists llms.txt among tactics you can ignore for Google, while noting it’s completely fine to keep one for other services that use it.

Google’s AI optimisation guide is direct about it. Under things you can ignore for Google Search, it says you don’t need to create new machine-readable files, AI text files, markup or Markdown to appear in Google Search, including its generative AI capabilities, “as Google Search itself doesn’t use them”.

Google added that clarification to the guide on 15 June 2026, according to its documentation updates page. The same guide says there’s no special markup needed for AI Overviews, and its AI features documentation says there are no additional requirements to appear in AI Overviews or AI Mode beyond normal SEO best practice.

So for Google, the answer isn’t a matter of opinion.

What about ChatGPT, Perplexity and Claude?

The crawler documentation from OpenAI, Perplexity and Anthropic explains how to control their bots through robots.txt, but none of it describes llms.txt as a way to appear in their answers. If other AI tools use the file, they don’t document it as a visibility signal.

What these companies do document is robots.txt. OpenAI’s crawler documentation says sites that opt out of OAI-SearchBot won’t be shown in ChatGPT search answers. Perplexity’s crawler documentation recommends allowing PerplexityBot to appear in its results. Those settings affect visibility directly. An llms.txt file, as far as their documentation shows, doesn’t.

That could change. Agents that complete tasks on websites are growing, and a clean summary file is genuinely convenient for them. But “might be used by some tools in future” is a different claim from “you need one to be visible in AI search”, which is how it’s often sold.

llms.txt versus the things that do matter

The files and signals AI search platforms actually document are robots.txt access, indexable pages and useful content. llms.txt sits well below these, because a summary file can only point to pages. If those pages are thin, blocked or missing, the file changes nothing.

What Does it affect AI search visibility? Documented by
robots.txt allowing search crawlers Yes, blocking a search crawler removes you from that assistant’s search results OpenAI, Perplexity, Anthropic
Pages indexed and snippet-eligible in Google Yes, required to be a supporting link in AI Overviews and AI Mode Google
Useful, non-commodity content Yes, Google calls it the most important factor for generative AI search Google
Structured data Helps understanding and rich results, not required for Google’s AI features Google
llms.txt Not used by Google Search. Not documented as a visibility signal by the others Google, llms.txt proposal

When an llms.txt file is worth adding

An llms.txt file can make sense if your site has documentation, product data or developer resources that AI coding tools and agents fetch, or if your platform generates one automatically. For a typical small business website, it’s reasonable to add one only after the basics are in place.

It’s worth considering if:

  • you publish technical documentation, APIs or help content that developers use through AI tools
  • your website platform creates and maintains the file for you, so it costs nothing
  • you’ve already checked robots.txt, indexing and your key pages

It’s probably not worth your time yet if:

  • your key service or product pages are thin or out of date
  • robots.txt blocks AI search crawlers you want to appear in
  • someone is charging you to create one as an “AI SEO” fix

If you do add one, keep it accurate. An out-of-date file that links to removed pages or old prices is worse than none, because any tool that reads it gets the wrong picture of your business.

What I learned

When I check sites for AI search readiness, a missing llms.txt file has never been the reason a business isn’t showing up. The reasons are almost always a robots.txt rule blocking a search crawler, key pages that aren’t indexed, or pages that don’t clearly answer what customers ask.

GaraDry is named first in Google’s AI Overview for “best garage door threshold seal” in the UK. The store does have an llms.txt file, a standard one generated by the platform, but that isn’t what got it there. Product pages that explain clearly what each seal does and who it suits did the work.

That’s why I treat llms.txt as a tidy extra at the end of a checklist, never at the top.

The free SEO checker reports whether a site has an llms.txt file as information, not as a fail, alongside the checks that do affect visibility. If you’d like a full review, the AI citation readiness service covers crawler access, indexing and content together.

FAQ

Does Google use llms.txt?

No. Google’s AI optimisation guide says Google Search doesn’t use llms.txt or similar AI text files, and that you don’t need them to appear in Google Search or its AI features, including AI Overviews and AI Mode. Google says it’s fine to keep one if other services you care about use it.

Is llms.txt the same as robots.txt?

No. robots.txt tells crawlers which parts of a site they may or may not access, and AI companies document how their bots follow it. llms.txt is a proposed summary file that points AI tools to useful content. It doesn’t grant or block access to anything.

Can an llms.txt file hurt my SEO?

There’s no evidence an accurate llms.txt file harms SEO, and Google says it doesn’t use the file in Search. The risk is keeping it out of date. A file linking to removed pages or wrong details gives any tool that reads it an inaccurate summary of your business.

Will llms.txt help my business appear in ChatGPT?

OpenAI’s crawler documentation doesn’t describe llms.txt as a way to appear in ChatGPT. What it does document is OAI-SearchBot: sites that block it in robots.txt won’t be shown in ChatGPT search answers. Checking that access matters far more than adding an llms.txt file.

More on AI search:

If you’re not sure whether your site is ready for AI search, get in touch or ask for a free assessment.

Sources

  1. AI optimization guide, Google Search Central, accessed 15 September 2026. Supports: Google Search doesn’t use llms.txt, it’s fine to keep one for other services, useful non-commodity content as the main factor, structured data not required.
  2. Latest Google Search documentation updates, Google Search Central, accessed 15 September 2026. Supports: the 15 June 2026 clarification on llms.txt.
  3. AI features and your website, Google Search Central, accessed 15 September 2026. Supports: no additional requirements for AI Overviews and AI Mode, indexing and snippet eligibility.
  4. The /llms.txt file proposal, Jeremy Howard, published 3 September 2024, modified 10 August 2026, accessed 15 September 2026. Supports: what llms.txt is, and the author’s statements on adoption.
  5. Overview of OpenAI crawlers, OpenAI, accessed 15 September 2026. Supports: OAI-SearchBot opt-out removes sites from ChatGPT search answers.
  6. Perplexity crawlers, Perplexity, accessed 15 September 2026. Supports: allowing PerplexityBot to appear in Perplexity search results.
  7. Live Google search for “best garage door threshold seal”, google.co.uk, 15 September 2026. Supports: GaraDry named first in the AI Overview.

Get started

Proof, not promises.

Tell me what's going on and I'll come back with what I'd do first. No obligation, and no report you need a translator for.

Over 925,000 impressions and 13,795 clicks in a year, from people asking one awkward question: what size do I need?condoms.uk, past 12 months

Brands and sites I have worked on

Brands worked on across nearly twenty years, in agency roles and directly.