Skip to content
SERPCompass

An llms.txt file that is missing or does not follow the format

llms.txt is an optional Markdown file at your site's root, /llms.txt, proposed at llmstxt.org, that gives AI tools a short map of your site. Start it with one H1 title, then a one-line summary and sections of links to your most useful pages. Google says Search ignores it, so it does not affect rankings, and OpenAI's and Anthropic's crawler pages do not say they read it.

Last updated 29 October 2026, when every step was checked against the vendor's documentation.

Why it matters

llms.txt is a proposal, first published by Jeremy Howard in September 2024, for a Markdown file that helps AI tools use a website: the site's name as an H1, a short summary, and lists of links to the pages worth reading. It is meant mainly for the moment a tool answers a question, rather than for training. It allows and blocks nothing; rules for crawlers belong in robots.txt.

Google's guide to its generative AI features in Search says you do not need llms.txt or other AI text files to appear in Google Search, including AI Overviews and AI Mode, because Search does not use them, and that creating one neither helps nor harms your visibility or rankings there. It adds that keeping one for other services that use it is fine.

On 29 October 2026, OpenAI's and Anthropic's pages about their crawlers explained how robots.txt rules apply to them, and neither said their crawlers read llms.txt; we found no Bing documentation that mentions it either. llmstxt.org notes that OpenAI, Anthropic and Google publish llms.txt files for their own developer documentation, which is publishing one, not reading yours.

Chrome's Lighthouse does look for it, in an experimental Agentic Browsing category that needs Chrome 150 or later. Its llms.txt audit treats a missing file as not applicable, because providing one is optional for now, and fails when /llms.txt answers a server error. That is a Chrome developer tool, not Google Search.

So SERPCompass rates a missing llms.txt as a notice, the lowest level, never a warning. It also flags, as a notice, a file that breaks the format's one rule, an H1 title first and only one, and a /llms.txt that answers an empty file or an HTML page, often a 'page not found' page sent with status 200. A missing summary, link list or H2 sections are recommendations the free checker lists, not findings.

The audit findings this guide fixes: No llms.txt file; llms.txt does not follow the format.

Find every page with this problem

Run the free scan on your domain: it requests /llms.txt at your site's root and reports a missing file, or one that breaks the format, with your other findings. The free llms.txt checker reads the file on its own, lists its errors and the recommended parts it lacks, shows its outline, and builds a starter file from your home page's site name, title and description. To check by hand, open /llms.txt in a browser: it should show plain text whose first line is # followed by your site's name, not a web page.

Scan my site free Use the free checker

How to fix it on your platform

llms-full.txt and the Markdown copies of pages the proposal also describes are not covered here; robots.txt rules for AI crawlers have their own guide.

Yoast SEO

  1. In the WordPress menu, go to Yoast SEO > Settings > Site features.
  2. Under AI tools, open LLMS.txt, switch the toggle on and click Save changes.
  3. To choose the pages yourself, click Customize llms.txt file, choose Manual page selection, pick the pages and click Save changes.
  4. The feature is not available on multisite. If Yoast says your llms.txt file couldn't be auto-generated, check the web server's filesystem permissions.

Source: How to enable llms.txt with Yoast SEO (Yoast).

Rank Math

  1. Go to Rank Math SEO > Dashboard, scroll to the LLMS Txt module and turn it on. If it is not there, update Rank Math.
  2. Open its settings with the Settings icon on the module, or Rank Math SEO > General Settings > Edit llms.txt.
  3. Choose post types under Select Post Types and taxonomies under Select Taxonomies. Posts/Terms Limit caps the list at 100 items by default, and Additional Content adds your own links or text, one per line. The file stays empty until you configure it.
  4. Click Save Changes, then the preview link at the top of the tab. Posts set to noindex are left out of the file.

Source: How to use llms.txt in Rank Math SEO (Rank Math).

Shopify

  1. Shopify already answers /llms.txt: by default it serves the same content as your store's /agents.md, which Shopify generates.
  2. To write your own, go to Online Store > Themes in your Shopify admin, click the theme's ... button and choose Edit code.
  3. Right-click the Templates folder, choose New File and name it llms.txt.liquid. It controls /llms.txt only; an agents.md.liquid template would change /agents.md and, by default, /llms.txt and /llms-full.txt too.
  4. Write the file in Markdown, starting with # and your store's name, and save it.

Sources: Customize /llms.txt, /llms-full.txt and /agents.md (Shopify developer changelog); agents.md.liquid template (Shopify developer documentation).

Wix

  1. Wix generates and maintains an llms.txt for sites that are upgraded, connected to a custom domain and open to search engine indexing.
  2. Go to SEO & GEO in your site's dashboard, scroll to Tools and settings and click Go to llms.txt. View File shows it.
  3. To edit it, click More Actions > Edit file, click Continue, change the text and click Save Changes. Editing stops Wix's automatic updates; Reset to Default turns them back on.
  4. The toggle next to Use your llms.txt file hides the file.

Source: Understanding your site's llms.txt file (Wix Help Center).

Squarespace

  1. On a version 7.1 site, open the SEO/AI Visibility panel, click SEO Settings, then the LLMS.txt tab.
  2. Type or paste your file into the text field and click Save. The file is off until it has text.
  3. To remove it, click Delete in the same tab, then Save.
  4. Squarespace gives no formatting advice, because the format is still a proposal: follow llmstxt.org, as in the examples below.

Source: Create an llms.txt file (Squarespace Help Center).

Plain HTML

  1. Write a plain text file named llms.txt.
  2. Make the first line # followed by your site's or business's name. It is the only part the format requires, and there may be only one H1.
  3. Under it, add a one-line summary starting with >, a short paragraph of facts a tool should get right if you like, then ## sections listing links as - [Page name](https://www.example.com/page/): what the reader finds there.
  4. Put links a tool can skip in a last section titled ## Optional.
  5. Upload the file to the folder that serves your home page, so it answers at https://www.example.com/llms.txt, and check that it shows as plain text.

Source: The /llms.txt file (llmstxt.org).

Examples

  • Good 
    # Corner Plumbing

> Emergency and planned plumbing in Coimbatore: leaks, blocked drains, water heaters and bathroom fittings.

We work across Coimbatore district, 24 hours a day. We do not fit gas lines.

## Services

- [Emergency plumber](https://www.example.com/emergency/): call-outs, response times and prices
- [Drain cleaning](https://www.example.com/services/drains/): blocked drains and sewer lines

## Optional

- [About us](https://www.example.com/about/): the team and our licences

    One H1 first, a summary, the facts a tool should get right, and links with a note on each.

  • Bad 
    Corner Plumbing - plumbing services in Coimbatore
https://www.example.com/services/
https://www.example.com/contact/

    No H1 title, the one line the format requires, and bare addresses that say nothing about each page.

  • Bad 
    # Corner Plumbing

> Plumbing in Coimbatore.

# Services

- [Drain cleaning](https://www.example.com/services/drains/)

    Two H1 titles. Only one is allowed: make the sections ##.

  • Bad 
    HTTP/1.1 200 OK
Content-Type: text/html

<!doctype html><html><head><title>Page not found</title>

    A missing file answered with a web page and status 200. SERPCompass reports it as a file that does not follow the format: answer 404 or publish a real file.

Common mistakes

  • Expecting better Google rankings or a place in AI Overviews: Google says Search ignores llms.txt.
  • Using llms.txt to keep AI crawlers out or let them in. It allows and blocks nothing; those rules belong in robots.txt.
  • Putting anything before the H1, such as a comment or a date, or using one H1 per section.
  • Letting a missing /llms.txt answer 200 with your home page or a 'page not found' page instead of 404.
  • Listing bare addresses instead of Markdown links: write each one as - [Name](URL): notes.
  • Editing Wix's generated file and then forgetting it: Wix stops updating an edited file, so pages you add later are missing until you edit it again or reset it.

Questions and answers

Does llms.txt help my Google rankings?

No. Google's guide to its generative AI features says you do not need llms.txt or other AI text files to appear in Google Search, including AI Overviews and AI Mode, because Search does not use them, and that creating one neither helps nor harms your visibility or rankings there. It adds that keeping one for other services is fine.

Which search engines and AI assistants read llms.txt?

On 29 October 2026 we found none of the large ones documenting that their crawlers read it. Google says Search ignores it, OpenAI's and Anthropic's crawler pages do not mention reading it, and we found no Bing documentation that does. Chrome's Lighthouse checks for the file in an experimental audit. The proposal itself is aimed at tools that read it while answering a person's question.

Is llms.txt the same as robots.txt or a sitemap?

No. robots.txt tells crawlers what they may fetch, and an XML sitemap lists the pages you want search engines to find. llms.txt is a short, hand-picked reading list in Markdown for AI tools; it allows and blocks nothing, so it cannot keep a crawler out or let one in.

What does the llms.txt format require?

One thing: an H1 title with the name of the site or project, first. The proposal recommends a one-line summary in a blockquote under it, optional paragraphs, then H2 sections that list links as a Markdown link followed by a colon and a note. A section named Optional holds links a tool can skip.

Should I create one anyway?

It does no harm if it takes you a few minutes: Google says it neither helps nor harms you in Search, and Yoast, Rank Math, Shopify, Wix and Squarespace can serve one for you. Treat it as a small extra after robots.txt, a sitemap and pages that answer your customers' questions, not as a ranking fix. SERPCompass rates a missing file as a notice, the lowest level.

Sources

Every step above was checked against these documents on 29 October 2026. Vendors change their menus; if a step no longer matches, the vendor's page is the authority.

Start with a free scan of your site.

Two to five minutes, no account. You get your three most urgent findings, and the exact count of everything else.

Free, 2–5 minutes, no account needed.