Short answer
llms.txt is a text file placed at the root of a website that tells AI systems in Markdown what the site is and which pages matter. Jeremy Howard proposed it in September 2024. No standards body has adopted it, and Google says it has no effect on search rankings and is not needed to appear in generative AI search. It still gives agents and developer tools a cheap, readable summary of your site.
Key points
- The file lives at /llms.txt: a title, a short summary and annotated link lists.
- In June 2026 Google wrote that keeping the file is fine, though it is not needed to appear in Search.
- llms.txt sets no access rules: which crawler may read what is decided in robots.txt.
- Everything in the file must match the site. A conflicting price or service undermines trust.
Contents
What is llms.txt for?
The llms.txt proposal was published by Jeremy Howard of Answer.AI at llmstxt.org in September 2024. The reasoning is simple: when language models read a site they have to dig the real information out of HTML full of menus, cookie banners and scripts, and their context window is limited. A short Markdown file at the root gives them a clean entry point that introduces the site and points to the most important pages.
The file spread mainly among documentation sites and software projects. On a company website it works as a summary that helps agents and assistants describe the business correctly: what you do, for whom, where, and which page holds what.
What does the format look like?
The proposed structure is Markdown in a set order:
- H1 title: the name of the site or company. This is the only required element.
- Blockquote: a summary of one or two sentences. Systems recognise the site from this line.
- Free paragraphs: context such as who you serve and how you work.
- H2 sections: each with a list of links made of the page name, its address and a one-line description.
- Optional section: secondary links that can be skipped.
# Example Engineering Ltd
> Manufacturer of industrial packaging machines in Leicester.
> Sales, installation and spare parts across the UK and Europe.
Founded in 1998. We build filling and packaging lines for food and chemical producers.
## Products
- [Filling machines](https://example.co.uk/filling): for liquids and powders
- [Packaging lines](https://example.co.uk/packaging): complete line installation
## Company
- [About](https://example.co.uk/about): factory, team, certificates
- [Contact](https://example.co.uk/contact): address, phone, quote form
## Optional
- [Press](https://example.co.uk/press)Some sites also publish an llms-full.txt that collects the full text of their pages in one file. This is another habit that follows the proposal, and it is optional.
Which systems read llms.txt?
Honesty matters here. None of the major search engines has said it uses llms.txt for ranking or for choosing sources. Google's May 2026 guide on generative AI says AI-specific text files are not needed to appear in those features. On 15 June 2026 Google added a note: keeping an llms.txt for other services or systems is completely fine, but it is not needed to appear in Search.
The ones that actually use the file are agents and developer tools asked to read a given address. When an assistant is told to look into a company, an llms.txt gives it a short, clean source. This site's own llms.txt is there for the same reason.
How do you write an llms.txt?
Choose the priority pages
Services, products, about and contact. Do not list every page, pick what a visitor or assistant should read first.
Write a one-paragraph summary
Say who you are, what you do and whom you serve, where, in plain sentences. Advertising language is no use to an assistant.
Group the links into sections
Add a one-line description next to each link. Use absolute URLs.
Match the site
Service names, the address and any prices must be the same as on the site. Conflicts lead assistants to describe the company wrongly.
Put it at the root
Serve the file as plain text at /llms.txt on the root of your domain.
Keep it current
When a service is added, a page is removed or the address changes, update the file as well.
How is it different from robots.txt and the sitemap?
| File | Purpose | Who reads it | Effect |
|---|---|---|---|
| robots.txt | Which crawler may crawl what | All crawlers | Sets access rules |
| sitemap.xml | Full list of pages and update dates | Search engines | Speeds up discovery |
| llms.txt | Summary of the site and priority pages | Agents, developer tools | Informs, sets no rules |
llms.txt does not get around a block in robots.txt. If AI crawlers are blocked there, they cannot reach the pages even if they read the file. Fix access first, then the summary. We explain why in our guide to SEO, GEO and AEO.
How do you check your file?
Open yourdomain.co.uk/llms.txt in a browser: it should show as plain text, special characters should be intact and the links should work. Our free AI visibility check reads llms.txt together with your robots.txt rules, the page text without JavaScript, the schema.org record and the sitemap.
Frequently asked questions
Does llms.txt help SEO?
According to Google it has no effect on search rankings. Its value is in giving agents and assistants asked to read your site an orderly summary.
What is llms-full.txt?
A habit used by some documentation sites: the full text of the important pages collected in a single Markdown file. For a company website, llms.txt is usually enough.
Should I put prices in the file?
The file should say what the site says. If you do not publish prices on the site, leave them out of llms.txt too and explain how prices are set.
How do I add it on WordPress or Shopify?
If you can upload a file to the root of your server, that is the simplest way. If you cannot, platform plugins or redirect settings can do it. Either way, the result should be plain text at /llms.txt.
Sources
- The /llms.txt filellmstxt.org (Jeremy Howard, Answer.AI) · 3 September 2024
- A new resource for optimizing for generative AI in Google SearchGoogle Search Central Blog · 15 May 2026
- Google's Updated Guidance Now Says It's Fine To Use LLMs.txt For AI SEOSearch Engine Journal
- Google: LLMs.txt Files Won't Help Or Hurt Your Search RankingsSearch Engine Roundtable
Ask your assistant
Open the article in an AI assistant to apply it to your own situation.
About this article
Entrida Technology & Consulting builds AI, automation and software for SMEs from Istanbul. The facts in this article rest on the sources listed at the end. If you spot an error, write to info@entrida.com.tr and we will correct it and move the updated date forward.
This article in other languages