What is llms.txt and Why Does It Matter?
llms.txt is a plain text file you add to your website that tells AI language models - ChatGPT, Claude, Perplexity and others - exactly what your site is about and which content is most important. Right now, 92% of websites do not have one. Here is why that matters.
The problem llms.txt solves
When an AI language model crawls your website, it faces a challenge. Your website was designed for humans - with visual design, navigation, images and layout that help people find what they need. An AI model reading your HTML has to figure out what is important, what is marketing fluff, what is navigation boilerplate, and what is the core content it should actually process.
llms.txt solves this by giving AI models a clean, structured summary: who you are, what you do, what your most important pages are, and how to understand your content. It is the AI equivalent of a sitemap combined with a brand brief.
What does an llms.txt file look like?
The format is simple Markdown. Here is an example for a hypothetical digital agency:
# Acme Digital Agency
> We help B2B SaaS companies grow through SEO, paid search and content marketing.
## About
Acme Digital Agency is a full-service digital marketing agency founded in 2018.
We work with Series A to Series C SaaS companies across the UK and US.
Our team of 24 specialists covers SEO, PPC, content, analytics and CRO.
## Key pages
- [Services](https://acmedigital.com/services/): Our core service offerings
- [Case Studies](https://acmedigital.com/case-studies/): Client results and outcomes
- [Blog](https://acmedigital.com/blog/): Guides and industry insights
- [About](https://acmedigital.com/about/): Team and company background
## Key topics
SEO strategy, B2B lead generation, SaaS marketing, content marketing, conversion rate optimisation.
## Contact
[email protected] | London, UKllms.txt vs robots.txt: what is the difference?
| File | Purpose | Audience |
|---|---|---|
robots.txt | Controls which bots can crawl which pages | All web crawlers |
llms.txt | Provides structured context about site content and purpose | AI language models specifically |
sitemap.xml | Lists all pages for crawling and indexing | Search engine crawlers |
You need all three. They serve different purposes and are not substitutes for each other.
llms-full.txt: the extended version
Alongside llms.txt, many websites also publish an llms-full.txt file containing the complete text of their most important pages. This makes it trivial for AI models to ingest your core content without crawling your entire site - effectively delivering your best content directly to AI systems.
If you have key pages - a detailed about page, your flagship guide, your most important service description - consider including their full text in llms-full.txt.
Quick stat: Our analysis of 12,000 websites found that 92% have no llms.txt file at all. This is one of the highest-impact, lowest-effort GEO improvements available right now - because the competition floor is so low.
How to create and deploy your llms.txt
- Create a plain text file named
llms.txt - Write a one-line description of your website after a
>character - Add an About section describing what you do and who you serve
- List your 5 to 10 most important pages with their URLs and one-line descriptions
- Add a Key Topics section naming the subjects your site covers
- Upload the file to the root directory of your website (so it is accessible at
yoursite.com/llms.txt)
The whole process takes under 30 minutes for most websites. It is one of the simplest GEO improvements available.
Check your AI search visibility
Free audit. Instant results. No sign-up required.
Get My Free GEO Score →