Technical SEO for AI search: what Google and John Mueller say (November 2026)
Short answer: Technical SEO for AI search is still technical SEO. Google Search Central says there are “no additional requirements” to appear in AI Overviews or AI Mode, and no llms.txt file or special schema is needed (Google Search Central). John Mueller, Search Advocate at Google, adds one nuance: AI crawlers have different intents, which he calls “another flavor of technical SEO”.
This is the November 2026 follow-up to our May piece on Google’s first guide to AI Overviews and AI Mode.
The short version
- Technical SEO stays central. Mueller expects technical SEO to “remain very relevant” (interview video, 29 Oct 2026).
- AI crawlers want different things. Some crawl for training, others for fresh content, according to Mueller and OpenAI’s own documentation.
- llms.txt isn’t needed for Google. Google says you don’t need “AI text files” or special markup. llms.txt is optional.
- AI Mode has the same technical bar. A page must be indexed and eligible to show with a snippet.
- Indexed is not recommended. Ranking in Google doesn’t guarantee an AI assistant will name you, so measure the two separately.
What does Google say about technical SEO for AI search?
Google says the same technical SEO applies. “The best practices for SEO remain relevant for AI features in Google Search,” according to Google Search Central’s AI features and your website.
To be a supporting link, a page must be indexed and eligible to appear with a snippet. Google also asks that crawling is allowed in robots.txt “and by any CDN or hosting infrastructure”.
“There are no additional requirements to appear in AI Overviews or AI Mode.” Google Search Central
In 2024, Liz Reid, then Google’s VP of Search, wrote that the AI Overviews model “is integrated with our core web ranking systems” (Google blog, 30 May 2024).
What did John Mueller say about technical SEO and AI?
He said AI builds on SEO, and that technical SEO matters most. In an interview with David Iwanow at Search Central Deep Dive Europe 2026, asked whether AI, GEO and SEO were dead, Mueller replied: “I think you’ll see that a lot of the AI systems they build on SEO” (video, from about 10:20).
He went on to say that technical SEO in particular is going to “remain very relevant”. Search Engine Journal covered the interview on 2 November.
“That just is like another flavor of technical SEO.” John Mueller, Search Advocate at Google, on how AI systems crawl
What do AI Overviews, AI Mode, GEO, AEO and query fan-out mean?
These are the terms that come up most, defined in one line each.
- AI Overviews: Google’s AI-generated summaries shown at the top of some search results, with supporting links to web pages.
- AI Mode: Google’s conversational AI search experience, which answers follow-up questions and links to supporting pages.
- Query fan-out: a technique Google says both features may use, “issuing multiple related searches across subtopics and data sources” (Google Search Central).
- GEO (generative engine optimisation): the practice of improving how often AI systems such as ChatGPT or Google’s AI features cite and recommend a website.
- AEO (answer engine optimisation): a near-synonym for GEO that focuses on getting content used as the direct answer to a question.
Do AI crawlers work differently from Googlebot?
Yes, some do. Mueller said AI systems “have different intents with regards to crawling because they want to do it for training versus just like getting the freshest content” (video, about 10:36).
OpenAI documents that split in its own crawlers (OpenAI bots documentation):
| Agent | Purpose, in OpenAI’s words |
|---|---|
| GPTBot | Crawls content that “may be used in training” OpenAI’s models |
| OAI-SearchBot | “Used to surface websites in search results in ChatGPT’s search features” |
| ChatGPT-User | Fetches pages when a user asks; “not used for crawling the web in an automatic fashion” |
Google doesn’t run a separate AI crawler. Google-Extended is a robots.txt token that controls use of your content for Gemini training and for grounding in some Gemini products. Google says it “does not impact a site’s inclusion in Google Search nor is it used as a ranking signal” (Google crawler documentation).
Blocking a training crawler and blocking a search crawler are different decisions. Our guide to AI bot permissions in robots.txt covers the setup.
Does Google use llms.txt?
No, Google doesn’t need it. Google Search Central says: “You don’t need to create new machine readable files, AI text files, or markup to appear in these features.” It adds that there is “no special schema.org structured data that you need to add.”
An llms.txt file is optional. It’s cheap and harmless, but it isn’t a ranking lever for Google. Our guide to what llms.txt is explains where it can still be useful.
“There’s also no special schema.org structured data that you need to add.” Google Search Central
Structured data still has a job. Google asks that it matches the visible text on the page.
Does Google AI Mode need different technical SEO?
No. Google Search Central covers AI Overviews and AI Mode with the same requirements. A page must be indexed and eligible to show with a snippet.
What differs is how pages are found. Google says both features may use query fan-out, which shows “a wider and more diverse set of helpful links” than a classic search. A page that answers one sub-question well can surface even if it doesn’t rank for the head term.
If you want the step-by-step version for Google’s AI answers, see how to appear in Google AI Overviews.
Does JavaScript rendering still matter for AI search?
Yes. Google can render JavaScript, but its own guide says server-side or pre-rendering “is still a great idea because it makes your website faster for users and crawlers” (JavaScript SEO basics).
“Not all bots can run JavaScript.” Google Search Central
If your main content only appears after client-side rendering, test what a crawler actually receives.
Which technical SEO claims about AI search are myths?
Several popular claims overstate or contradict what Google has said. Here’s how they compare.
| Claim | What Google says | Verdict |
|---|---|---|
| “Google has declared listicles spam.” | Mueller: “I wouldn’t necessarily say it’s like anything that has a listicle is spam.” It “needs to add value” | False |
| “GEO is dead.” | Mueller: AI systems “build on SEO” | Unsupported |
| “Ranking well guarantees AI recommendations.” | Fan-out shows “a wider and more diverse set of helpful links” than classic search | False |
| “Adding llms.txt improves AI rankings.” | No “AI text files” needed for AI features | Not established |
| “Schema markup guarantees AI citations.” | “No special schema.org structured data” needed | False |
| “All AI engines use Google’s ranking signals.” | OpenAI runs its own search crawler, OAI-SearchBot | False |
| “More third-party mentions always mean more AI recommendations.” | No Google statement either way | Unsupported as a rule |
| “AI search needs an entirely new technical discipline.” | Mueller: “another flavor of technical SEO” | Overstated |
How GEO and SEO differ beyond the technical layer is covered in our GEO vs SEO guide.
Do technical shortcuts for AI search still work?
Some may work briefly, but Mueller expects them to stop. “People always find some trick and then they write about it,” he said, and “at some point the systems catch up” (video, about 2:04 and 3:43).
On a strategy built only on listicles, he said “at some point that’s going to switch off and you’re left with nothing.”
Many tactics sold as AI optimisation already appear in Google’s spam policies. Cloaking is there. So are excessive link exchanges and low-quality directory links. Mass-producing pages to manipulate rankings has its own entry, “scaled content abuse”.
Building up “a serious stable foundation” for a website is “the most critical part.” John Mueller, Search Advocate at Google
What should a technical SEO checklist for AI search include?
Start with access and indexing, then content, then measurement.
1. Crawl access
Confirm Googlebot isn’t blocked by robots.txt, your CDN or your host. Then decide on AI crawlers one at a time.
2. Indexing and snippets
Check key pages are indexed in Search Console. Don’t set nosnippet or a tight max-snippet on pages you want cited.
3. JavaScript rendering
Make sure core content is in the HTML a crawler receives, using server-side or pre-rendering where you can.
4. Original content
Google asks whether content provides “original information, reporting, research, or analysis” and shows “first-hand expertise” (helpful content guidance).
5. Entity clarity
Say plainly who you are and what you do, including where you operate. Keep structured data matched to the visible text.
6. Third-party credibility
Earn genuine mentions and reviews. Treat it as reputation work, not a numbers game.
7. Separate AI measurement
Search Console reports AI feature traffic inside the Performance report. It won’t tell you whether ChatGPT or Perplexity recommend you.
For the full list, see the technical GEO checklist.
If my site is technically sound, will AI recommend it?
Not necessarily. Good technical SEO makes a page eligible, but it doesn’t make it the answer.
A site can be technically sound and rank well, yet rarely appear when AI assistants answer questions in its category. Only 216 of over a million sites we’ve analysed are AI-Ready, about 1 in 4,600.
Technical SEO makes a business discoverable. AI visibility measurement shows whether AI systems actually mention or recommend it. SearchScore
A strong SEO score with weak AI visibility is a useful diagnostic. That’s why the free SearchScore check reports AI, SEO and conversion scores separately. You can also check whether ChatGPT can find your website.
Sources
- Google Search Central, “AI features and your website”: https://developers.google.com/search/docs/appearance/ai-features
- Google Search Central, Google’s common crawlers (Google-Extended): https://developers.google.com/search/docs/crawling-indexing/google-common-crawlers
- Google Search Central, JavaScript SEO basics: https://developers.google.com/search/docs/crawling-indexing/javascript/javascript-seo-basics
- Google Search Central, Creating helpful, reliable, people-first content: https://developers.google.com/search/docs/fundamentals/creating-helpful-content
- Google Search Central, Spam policies for Google web search: https://developers.google.com/search/docs/essentials/spam-policies
- Liz Reid, Google blog, “AI Overviews: About last week”, 30 May 2024: https://blog.google/products/search/ai-overviews-update-may-2024/
- OpenAI, Overview of OpenAI crawlers: https://developers.openai.com/api/docs/bots
- John Mueller interviewed by David Iwanow, Search Central Deep Dive Europe 2026 (video, 29 Oct 2026): https://www.youtube.com/watch?v=-ZA5SNV4NjU
- Roger Montti, Search Engine Journal, “Google Says Technical SEO Remains Key For AI SEO”, 2 Nov 2026: https://www.searchenginejournal.com/google-says-technical-seo-remains-key-for-ai-seo/595550/
Frequently asked questions
What is technical SEO for AI search?
It's the same technical SEO that gets pages crawled and indexed, applied with AI crawlers in mind. Google says there are no additional requirements for AI Overviews or AI Mode. John Mueller, Search Advocate at Google, says AI crawlers have different intents, such as training or fetching fresh content, which he calls "another flavor of technical SEO".
Does Google use llms.txt?
Google says you don't need AI text files, machine-readable files or special markup to appear in its AI features. An llms.txt file is optional and harmless, and some AI tools and agents may read it. It isn't a ranking lever for Google, so treat it as a low-cost extra rather than a priority.
Does Google AI Mode need different technical SEO from normal search?
No. Google Search Central applies the same requirements to AI Mode and AI Overviews. The page must be indexed and eligible to show with a snippet, with crawling allowed. AI Mode may use query fan-out, running related searches across subtopics, so pages that answer specific sub-questions well can be surfaced as supporting links.
Should I block AI crawlers in robots.txt?
It depends which crawler. OpenAI says GPTBot gathers content that may be used for model training, while OAI-SearchBot surfaces sites in ChatGPT search. Blocking one doesn't block the other. Google says blocking Google-Extended doesn't affect inclusion or ranking in Google Search, only Gemini training and some grounding uses.
Does JavaScript affect whether AI search can read my site?
It can. Google renders JavaScript, but its own guidance says server-side or pre-rendering is still a great idea, and that not all bots can run JavaScript. If your main content only appears after client-side rendering, some crawlers may miss it. Test what a crawler receives before assuming it sees your page.