A robots.txt control token for certain Gemini training and grounding uses; it is not a separate fetching crawler for Google Search.
ID
SS-DF-109
Confidence
High · 95
Evidence
Strong
Updated
2026-09-20
Definition
A robots.txt control token for certain Gemini training and grounding uses; it is not a separate fetching crawler for Google Search.
Google-Extended is a robots.txt product token, not its own HTTP crawler. It controls whether content Google has crawled may be used for training future Gemini models and for grounding in certain Gemini/Vertex experiences. Google states that it does not affect inclusion or ranking in Google Search. AI Overviews and AI Mode in Search use the ordinary Search crawling/indexing system, so blocking Google-Extended does not remove a page from those Search features.