Google · Training-control token

Google-Extended

Google-Extended is a robots.txt control token, not a crawler with its own user agent. It lets you opt your already-crawled content out of being used to train Google's Gemini models and to ground generative answers, without changing how Googlebot crawls or ranks you in Search. Disallowing Google-Extended is the supported way to keep your content out of Gemini training while staying fully in Google Search.

Last updated July 2026

User-agent token: Google-Extended
Operator: Google
Feeds: Gemini training & grounding
robots.txt: Unverified

It is a robots.txt control token, not a separate crawler — it has no user agent of its own.

How to control Google-Extended in robots.txt

Edit the robots.txt file at the root of your domain (for example https://example.com/robots.txt), add one of the groups below, then save and re-deploy.

Allow (default — used for training/grounding)

# Welcome Google-Extended, but keep private areas blocked.
# A named user-agent group overrides "User-agent: *", so repeat
# your own private Disallow rules inside this group.
User-agent: Google-Extended
Allow: /
Disallow: /admin/
Disallow: /account/
Disallow: /cart/
Disallow: /checkout/

# Welcome Google-Extended, but keep private areas blocked.
# A named user-agent group overrides "User-agent: *", so repeat
# your own private Disallow rules inside this group.
User-agent: Google-Extended
Allow: /
Disallow: /admin/
Disallow: /account/
Disallow: /cart/
Disallow: /checkout/

Opt out of Google-Extended

# Opt out of Google-Extended (a robots.txt control token, not a crawler).
User-agent: Google-Extended
Disallow: /

# Opt out of Google-Extended (a robots.txt control token, not a crawler).
User-agent: Google-Extended
Disallow: /

FAQ

Does blocking Google-Extended hurt my Search rankings?

No. Google-Extended only governs generative-AI training and grounding. Googlebot still crawls and ranks your pages in Search exactly as before.

Why does Google-Extended have no IP range or user agent?

Because it is a policy token, not a bot. You add it to robots.txt to signal consent; the actual crawling is still done by Googlebot.

Is your site visible to AI crawlers?

Run a free AI-visibility audit to see which AI crawlers can reach your content and how often you get cited by ChatGPT, Perplexity, Claude, and Google AI Overviews.

Run a free audit

Part of the Cite Hustle AI crawler directory. For the full framework on AI search visibility, read the GEO methodology.