robots.txt allows Google-Extended
What this is
Whether your robots.txt (the file that tells crawlers which parts of the site they may visit) blocks Google-Extended. It is a setting, not a separate crawler: it controls whether Google may use your content to train Gemini or to ground Gemini's answers.
Why it matters
Google-Extended does not affect your Google Search ranking or whether you are indexed; regular Google Search works the same either way. It only decides use in Gemini and similar AI products, so allowing it is your choice.
What counts as passing
Passes unless robots.txt has a section for Google-Extended with “Disallow: /” (block the whole site); not scored if the site has no robots.txt.
Evidence
| Crawler name | Google-Extended |
|---|---|
| Crawler | Google-Extended |
| Blocked | No |
| Has its own rules | No |
Raw data
Check ID geo.robots.allowsGoogleExtended
{
"bot": "Google-Extended",
"label": "Google-Extended",
"blocked": false,
"matched": false
}Suggestion
Pro plan onlyAllow Google-Extended
robots.txt currently blocks Google-Extended, preventing AI answer engines from indexing the site.
Before / After
User-agent: Google-Extended Disallow: /
User-agent: Google-Extended Disallow: