Back to report
robots.txt allows Googlebot
SEOWeight 2.0% (This check's share of the SEO score)Score 100
What this is
Whether the site's robots.txt (the file telling search engines where they may go) blocks Google's crawler from the whole site.
Why it matters
If the whole site is blocked for Google, its pages will struggle to appear in search. This often happens when a "block everything" rule set before launch is never removed.
What counts as passing
Passes when the rules for Google (or, if none, for all crawlers) contain no whole-site block such as "Disallow: /"; fails if they do; not scored when there is no robots.txt.
Evidence
| Crawler rule group used | * |
|---|---|
| Blocked paths | None found |
Raw data
Check ID seo.robots.allowsGooglebot
{
"ua": "*",
"disallows": []
}Suggestion
Pro plan onlyAllow Googlebot
robots.txt blocks the entire site via a Disallow "/" for user-agent *. Remove or scope the rule.