Skip to main content
Back to report

robots.txt allows Googlebot

SEOWeight 2.0% (This check's share of the SEO score)Score 100

What this is

Whether the site's robots.txt (the file telling search engines where they may go) blocks Google's crawler from the whole site.

Why it matters

If the whole site is blocked for Google, its pages will struggle to appear in search. This often happens when a "block everything" rule set before launch is never removed.

What counts as passing

Passes when the rules for Google (or, if none, for all crawlers) contain no whole-site block such as "Disallow: /"; fails if they do; not scored when there is no robots.txt.

Evidence

Crawler rule group used*
Blocked pathsNone found
Raw data

Check ID seo.robots.allowsGooglebot

{
  "ua": "*",
  "disallows": []
}

Suggestion

Pro plan only

Allow Googlebot

robots.txt blocks the entire site via a Disallow "/" for user-agent *. Remove or scope the rule.