What is the "Robots blocks crawlers" check?

P0 · CriticalSEO

Robots blocks crawlers

robots.txt blocks all search engines

Code: robots_blocks_all

Why it matters

robots.txt blocks all search engines. Search engines use this signal when crawling and ranking pages. Getting it wrong can suppress visibility in results or lead to missed indexing opportunities.

Related checks in SEO

Missing page title

Page has no <title> tag

Title too short

Title is under 30 characters

Title too long

Title exceeds 60 characters

Missing meta description

No meta description found

Meta description too short

Description under 70 characters

Run a free scan to check your site

Get a complete audit in under 2 minutes. No account required.

Start Free Scan