Self-assessment. Scanner in progress.

How AI-ready
is your website?

Eight questions, two minutes. You get a score and a tier.

01 / 080 of 8 answered

Question 01robots txt

How explicitly does your robots.txt handle AI crawlers (GPTBot, ClaudeBot, PerplexityBot, Google-Extended)?

Your robots.txt is the front door for crawlers. Most sites still treat it as a Google-only signal, but ChatGPT, Claude, Perplexity, and dozens of others now decide whether to fetch you based on whether you’ve explicitly allowed or blocked them. Saying nothing isn’t neutral. It’s read as “unclear”, and unclear is risky.