Free tool
Can AI bots read your page?
Paste a URL. We read the site's robots.txt live and tell you, bot by bot, who may read that page and who is locked out.
What it reads
robots.txt
the site's own rules, fetched live
Bots checked
25+
GPTBot, ClaudeBot, PerplexityBot, Googlebot and more
Three verdicts
Honest
allowed, blocked, or follows defaults. Never guessed
Cost
Free
no signup, cached for a day
How it works
01
Paste a URL
Any page. Yours, or a competitor's.
02
We read robots.txt
Live from the site, and check every known AI bot against your path.
03
Fix what blocks you
Answer-feeding bots blocked? That removes you from AI answers.
Why it matters
AI bots come in three kinds. Training bots read your site to teach future models. Index bots keep the AI's search fresh. And live-answer bots fetch a page RIGHT NOW because someone asked something. Block that last kind and you are simply not in the answer. This checker shows all three, labeled, so you block on purpose or not at all. Watching who actually visits is the next step. That is what AI crawler analytics does.
Questions people ask
What does this checker do?
You give it a URL. It reads that site's robots.txt file live and answers, for every known AI bot: may this bot read this page? Three honest answers: allowed by name, blocked by name, or no rule names it so it follows the site's defaults.
Why does blocking AI bots matter?
Some AI bots fetch pages to answer a user's question right now. Block those and your site can't be used in the answer, so you disappear from it. Blocking training-only bots is different: that just opts you out of model training.
What does 'follows defaults' mean?
No rule in robots.txt names that bot. It follows whatever the site's general rules say. That is not the same as an explicit allow, which is why we never show it as a green light.
Is this the live robots.txt?
Yes. We fetch it from the site when you ask, and cache the answer for 24 hours. If the site doesn't answer, we say the verdict is unknown instead of guessing.