Does theglobeandmail.com block AI crawlers?

As of 2026-11-03, the robots.txt of theglobeandmail.com blocks 15 of 18 AI crawlers, including GPTBot, OAI-SearchBot, ChatGPT-User, ClaudeBot.

15/18AI crawlers blocked

NoChatGPT can read it

NoPerplexity can read it

NoClaude can read it

NoHas an llms.txt file

AI crawler status of theglobeandmail.com

Based on the live robots.txt of theglobeandmail.com, checked on 2026-11-03. “Some paths restricted” means the bot may crawl the site but certain sections are excluded.

User agent	Company	Purpose	Status
`GPTBot`	OpenAI	Model training	Blocked
`OAI-SearchBot`	OpenAI	ChatGPT search index	Blocked
`ChatGPT-User`	OpenAI	Live browsing for ChatGPT users	Blocked
`ClaudeBot`	Anthropic	Model training	Blocked
`Claude-SearchBot`	Anthropic	Claude search index	Blocked
`Claude-User`	Anthropic	Live browsing for Claude users	Blocked
`PerplexityBot`	Perplexity	Perplexity search index	Blocked
`Perplexity-User`	Perplexity	Live browsing for Perplexity users	Blocked
`Google-Extended`	Google	Gemini training & grounding	Blocked
`Googlebot`	Google	Search and AI Overviews	Allowed (some paths restricted)
`Bingbot`	Microsoft	Bing search and Microsoft Copilot	Allowed (some paths restricted)
`Applebot-Extended`	Apple	Apple Intelligence training	Allowed (some paths restricted)
`Meta-ExternalAgent`	Meta	Meta AI training	Blocked
`Amazonbot`	Amazon	Alexa and Amazon AI	Blocked
`DuckAssistBot`	DuckDuckGo	DuckAssist answers	Blocked
`MistralAI-User`	Mistral	Live browsing for Le Chat users	Blocked
`CCBot`	Common Crawl	Open dataset used by many AI models	Blocked
`Bytespider`	ByteDance	Model training	Blocked

What this means

theglobeandmail.com blocks both training and AI search crawlers. Its pages are unlikely to be read live by ChatGPT or Perplexity, so AI answers about its content usually rely on older training data or third-party sources instead of linking to theglobeandmail.com.

Among the 381 news & media sites in our AI crawler report, 59% block GPTBot completely. theglobeandmail.com is one of them.

Blocking AI bots is one side. The other: is AI actually sending you visitors? Citelytic shows how much traffic ChatGPT, Perplexity, Gemini and Copilot send to your own site.

Start free – no credit card

Check your own website

Want to see this table for your own domain? The free AI crawler checker reads your robots.txt and shows which AI assistants can access your site. For a full 0-100 rating with fixes, get your AI visibility score. No signup needed.

FAQ

Does theglobeandmail.com block ChatGPT?

Yes. As of 2026-11-03, OAI-SearchBot is blocked and ChatGPT-User is blocked in the robots.txt of theglobeandmail.com. GPTBot (OpenAI's training crawler) is blocked.

Can Perplexity access theglobeandmail.com?

PerplexityBot is blocked and Perplexity-User is blocked on theglobeandmail.com according to its robots.txt checked on 2026-11-03.

Does theglobeandmail.com have an llms.txt file?

No, we did not find an llms.txt file on theglobeandmail.com when we checked on 2026-11-03.

How is this data collected?

We fetch the public robots.txt file of each site and evaluate the rules for 18 AI user agents for the site root. robots.txt is a request, not a technical barrier, and sites may also block bots at the firewall level, which this check does not see.