Does planetscale.com block AI crawlers?
As of 2026-11-03, planetscale.com does not block any of the 18 AI crawlers we check. ChatGPT, Claude, Perplexity and Gemini can all read its public pages.
AI crawler status of planetscale.com
Based on the live robots.txt of planetscale.com, checked on 2026-11-03. “Some paths restricted” means the bot may crawl the site but certain sections are excluded.
| User agent | Company | Purpose | Status |
|---|---|---|---|
GPTBot | OpenAI | Model training | Allowed |
OAI-SearchBot | OpenAI | ChatGPT search index | Allowed |
ChatGPT-User | OpenAI | Live browsing for ChatGPT users | Allowed |
ClaudeBot | Anthropic | Model training | Allowed |
Claude-SearchBot | Anthropic | Claude search index | Allowed |
Claude-User | Anthropic | Live browsing for Claude users | Allowed |
PerplexityBot | Perplexity | Perplexity search index | Allowed |
Perplexity-User | Perplexity | Live browsing for Perplexity users | Allowed |
Google-Extended | Gemini training & grounding | Allowed | |
Googlebot | Search and AI Overviews | Allowed | |
Bingbot | Microsoft | Bing search and Microsoft Copilot | Allowed |
Applebot-Extended | Apple | Apple Intelligence training | Allowed |
Meta-ExternalAgent | Meta | Meta AI training | Allowed |
Amazonbot | Amazon | Alexa and Amazon AI | Allowed |
DuckAssistBot | DuckDuckGo | DuckAssist answers | Allowed |
MistralAI-User | Mistral | Live browsing for Le Chat users | Allowed |
CCBot | Common Crawl | Open dataset used by many AI models | Allowed |
Bytespider | ByteDance | Model training | Allowed |
What this means
planetscale.com is fully open to AI crawlers. Its content can be used for training and can be read, cited and linked by AI assistants in real time.
Among the 335 saas & software sites in our AI crawler report, 3% block GPTBot completely. planetscale.com is not one of them.
Blocking AI bots is one side. The other: is AI actually sending you visitors? Citelytic shows how much traffic ChatGPT, Perplexity, Gemini and Copilot send to your own site.
Start free – no credit cardCheck your own website
Want to see this table for your own domain? The free AI crawler checker reads your robots.txt and shows which AI assistants can access your site. For a full 0-100 rating with fixes, get your AI visibility score. No signup needed.
FAQ
Does planetscale.com block ChatGPT?
No. As of 2026-11-03, OAI-SearchBot is allowed and ChatGPT-User is allowed in the robots.txt of planetscale.com. GPTBot (OpenAI's training crawler) is allowed.
Can Perplexity access planetscale.com?
PerplexityBot is allowed and Perplexity-User is allowed on planetscale.com according to its robots.txt checked on 2026-11-03.
Does planetscale.com have an llms.txt file?
Yes, planetscale.com publishes an llms.txt file.
How is this data collected?
We fetch the public robots.txt file of each site and evaluate the rules for 18 AI user agents for the site root. robots.txt is a request, not a technical barrier, and sites may also block bots at the firewall level, which this check does not see.
Blocking AI bots is one side. The other: is AI actually sending you visitors? Citelytic shows how much traffic ChatGPT, Perplexity, Gemini and Copilot send to your own site.
Start free – no credit card