Does researchgate.net block AI crawlers?
As of 2026-11-03, the robots.txt of researchgate.net blocks 1 of 18 AI crawlers, including Applebot-Extended.
AI crawler status of researchgate.net
Based on the live robots.txt of researchgate.net, checked on 2026-11-03. “Some paths restricted” means the bot may crawl the site but certain sections are excluded.
| User agent | Company | Purpose | Status |
|---|---|---|---|
GPTBot | OpenAI | Model training | Allowed (some paths restricted) |
OAI-SearchBot | OpenAI | ChatGPT search index | Allowed (some paths restricted) |
ChatGPT-User | OpenAI | Live browsing for ChatGPT users | Allowed (some paths restricted) |
ClaudeBot | Anthropic | Model training | Allowed (some paths restricted) |
Claude-SearchBot | Anthropic | Claude search index | Allowed (some paths restricted) |
Claude-User | Anthropic | Live browsing for Claude users | Allowed (some paths restricted) |
PerplexityBot | Perplexity | Perplexity search index | Allowed (some paths restricted) |
Perplexity-User | Perplexity | Live browsing for Perplexity users | Allowed (some paths restricted) |
Google-Extended | Gemini training & grounding | Allowed (some paths restricted) | |
Googlebot | Search and AI Overviews | Allowed (some paths restricted) | |
Bingbot | Microsoft | Bing search and Microsoft Copilot | Allowed (some paths restricted) |
Applebot-Extended | Apple | Apple Intelligence training | Blocked |
Meta-ExternalAgent | Meta | Meta AI training | Allowed (some paths restricted) |
Amazonbot | Amazon | Alexa and Amazon AI | Allowed (some paths restricted) |
DuckAssistBot | DuckDuckGo | DuckAssist answers | Allowed (some paths restricted) |
MistralAI-User | Mistral | Live browsing for Le Chat users | Allowed (some paths restricted) |
CCBot | Common Crawl | Open dataset used by many AI models | Allowed (some paths restricted) |
Bytespider | ByteDance | Model training | Allowed (some paths restricted) |
What this means
researchgate.net follows a pattern many publishers now use: it keeps AI training crawlers like Applebot-Extended out, but still lets AI search and live-browsing agents in. That way it can still be cited and linked in ChatGPT or Perplexity answers.
Among the 92 reference & knowledge sites in our AI crawler report, 27% block GPTBot completely. researchgate.net is not one of them.
Blocking AI bots is one side. The other: is AI actually sending you visitors? Citelytic shows how much traffic ChatGPT, Perplexity, Gemini and Copilot send to your own site.
Start free – no credit cardCheck your own website
Want to see this table for your own domain? The free AI crawler checker reads your robots.txt and shows which AI assistants can access your site. For a full 0-100 rating with fixes, get your AI visibility score. No signup needed.
FAQ
Does researchgate.net block ChatGPT?
No. As of 2026-11-03, OAI-SearchBot is allowed with some restricted paths and ChatGPT-User is allowed with some restricted paths in the robots.txt of researchgate.net. GPTBot (OpenAI's training crawler) is allowed with some restricted paths.
Can Perplexity access researchgate.net?
PerplexityBot is allowed with some restricted paths and Perplexity-User is allowed with some restricted paths on researchgate.net according to its robots.txt checked on 2026-11-03.
Does researchgate.net have an llms.txt file?
No, we did not find an llms.txt file on researchgate.net when we checked on 2026-11-03.
How is this data collected?
We fetch the public robots.txt file of each site and evaluate the rules for 18 AI user agents for the site root. robots.txt is a request, not a technical barrier, and sites may also block bots at the firewall level, which this check does not see.
Blocking AI bots is one side. The other: is AI actually sending you visitors? Citelytic shows how much traffic ChatGPT, Perplexity, Gemini and Copilot send to your own site.
Start free – no credit card