Who blocks AI · #125 in the Majestic Million
robots.txt · checked 9 Nov 2026
Does issuu.com block AI crawlers?
No. issuu.com’s robots.txt lets all 19 AI crawlers we track crawl the site. It also blocks PetalBot among search engines.
GPTBotAllowedOAI-SearchBotAllowedClaudeBotAllowedPerplexityBotAllowedGoogle-ExtendedAllowedCCBotAllowed- robots.txt
- issuu.com/robots.txt · 184 lines
- llms.txt
- none
- Checked
- 9 November 2026, as canaicrawl. We check again every week.
Every bot, and the line that decides
Search engines
| Bot | Operator | robots.txt | Deciding line |
|---|---|---|---|
Googlebot | Allowed | no rule matches the home page | |
Bingbot | Microsoft | Allowed | no rule matches the home page |
DuckDuckBot | DuckDuckGo | Allowed | no rule matches the home page |
Applebot | Apple | Allowed | no rule matches the home page |
PetalBot | Huawei | Blocked | line 50 · Disallow: / under User-agent: PetalBot |
YandexBot | Yandex | Allowed | no rule matches the home page |
Baiduspider | Baidu | Allowed | no rule matches the home page |
AI search
| Bot | Operator | robots.txt | Deciding line |
|---|---|---|---|
OAI-SearchBot | OpenAI | Allowed | no rule matches the home page |
PerplexityBot | Perplexity | Allowed | no rule matches the home page |
Claude-SearchBot | Anthropic | Allowed | no rule matches the home page |
DuckAssistBot | DuckDuckGo | Allowed | no rule matches the home page |
Amazonbot | Amazon | Allowed | no rule matches the home page |
YouBot | You.com | Allowed | no rule matches the home page |
AI training
| Bot | Operator | robots.txt | Deciding line |
|---|---|---|---|
GPTBot | OpenAI | Allowed | no rule matches the home page |
ClaudeBot | Anthropic | Allowed | no rule matches the home page |
Google-Extended | Allowed | no rule matches the home page | |
CCBot | Common Crawl | Allowed | no rule matches the home page |
Applebot-Extended | Apple | Allowed | no rule matches the home page |
GoogleOther | Allowed | no rule matches the home page | |
Meta-ExternalAgent | Meta | Allowed | no rule matches the home page |
Bytespider | ByteDance | Allowed | no rule matches the home page |
User-triggered fetchers
| Bot | Operator | robots.txt | Deciding line |
|---|---|---|---|
ChatGPT-User | OpenAI | Allowed | no rule matches the home page |
Claude-User | Anthropic | Allowed | no rule matches the home page |
Perplexity-User | Perplexity | Allowed | no rule matches the home page |
MistralAI-User | Mistral | Allowed | no rule matches the home page |
Meta-ExternalFetcher | Meta | Allowed | no rule matches the home page |
SEO tools
| Bot | Operator | robots.txt | Deciding line |
|---|---|---|---|
AhrefsBot | Ahrefs | Allowed | no rule matches the home page |
SemrushBot | Semrush | Allowed | no rule matches the home page |
MJ12bot | Majestic | Allowed | no rule matches the home page |
DotBot | Moz | Blocked | line 24 · Disallow: / under User-agent: DotBot |
View issuu.com/robots.txt · 184 lines
1User-agent: AddSearchBot
2Disallow: /
3User-agent: AwarioBot
4Disallow: /
5User-agent: AwarioRssBot
6Disallow: /
7User-agent: AwarioSmartBot
8Disallow: /
9User-agent: BLEXBot
10Disallow: /
11User-agent: BomboraBot
12Disallow: /
13User-agent: CheckLinks
14Disallow: /
15User-agent: Clickagy Intelligence Bot
16Disallow: /
17User-agent: cocolyzebot
18Disallow: /
19User-agent: DataForSeoBot
20Disallow: /
21User-agent: DomainStatsBot
22Disallow: /
23User-agent: DotBot
24Disallow: /
25User-agent: FindLinks
26Disallow: /
27User-agent: getlinkinfo.com
28Disallow: /
29User-agent: harsilbot
30Disallow: /
31User-agent: HubSpot Crawler
32Disallow: /
33User-agent: linkCheck
34Disallow: /
35User-agent: LinkWalker
36Disallow: /
37User-agent: MBCrawler
38Disallow: /
39User-agent: MJ12bot
40Disallow: /
41User-agent: Morningscore Bot
42Disallow: /
43User-agent: nooze-bot
44Disallow: /
45User-agent: OpenindexSpider
46Disallow: /
47User-agent: OpenWebSpider
48Disallow: /
49User-agent: PetalBot
50Disallow: /
51User-agent: Qwantify
52Disallow: /
53User-agent: Qwantify-prod
54Disallow: /
55User-agent: RankFlex
56Disallow: /
57User-agent: Rogerbot
58Disallow: /
59User-agent: Screaming Frog SEO Spider
60Disallow: /
61User-agent: SearchmetricsBot
62Disallow: /
63User-agent: SeekportBot
64Disallow: /
65User-agent: SeekrBot
66Disallow: /
67User-agent: SemrushBot-BA
68Disallow: /
69User-agent: SemrushBot-OCOB
70Disallow: /
71User-agent: SEO-Checker-bot
72Disallow: /
73User-agent: SeobilityBot
74Disallow: /
75User-agent: SeoSiteCheckup
76Disallow: /
77User-agent: SEOdiver Bot
78Disallow: /
79User-agent: SEOkicks-Robot
80Disallow: /
81User-agent: SEOstats
82Disallow: /
83User-agent: SiteAuditBot
84Disallow: /
85User-agent: trendictionbot
86Disallow: /
87User-agent: webgains-bot
88Disallow: /
89User-agent: www.deadlinkchecker.com
90Disallow: /
91User-agent: YaK
92Disallow: /
93
94User-agent: *
95Disallow: /home$
96Disallow: /home/
97Disallow: /home?
98Disallow: /mylibrary$
99Disallow: /mylibrary/
100Disallow: /mylibrary?
101Disallow: /publish$
102Disallow: /publish/
103Disallow: /publish?
104Disallow: /user/settings
105Disallow: /user/upload
106Disallow: /sections$
107Disallow: /sections/
108Disallow: /sections?
109Disallow: /business/signup
110Disallow: /embed/guide
111Disallow: /oembed/
112Disallow: /oembed?
113Disallow: /oembed_wp/
114Disallow: /oembed_wp?
115Disallow: /oembed_tumblr/
116Disallow: /oembed_tumblr?
117Disallow: /prv/originalfile
118Disallow: /flag/document
119Disallow: /flag/profile
120Disallow: /action$
121Disallow: /action/
122Disallow: /action?
123Disallow: /api/
124Disallow: /students/
125Allow: /call/notifier/friendly/get
126Allow: /call/document-page/stream/
127Allow: /call/stream/
128Allow: /call/profile/
129Allow: /query?*action=issuu.documents.list_anonymous&
130Allow: /query?*action=issuu.documents.list_anonymous$
131Allow: /query?*action=issuu.stacks.list_anonymous&
132Allow: /query?*action=issuu.stacks.list_anonymous$
133Allow: /query?*action=issuu.user.list_subscribers&
134Allow: /query?*action=issuu.user.list_subscribers$
135Disallow: /call/
136Disallow: /res/
137Disallow: /cwv/
138Disallow: /query$
139Disallow: /query%
140Disallow: /query?
141Disallow: /query/
142Disallow: /try$
143Disallow: /try%
144Disallow: /try?
145Disallow: /try/
146Disallow: /prices$
147Disallow: /prices%
148Disallow: /prices?
149Disallow: /prices/
150Disallow: /query%
151Disallow: /query?
152Disallow: /query/
153Disallow: /signup/payment
154Disallow: /signup/payment%
155Disallow: /signup/payment?
156Disallow: /signup/payment/
157Disallow: /signup/onboarding
158Disallow: /signup/onboarding%
159Disallow: /signup/onboarding?
160Disallow: /signup/onboarding/
161Disallow: /signup?
162Disallow: /signin?
163Disallow: /forgotpassword?
164Disallow: /sso-signin?
165Disallow: /logout
166Disallow: /preview/result
167Disallow: /preview/result?
168Disallow: /preview/result%
169Disallow: /preview/result?
170Disallow: /preview/result/
171Disallow: /search?
172
173Sitemap: https://issuu.com/sitemap.xml
174Sitemap: https://issuu.com/categories-sitemap.xml
175Sitemap: https://issuu.com/sitemap/segmented/index-document-deu.xml
176Sitemap: https://issuu.com/sitemap/segmented/index-document-por.xml
177Sitemap: https://issuu.com/sitemap/segmented/index-document-fra.xml
178Sitemap: https://issuu.com/sitemap/segmented/index-document-spa.xml
179Sitemap: https://issuu.com/sitemap/segmented/index-document-eng.xml
180Sitemap: https://issuu.com/sitemap/segmented/index-document-other.xml
181Sitemap: https://issuu.com/sitemap/segmented/index-document-ind.xml
182Sitemap: https://issuu.com/sitemap/segmented/index-document-ita.xml
183Sitemap: https://issuu.com/sitemap/segmented/index-user.xml
184
What do the bots actually get?
This page reads robots.txt, which states what issuu.com asks of crawlers. A firewall or CDN can still refuse a bot that robots.txt allows. The live check requests the page as each bot and shows the status it gets.
Run a live check on issuu.com Test a path in the robots.txt tester
History
- 19 October 2026: first checked.
Questions
Does issuu.com block GPTBot?
No. issuu.com’s robots.txt lets GPTBot crawl the site. GPTBot is OpenAI’s crawler for training data; blocking it doesn’t affect ChatGPT search, which uses OAI-SearchBot. Checked 9 November 2026.
Does issuu.com block ClaudeBot?
No. issuu.com’s robots.txt lets ClaudeBot crawl the site. ClaudeBot is Anthropic’s crawler for training data. Checked 9 November 2026.
Does issuu.com block Google-Extended?
No. issuu.com’s robots.txt lets Google-Extended crawl the site. Google-Extended is the token that controls whether Google may use pages for Gemini training and grounding; it doesn’t affect Google Search. Checked 9 November 2026.
Does issuu.com block PerplexityBot?
No. issuu.com’s robots.txt lets PerplexityBot crawl the site. PerplexityBot is the crawler that indexes pages for Perplexity’s answers. Checked 9 November 2026.
Can ChatGPT search find issuu.com?
Yes. issuu.com’s robots.txt lets OAI-SearchBot crawl the site. OAI-SearchBot is the crawler behind ChatGPT search; blocking it keeps the site out of ChatGPT’s search answers. Checked 9 November 2026.