Who blocks AI · #886 in the Majestic Million

robots.txt · checked 9 Nov 2026

Does nintendo.com block AI crawlers?

Yes. nintendo.com’s robots.txt blocks 7 of the 19 AI crawlers we track, including GPTBot, ClaudeBot, Google-Extended and 4 more. It also blocks PetalBot among search engines.

GPTBotBlocked OAI-SearchBotAllowed ClaudeBotBlocked PerplexityBotAllowed Google-ExtendedBlocked CCBotBlocked

robots.txt: www.nintendo.com/robots.txt · 152 lines
llms.txt: none
Checked: 9 November 2026, as canaicrawl. We check again every week.

Every bot, and the line that decides

Search engines

Bot	Operator	robots.txt	Deciding line
`Googlebot`	Google	Allowed	line 2 · `Allow: /` under `User-agent: *`
`Bingbot`	Microsoft	Allowed	line 2 · `Allow: /` under `User-agent: *`
`DuckDuckBot`	DuckDuckGo	Allowed	line 2 · `Allow: /` under `User-agent: *`
`Applebot`	Apple	Allowed	line 2 · `Allow: /` under `User-agent: *`
`PetalBot`	Huawei	Blocked	line 23 · `Disallow: /` under `User-agent: PetalBot`
`YandexBot`	Yandex	Allowed	line 2 · `Allow: /` under `User-agent: *`
`Baiduspider`	Baidu	Allowed	line 2 · `Allow: /` under `User-agent: *`

AI search

Bot	Operator	robots.txt	Deciding line
`OAI-SearchBot`	OpenAI	Allowed	line 2 · `Allow: /` under `User-agent: *`
`PerplexityBot`	Perplexity	Allowed	line 2 · `Allow: /` under `User-agent: *`
`Claude-SearchBot`	Anthropic	Allowed	line 2 · `Allow: /` under `User-agent: *`
`DuckAssistBot`	DuckDuckGo	Allowed	line 2 · `Allow: /` under `User-agent: *`
`Amazonbot`	Amazon	Allowed	line 2 · `Allow: /` under `User-agent: *`
`YouBot`	You.com	Allowed	line 2 · `Allow: /` under `User-agent: *`

AI training

Bot	Operator	robots.txt	Deciding line
`GPTBot`	OpenAI	Blocked	line 57 · `Disallow: /` under `User-agent: GPTBot`
`ClaudeBot`	Anthropic	Blocked	line 65 · `Disallow: /` under `User-agent: Claudebot`
`Google-Extended`	Google	Blocked	line 69 · `Disallow: /` under `User-agent: Google-Extended`
`CCBot`	Common Crawl	Blocked	line 41 · `Disallow: /` under `User-agent: CCBot`
`Applebot-Extended`	Apple	Blocked	line 73 · `Disallow: /` under `User-agent: Applebot-Extended`
`GoogleOther`	Google	Allowed	line 2 · `Allow: /` under `User-agent: *`
`Meta-ExternalAgent`	Meta	Blocked	line 77 · `Disallow: /` under `User-agent: Meta-ExternalAgent`
`Bytespider`	ByteDance	Blocked	line 38 · `Disallow: /` under `User-agent: Bytespider`

User-triggered fetchers

Bot	Operator	robots.txt	Deciding line
`ChatGPT-User`	OpenAI	Allowed	line 2 · `Allow: /` under `User-agent: *`
`Claude-User`	Anthropic	Allowed	line 2 · `Allow: /` under `User-agent: *`
`Perplexity-User`	Perplexity	Allowed	line 2 · `Allow: /` under `User-agent: *`
`MistralAI-User`	Mistral	Allowed	line 2 · `Allow: /` under `User-agent: *`
`Meta-ExternalFetcher`	Meta	Allowed	line 2 · `Allow: /` under `User-agent: *`

SEO tools

Bot	Operator	robots.txt	Deciding line
`AhrefsBot`	Ahrefs	Allowed	line 2 · `Allow: /` under `User-agent: *`
`SemrushBot`	Semrush	Allowed	line 2 · `Allow: /` under `User-agent: *`
`MJ12bot`	Majestic	Allowed	line 2 · `Allow: /` under `User-agent: *`
`DotBot`	Moz	Allowed	line 2 · `Allow: /` under `User-agent: *`

View www.nintendo.com/robots.txt · 152 lines

1User-agent: *

2Allow: /

4DaumWebMasterTool: 32aa5c28d33b91d5b7ca65e51ab5af74e84941e2c30d294caa1a3dc55aea1191:/KZk3GCODdcSqsR4mp1dtQ==

6# Blocked Bots

7User-agent: Kangaroo Bot

8Disallow: /

10User-agent: Nutch

11Disallow: /

13User-agent: Omgili

14Disallow: /

16User-agent: Omgilibot

17Disallow: /

19User-agent: PanguBot

20Disallow: /

22User-agent: PetalBot

23Disallow: /

25User-agent: Timpibot

26Disallow: /

28User-agent: Webzio-Extended

29Disallow: /

31User-agent: AI2Bot

32Disallow: /

34User-agent: AI2Bot-Dolma

35Disallow: /

37User-agent: Bytespider

38Disallow: /

40User-agent: CCBot

41Disallow: /

43User-agent: Diffbot

44Disallow: /

46User-agent: FacebookBot

47Disallow: /

49User-agent: FriendlyCrawler

50Disallow: /

52User-agent: ICC-Crawler

53Disallow: /

55User-agent: GPTBot

56Allow: /jp/nintendo-direct/description/

57Disallow: /

59User-agent: Claude-Web

60Allow: /jp/nintendo-direct/description/

61Disallow: /

63User-agent: Claudebot

64Allow: /jp/nintendo-direct/description/

65Disallow: /

67User-agent: Google-Extended

68Allow: /jp/nintendo-direct/description/

69Disallow: /

71User-agent: Applebot-Extended

72Allow: /jp/nintendo-direct/description/

73Disallow: /

75User-agent: Meta-ExternalAgent

76Allow: /jp/nintendo-direct/description/

77Disallow: /

79User-agent: cohere-ai

80Allow: /jp/nintendo-direct/description/

81Disallow: /

83User-agent: cohere-training-data-crawler

84Allow: /jp/nintendo-direct/description/

85Disallow: /

87# Existing restrictions

89User-agent: *

90Disallow: /sg/support/qa-list

91Disallow: /my/support/qa-list

92Disallow: /th/support/qa-list

93Disallow: /ph/support/qa-list

95# Sitemaps

97Sitemap: https://www.nintendo.com/au/sitemap/0.xml

98Sitemap: https://www.nintendo.com/jp/data/sitemap/sitemap.xml

99Sitemap: https://www.nintendo.com/jp/topics/sitemap.xml

100Sitemap: https://www.nintendo.com/jp/nintendo-direct/description/sitemap.xml

101Sitemap: https://www.nintendo.com/kr/sitemap.xml

102Sitemap: https://www.nintendo.com/hk/sitemap.xml

103Sitemap: https://www.nintendo.com/tw/sitemap.xml

104Sitemap: https://www.nintendo.com/sg/data/sitemap/sitemap.xml

105Sitemap: https://www.nintendo.com/th/data/sitemap/sitemap.xml

106Sitemap: https://www.nintendo.com/my/data/sitemap/sitemap.xml

107Sitemap: https://www.nintendo.com/ph/data/sitemap/sitemap.xml

108Sitemap: https://www.nintendo.com/us/whatsnew/sitemap.xml

109Sitemap: https://www.nintendo.com/us/nintendo-direct/sitemap.xml

110Sitemap: https://www.nintendo.com/us/store/sitemap.xml

111Sitemap: https://www.nintendo.com/us/news/sitemap.xml

112Sitemap: https://www.nintendo.com/us/sitemap.xml

113Sitemap: https://www.nintendo.com/en-ca/whatsnew/sitemap.xml

114Sitemap: https://www.nintendo.com/en-ca/nintendo-direct/sitemap.xml

115Sitemap: https://www.nintendo.com/en-ca/store/sitemap.xml

116Sitemap: https://www.nintendo.com/en-ca/news/sitemap.xml

117Sitemap: https://www.nintendo.com/en-ca/sitemap.xml

118Sitemap: https://www.nintendo.com/fr-ca/whatsnew/sitemap.xml

119Sitemap: https://www.nintendo.com/fr-ca/store/sitemap.xml

120Sitemap: https://www.nintendo.com/fr-ca/news/sitemap.xml

121Sitemap: https://www.nintendo.com/fr-ca/sitemap.xml

122Sitemap: https://www.nintendo.com/pt-br/whatsnew/sitemap.xml

123Sitemap: https://www.nintendo.com/pt-br/store/sitemap.xml

124Sitemap: https://www.nintendo.com/pt-br/news/sitemap.xml

125Sitemap: https://www.nintendo.com/pt-br/sitemap.xml

126Sitemap: https://www.nintendo.com/es-mx/whatsnew/sitemap.xml

127Sitemap: https://www.nintendo.com/es-mx/store/sitemap.xml

128Sitemap: https://www.nintendo.com/es-mx/news/sitemap.xml

129Sitemap: https://www.nintendo.com/es-mx/sitemap.xml

130Sitemap: https://www.nintendo.com/es-pe/whatsnew/sitemap.xml

131Sitemap: https://www.nintendo.com/es-pe/store/sitemap.xml

132Sitemap: https://www.nintendo.com/es-pe/news/sitemap.xml

133Sitemap: https://www.nintendo.com/es-pe/sitemap.xml

134Sitemap: https://www.nintendo.com/es-cl/whatsnew/sitemap.xml

135Sitemap: https://www.nintendo.com/es-cl/store/sitemap.xml

136Sitemap: https://www.nintendo.com/es-cl/news/sitemap.xml

137Sitemap: https://www.nintendo.com/es-cl/sitemap.xml

138Sitemap: https://www.nintendo.com/es-co/whatsnew/sitemap.xml

139Sitemap: https://www.nintendo.com/es-co/store/sitemap.xml

140Sitemap: https://www.nintendo.com/es-co/news/sitemap.xml

141Sitemap: https://www.nintendo.com/es-co/sitemap.xml

142Sitemap: https://www.nintendo.com/es-ar/whatsnew/sitemap.xml

143Sitemap: https://www.nintendo.com/es-ar/store/sitemap.xml

144Sitemap: https://www.nintendo.com/es-ar/news/sitemap.xml

145Sitemap: https://www.nintendo.com/es-ar/sitemap.xml

146

147

148

149#Nintendo Co., Ltd. and its affiliated companies ("Nintendo") therefore explicitly reserve all their rights in any content made available, including, without limitation, content made available by Nintendo on websites, social media pages and any other platforms, as well as in Nintendo games, video content, and social media posts.

150#Any use of such content for the development, training, programming, improvement and/or enhancement of artificial intelligence (including, but not limited to, generative AI systems), web scraping, machine learning, or any form of text or data mining by any means, is strictly prohibited, unless specifically and explicitly authorized in writing by the Nintendo company that owns the respective rights.

151#This statement is a reservation of rights (also known as an "opt-out") with respect to text and data mining, to the extent that this concept is recognised by applicable law in all jurisdictions worldwide, such as Article 4 (3) of Directive (EU) 2019/790 and national implementation laws in the EU region.

152#It applies to any Nintendo content including, without limitation, video games, visual displays of video games, characters, brands, artworks, images, videos, music, dialogue, story, and any Nintendo works or data.

What do the bots actually get?

This page reads robots.txt, which states what nintendo.com asks of crawlers. A firewall or CDN can still refuse a bot that robots.txt allows. The live check requests the page as each bot and shows the status it gets.

Run a live check on nintendo.com Test a path in the robots.txt tester

History

19 October 2026: first checked.

Questions

Does nintendo.com block GPTBot?

Yes. nintendo.com’s robots.txt disallows GPTBot from the whole site (line 57: Disallow: /). GPTBot is OpenAI’s crawler for training data; blocking it doesn’t affect ChatGPT search, which uses OAI-SearchBot. Checked 9 November 2026.

Does nintendo.com block ClaudeBot?

Yes. nintendo.com’s robots.txt disallows ClaudeBot from the whole site (line 65: Disallow: /). ClaudeBot is Anthropic’s crawler for training data. Checked 9 November 2026.

Does nintendo.com block Google-Extended?

Yes. nintendo.com’s robots.txt disallows Google-Extended from the whole site (line 69: Disallow: /). Google-Extended is the token that controls whether Google may use pages for Gemini training and grounding; it doesn’t affect Google Search. Checked 9 November 2026.

Does nintendo.com block PerplexityBot?

No. nintendo.com’s robots.txt lets PerplexityBot crawl the site. PerplexityBot is the crawler that indexes pages for Perplexity’s answers. Checked 9 November 2026.

Can ChatGPT search find nintendo.com?

Yes. nintendo.com’s robots.txt lets OAI-SearchBot crawl the site. OAI-SearchBot is the crawler behind ChatGPT search; blocking it keeps the site out of ChatGPT’s search answers. Checked 9 November 2026.