Who blocks AI · #381 in the Majestic Million
robots.txt · checked 9 Nov 2026
Does ovh.com block AI crawlers?
Yes. ovh.com’s robots.txt blocks 3 of the 19 AI crawlers we track, including GPTBot, CCBot and ChatGPT-User. Search engines such as Googlebot and Bingbot may crawl it.
GPTBotBlockedOAI-SearchBotAllowedClaudeBotAllowedPerplexityBotAllowedGoogle-ExtendedAllowedCCBotBlocked- robots.txt
- www.ovh.com/robots.txt · 238 lines
- llms.txt
- none
- Checked
- 9 November 2026, as canaicrawl. We check again every week.
Every bot, and the line that decides
Search engines
| Bot | Operator | robots.txt | Deciding line |
|---|---|---|---|
Googlebot | Allowed | no rule matches the home page | |
Bingbot | Microsoft | Allowed | no rule matches the home page |
DuckDuckBot | DuckDuckGo | Allowed | no rule matches the home page |
Applebot | Apple | Allowed | no rule matches the home page |
PetalBot | Huawei | Allowed | no rule matches the home page |
YandexBot | Yandex | Allowed | no rule matches the home page |
Baiduspider | Baidu | Allowed | no rule matches the home page |
AI search
| Bot | Operator | robots.txt | Deciding line |
|---|---|---|---|
OAI-SearchBot | OpenAI | Allowed | no rule matches the home page |
PerplexityBot | Perplexity | Allowed | no rule matches the home page |
Claude-SearchBot | Anthropic | Allowed | no rule matches the home page |
DuckAssistBot | DuckDuckGo | Allowed | no rule matches the home page |
Amazonbot | Amazon | Allowed | no rule matches the home page |
YouBot | You.com | Allowed | no rule matches the home page |
AI training
| Bot | Operator | robots.txt | Deciding line |
|---|---|---|---|
GPTBot | OpenAI | Blocked | line 215 · Disallow: / under User-agent: GPTBot |
ClaudeBot | Anthropic | Allowed | no rule matches the home page |
Google-Extended | Allowed | no rule matches the home page | |
CCBot | Common Crawl | Blocked | line 221 · Disallow: / under User-agent: CCBot |
Applebot-Extended | Apple | Allowed | no rule matches the home page |
GoogleOther | Allowed | no rule matches the home page | |
Meta-ExternalAgent | Meta | Allowed | no rule matches the home page |
Bytespider | ByteDance | Allowed | no rule matches the home page |
User-triggered fetchers
| Bot | Operator | robots.txt | Deciding line |
|---|---|---|---|
ChatGPT-User | OpenAI | Blocked | line 218 · Disallow: / under User-agent: ChatGPT-User |
Claude-User | Anthropic | Allowed | no rule matches the home page |
Perplexity-User | Perplexity | Allowed | no rule matches the home page |
MistralAI-User | Mistral | Allowed | no rule matches the home page |
Meta-ExternalFetcher | Meta | Allowed | no rule matches the home page |
SEO tools
| Bot | Operator | robots.txt | Deciding line |
|---|---|---|---|
AhrefsBot | Ahrefs | Allowed | no rule matches the home page |
SemrushBot | Semrush | Allowed | no rule matches the home page |
MJ12bot | Majestic | Allowed | no rule matches the home page |
DotBot | Moz | Allowed | no rule matches the home page |
View www.ovh.com/robots.txt · 238 lines
1User-agent: *
2
3Disallow: /cgi-bin/
4
5#Disallow: /images/
6#Disallow: /fr/images/
7#Disallow: /javascripts/
8#Disallow: /js/
9Disallow: /fr/images.xml
10#Disallow: /fr/support/nous-contacter/
11Disallow: /fr/support/nous-contacter/moyens-de-contact.xml
12#Disallow: /themes/
13#Disallow: /fr/themes/
14Disallow: /autoedit/
15Disallow: /banners/
16Disallow: /flashbanners/
17Disallow: /flashBanners/
18Disallow: /errors/
19Disallow: /templates/
20Disallow: /tmp/
21Disallow: /fr/erreurs/
22Disallow: /fr/cgi-bin/
23Disallow: /fr/xml_shared/
24Noindex: /fr/xml_shared/
25
26Disallow: /en-alpha/
27Disallow: /en/pattern/
28
29Disallow: /mini/
30Disallow: /minipl/
31Disallow: /mini.save/
32
33Disallow: /spyweb/
34Disallow: /spyweb.d/
35
36Disallow: /update/
37Disallow: /fr/update/
38Disallow: /fr/cloud/api/
39
40Disallow: /fr/espaceclients/support/supportv2.cgi
41Disallow: /fr/adieu_thomas.xml
42Disallow: /fr/tom.xsl
43Disallow: /fr/pattern/
44
45Disallow: /fr/support/support/support.xml
46Disallow: /fr/support/support/supportv3.cgi
47Disallow: /fr/images/news/
48
49
50Disallow: /*?
51
52Disallow: /fr/emails/hosted_exchange/
53Disallow: /us/cgi-bin/
54Disallow: /ma/cgi-bin/
55Disallow: /tn/cgi-bin/
56Disallow: /ca/en/cgi-bin/
57Disallow: /ca/fr/cgi-bin/
58Disallow: /managerv3/error.html
59Disallow: /managerv5/VAADIN/
60
61Disallow: /sg/cgi-bin/
62Disallow: /asia/cgi-bin/
63
64Disallow: /fr/domaines/charte-nommage-dotovh.xml
65Disallow: /fr/hpc/*
66
67Disallow: /fr/images/housing/documents/presentation/ecologie.pdf
68
69Disallow: /fr/dlp/forms/
70Disallow: /us/dlp/forms/
71Disallow: /ca/en/dlp/forms/
72Disallow: /ca/fr/dlp/forms/
73Disallow: /sg/dlp/forms/
74Disallow: /asia/dlp/forms/
75
76#Disallow: /fr/homeOVH/
77#Disallow: /tn/homeOVH/
78#Disallow: /ma/homeOVH/
79#Disallow: /ca/fr/homeOVH/
80#Disallow: /ca/en/homeOVH/
81#Disallow: /world/homeOVH/
82#Disallow: /world/es/homeOVH/
83#Disallow: /sg/homeOVH/
84#Disallow: /asia/homeOVH/
85
86Allow: /fr/images/logo-ovh.jpg
87Allow: /fr/components/footer/footer.js
88Allow: /js/fancyBox/jquery.fancybox.css
89Allow: /js/fancyBox/jquery.fancybox.pack.js
90Allow: /js/lazyLoad/jquery.lazyload.js
91Allow: /js/website/raven/raven.min.js
92Allow: /templates/jscommon/website/commonOVH/common.js
93
94# BLOG
95Disallow: /fr/blog//wp-admin/
96Disallow: /fr/blog//wp-includes/
97Disallow: /fr/blog//wp-content/
98Disallow: /?
99Disallow: /*?
100Disallow: /fr/blog/author/*
101Disallow: /fr/blog/tag/*
102Disallow: /fr/blog/nous-contacter/
103
104Disallow: /fr/fin-inscription-hubic/
105
106Disallow: /fr/startup/forms/
107Disallow: /world/startup/forms/
108Disallow: /ca/en/startup/forms/
109Disallow: /ca/fr/startup/forms/
110Disallow: /sg/startup/forms/
111Disallow: /asia/startup/forms/
112
113Disallow: /ca/en//vps/
114Disallow: /ca/en//vps/faq-help.xml
115Disallow: /ca/en//vps/manager-web.xml
116Disallow: /ma/produits/comparer_vps.xml
117Disallow: /ma/vps/
118Disallow: /ma/vps/quel-vps-choisir.xml
119Disallow: /ma/vps/systeme-exploitation.xml
120Disallow: /tn//vps/
121Disallow: /tn/produits/comparer_vps.xml
122Disallow: /tn/produits/tarifs_vps.xml
123Disallow: /world//vps/
124Disallow: /world/es//vps/
125Disallow: /fr/vps/
126Disallow: /fr/vps/vps-ssd.xml
127Disallow: /fr/vps/vps-cloud.xml
128Disallow: /fr/vps/backup-vps.xml
129Disallow: /fr/vps/geolocalisation-vps.xml
130Disallow: /fr/vps/aide-faq.xml
131Disallow: /fr/vps/systeme-exploitation.xml
132Disallow: /fr/vps/quel-vps-choisir.xml
133Disallow: /world/vps/
134Disallow: /world/vps/backup-vps.xml
135Disallow: /world/vps/vps-ssd.xml
136Disallow: /world/vps/faq-help.xml
137Disallow: /world/vps/vps-cloud.xml
138Disallow: /world/vps/which-vps-to-choose.xml
139Disallow: /asia/vps/
140Disallow: /asia/vps/vps-cloud.xml
141Disallow: /asia/vps/operating-system.xml
142Disallow: /asia/vps/vps-ssd.xml
143Disallow: /ca/en/vps/
144Disallow: /ca/en/vps/api-restful.xml
145Disallow: /ca/en/vps/vps-ssd.xml
146Disallow: /ca/en/vps/faq-help.xml
147Disallow: /ca/en/vps/vps-cloud-ram.xml
148Disallow: /ca/en/vps/which-vps-to-choose.xml
149Disallow: /ca/fr/vps/
150Disallow: /ca/fr/vps/storage.xml
151Disallow: /ca/fr/vps/vps-cloud.xml
152Disallow: /ca/fr/vps/vps-ssd.xml
153Disallow: /ca/fr/vps/systeme-exploitation.xml
154Disallow: /ca/fr/vps/aide-faq.xml
155Disallow: /ca/fr/vps/quel-vps-choisir.xml
156Disallow: /sg/vps/
157Disallow: /sg/vps/storage.xml
158Disallow: /sg/vps/faq-help.xml
159Disallow: /sg/vps/which-vps-to-choose.xml
160
161
162Disallow: /conferences/*
163Disallow: //conferences/*
164Disallow: /cgi-bin/order/
165Disallow: /cgi-bin/fr/order/
166Disallow: /en/
167
168Disallow: /cgi-bin/fr/order/renew.cgi
169Disallow: /cgi-bin/order/bill.pdf
170Disallow: /cgi-bin/order/display-order.cgi
171Disallow: /cgi-bin/order/redirect-payment-edinar.cgi
172Disallow: /cgi-bin/order/renew.cgi
173Disallow: /cgi-bin/telephony/webconf.pl
174
175Disallow: /cgi-bin/
176
177Disallow: /cgi-bin/order/renew.cgi
178Disallow: /fr/cgi-bin/order/renew.cgi
179
180
181Disallow: /manager/
182Disallow: /order/
183
184Disallow: /es/
185Disallow: /fr/commande/
186Disallow: /fr/emails/commande/
187Disallow: /fr/order/dedicated/
188
189Disallow: /fr/cgi-bin/contactcontrol.cgi
190Disallow: /fr/cgi-bin/domain/outgoing.cgi
191Disallow: /fr/cgi-bin/fr/domain/trade.cgi
192Disallow: /fr/cgi-bin/fr/order/facture.pdf
193Disallow: /fr/cgi-bin/fr/order/renew.cgi
194Disallow: /fr/cgi-bin/fr/procedure/procedure.pdf
195Disallow: /fr/cgi-bin/fr/procedure/procedureChangeContacts.cgi
196Disallow: /fr/cgi-bin/fr/procedure/procedureChangeEmail.cgi
197Disallow: /fr/cgi-bin/fr/procedure/procedureChangeOwner.cgi
198Disallow: /fr/cgi-bin/order/display-order.cgi
199Disallow: /fr/cgi-bin/order/facture.pdf
200Disallow: /fr/cgi-bin/order/renew.cgi
201Disallow: /fr/cgi-bin/procedure/procedureChangeContacts.cgi
202Disallow: /fr/cgi-bin/procedure/procedureChangeOwner.cgi
203Disallow: /fr/cgi-bin/telephony/callRate.cgi
204Disallow: /fr/cgi-bin/telephony/rma.pl
205Disallow: /fr/cgi-bin/telephony/webconf
206Disallow: /fr/cgi-bin/telephony/webconf.pl
207Disallow: /fr/cgi-bin/transfer.cgi
208
209Disallow: /ma/commande/
210Disallow: /ma/order/
211
212Disallow: /tn/commande/
213
214User-agent: GPTBot
215Disallow: /
216
217User-agent: ChatGPT-User
218Disallow: /
219
220User-agent: CCBot
221Disallow: /
222
223User-agent: anthropic-ai
224Disallow: /
225
226User-agent: TextBulkerBot
227Disallow: /
228
229Sitemap: https://www.ovh.com/fr/sitemap-fr.xml
230Sitemap: https://www.ovh.com/sg/sitemap-sg.xml
231Sitemap: https://www.ovh.com/ca/en/sitemap-ca-en.xml
232Sitemap: https://www.ovh.com/ca/fr/sitemap-ca-fr.xml
233Sitemap: https://www.ovh.com/asia/sitemap-asia.xml
234Sitemap: https://www.ovh.com/world/es/sitemap-world-es.xml
235Sitemap: https://www.ovh.com/ma/sitemap-ma.xml
236Sitemap: https://www.ovh.com/tn/sitemap-tn.xml
237Sitemap: https://www.ovh.com/world/sitemap-world.xml
238
What do the bots actually get?
This page reads robots.txt, which states what ovh.com asks of crawlers. A firewall or CDN can still refuse a bot that robots.txt allows. The live check requests the page as each bot and shows the status it gets.
Run a live check on ovh.com Test a path in the robots.txt tester
History
- 19 October 2026: first checked.
Questions
Does ovh.com block GPTBot?
Yes. ovh.com’s robots.txt disallows GPTBot from the whole site (line 215: Disallow: /). GPTBot is OpenAI’s crawler for training data; blocking it doesn’t affect ChatGPT search, which uses OAI-SearchBot. Checked 9 November 2026.
Does ovh.com block ClaudeBot?
No. ovh.com’s robots.txt lets ClaudeBot crawl the site. ClaudeBot is Anthropic’s crawler for training data. Checked 9 November 2026.
Does ovh.com block Google-Extended?
No. ovh.com’s robots.txt lets Google-Extended crawl the site. Google-Extended is the token that controls whether Google may use pages for Gemini training and grounding; it doesn’t affect Google Search. Checked 9 November 2026.
Does ovh.com block PerplexityBot?
No. ovh.com’s robots.txt lets PerplexityBot crawl the site. PerplexityBot is the crawler that indexes pages for Perplexity’s answers. Checked 9 November 2026.
Can ChatGPT search find ovh.com?
Yes. ovh.com’s robots.txt lets OAI-SearchBot crawl the site. OAI-SearchBot is the crawler behind ChatGPT search; blocking it keeps the site out of ChatGPT’s search answers. Checked 9 November 2026.