Who blocks AI · #644 in the Majestic Million
robots.txt · checked 9 Nov 2026
Does qualtrics.com block AI crawlers?
No. qualtrics.com’s robots.txt lets all 19 AI crawlers we track crawl the site. Search engines such as Googlebot and Bingbot may crawl it.
GPTBotAllowedOAI-SearchBotAllowedClaudeBotAllowedPerplexityBotAllowedGoogle-ExtendedAllowedCCBotAllowed- robots.txt
- www.qualtrics.com/robots.txt · 1,013 lines
- llms.txt
- none
- Checked
- 9 November 2026, as canaicrawl. We check again every week.
Every bot, and the line that decides
Search engines
| Bot | Operator | robots.txt | Deciding line |
|---|---|---|---|
Googlebot | Allowed | no rule matches the home page | |
Bingbot | Microsoft | Allowed | no rule matches the home page |
DuckDuckBot | DuckDuckGo | Allowed | no rule matches the home page |
Applebot | Apple | Allowed | no rule matches the home page |
PetalBot | Huawei | Allowed | no rule matches the home page |
YandexBot | Yandex | Allowed | no rule matches the home page |
Baiduspider | Baidu | Allowed | no rule matches the home page |
AI search
| Bot | Operator | robots.txt | Deciding line |
|---|---|---|---|
OAI-SearchBot | OpenAI | Allowed | no rule matches the home page |
PerplexityBot | Perplexity | Allowed | no rule matches the home page |
Claude-SearchBot | Anthropic | Allowed | no rule matches the home page |
DuckAssistBot | DuckDuckGo | Allowed | no rule matches the home page |
Amazonbot | Amazon | Allowed | no rule matches the home page |
YouBot | You.com | Allowed | no rule matches the home page |
AI training
| Bot | Operator | robots.txt | Deciding line |
|---|---|---|---|
GPTBot | OpenAI | Allowed | no rule matches the home page |
ClaudeBot | Anthropic | Allowed | no rule matches the home page |
Google-Extended | Allowed | no rule matches the home page | |
CCBot | Common Crawl | Allowed | no rule matches the home page |
Applebot-Extended | Apple | Allowed | no rule matches the home page |
GoogleOther | Allowed | no rule matches the home page | |
Meta-ExternalAgent | Meta | Allowed | no rule matches the home page |
Bytespider | ByteDance | Allowed | no rule matches the home page |
User-triggered fetchers
| Bot | Operator | robots.txt | Deciding line |
|---|---|---|---|
ChatGPT-User | OpenAI | Allowed | no rule matches the home page |
Claude-User | Anthropic | Allowed | no rule matches the home page |
Perplexity-User | Perplexity | Allowed | no rule matches the home page |
MistralAI-User | Mistral | Allowed | no rule matches the home page |
Meta-ExternalFetcher | Meta | Allowed | no rule matches the home page |
SEO tools
| Bot | Operator | robots.txt | Deciding line |
|---|---|---|---|
AhrefsBot | Ahrefs | Allowed | no rule matches the home page |
SemrushBot | Semrush | Allowed | no rule matches the home page |
MJ12bot | Majestic | Allowed | no rule matches the home page |
DotBot | Moz | Allowed | no rule matches the home page |
View www.qualtrics.com/robots.txt · 1,013 lines
1#Ask SEO team before you edit this file
2#Robot experience management
3
4User-agent: *
5#CSS JS Images
6Allow: /core/*.css$
7Allow: /en-gb/core/*.css$
8Allow: /en-au/core/*.css$
9Allow: /de/core/*.css$
10Allow: /ja/core/*.css$
11Allow: /fr/core/*.css$
12Allow: /es/core/*.css$
13Allow: /es-es/core/*.css$
14Allow: /it/core/*.css$
15Allow: /zh-hk/core/*.css$
16Allow: /ko/core/*.css$
17Allow: /pt-br/core/*.css$
18Allow: /nl/core/*.css$
19Allow: /th/core/*.css$
20Allow: /core/*.css?
21Allow: /en-gb/core/*.css?
22Allow: /en-au/core/*.css?
23Allow: /de/core/*.css?
24Allow: /ja/core/*.css?
25Allow: /fr/core/*.css?
26Allow: /es/core/*.css?
27Allow: /es-es/core/*.css?
28Allow: /it/core/*.css?
29Allow: /zh-hk/core/*.css?
30Allow: /ko/core/*.css?
31Allow: /pt-br/core/*.css?
32Allow: /nl/core/*.css?
33Allow: /th/core/*.css?
34Allow: /core/*.js$
35Allow: /en-gb/core/*.js$
36Allow: /en-au/core/*.js$
37Allow: /de/core/*.js$
38Allow: /ja/core/*.js$
39Allow: /fr/core/*.js$
40Allow: /es/core/*.js$
41Allow: /es-es/core/*.js$
42Allow: /it/core/*.js$
43Allow: /zh-hk/core/*.js$
44Allow: /ko/core/*.js$
45Allow: /pt-br/core/*.js$
46Allow: /nl/core/*.js$
47Allow: /th/core/*.js$
48Allow: /core/*.js?
49Allow: /en-gb/core/*.js?
50Allow: /en-au/core/*.js?
51Allow: /de/core/*.js?
52Allow: /ja/core/*.js?
53Allow: /fr/core/*.js?
54Allow: /es/core/*.js?
55Allow: /es-es/core/*.js?
56Allow: /it/core/*.js?
57Allow: /zh-hk/core/*.js?
58Allow: /ko/core/*.js?
59Allow: /pt-br/core/*.js?
60Allow: /nl/core/*.js?
61Allow: /th/core/*.js?
62Allow: /core/*.gif
63Allow: /en-gb/core/*.gif
64Allow: /en-au/core/*.gif
65Allow: /de/core/*.gif
66Allow: /ja/core/*.gif
67Allow: /fr/core/*.gif
68Allow: /es/core/*.gif
69Allow: /es-es/core/*.gif
70Allow: /it/core/*.gif
71Allow: /zh-hk/core/*.gif
72Allow: /ko/core/*.gif
73Allow: /pt-br/core/*.gif
74Allow: /nl/core/*.gif
75Allow: /th/core/*.gif
76Allow: /core/*.jpg
77Allow: /en-gb/core/*.jpg
78Allow: /en-au/core/*.jpg
79Allow: /de/core/*.jpg
80Allow: /ja/core/*.jpg
81Allow: /fr/core/*.jpg
82Allow: /es/core/*.jpg
83Allow: /es-es/core/*.jpg
84Allow: /it/core/*.jpg
85Allow: /zh-hk/core/*.jpg
86Allow: /ko/core/*.jpg
87Allow: /pt-br/core/*.jpg
88Allow: /nl/core/*.jpg
89Allow: /th/core/*.jpg
90Allow: /core/*.jpeg
91Allow: /en-gb/core/*.jpeg
92Allow: /en-au/core/*.jpeg
93Allow: /de/core/*.jpeg
94Allow: /ja/core/*.jpeg
95Allow: /fr/core/*.jpeg
96Allow: /es/core/*.jpeg
97Allow: /es-es/core/*.jpeg
98Allow: /it/core/*.jpeg
99Allow: /zh-hk/core/*.jpeg
100Allow: /ko/core/*.jpeg
101Allow: /pt-br/core/*.jpeg
102Allow: /nl/core/*.jpeg
103Allow: /th/core/*.jpeg
104Allow: /core/*.png
105Allow: /en-gb/core/*.png
106Allow: /en-au/core/*.png
107Allow: /de/core/*.png
108Allow: /ja/core/*.png
109Allow: /fr/core/*.png
110Allow: /es/core/*.png
111Allow: /es-es/core/*.png
112Allow: /it/core/*.png
113Allow: /zh-hk/core/*.png
114Allow: /ko/core/*.png
115Allow: /pt-br/core/*.png
116Allow: /nl/core/*.png
117Allow: /th/core/*.png
118Allow: /core/*.svg
119Allow: /en-gb/core/*.svg
120Allow: /en-au/core/*.svg
121Allow: /de/core/*.svg
122Allow: /ja/core/*.svg
123Allow: /fr/core/*.svg
124Allow: /es/core/*.svg
125Allow: /es-es/core/*.svg
126Allow: /it/core/*.svg
127Allow: /zh-hk/core/*.svg
128Allow: /ko/core/*.svg
129Allow: /pt-br/core/*.svg
130Allow: /nl/core/*.svg
131Allow: /th/core/*.svg
132Allow: /profiles/*.css$
133Allow: /en-gb/profiles/*.css$
134Allow: /en-au/profiles/*.css$
135Allow: /de/profiles/*.css$
136Allow: /ja/profiles/*.css$
137Allow: /fr/profiles/*.css$
138Allow: /es/profiles/*.css$
139Allow: /es-es/profiles/*.css$
140Allow: /it/profiles/*.css$
141Allow: /zh-hk/profiles/*.css$
142Allow: /ko/profiles/*.css$
143Allow: /pt-br/profiles/*.css$
144Allow: /nl/profiles/*.css$
145Allow: /th/profiles/*.css$
146Allow: /profiles/*.css?
147Allow: /en-gb/profiles/*.css?
148Allow: /en-au/profiles/*.css?
149Allow: /de/profiles/*.css?
150Allow: /ja/profiles/*.css?
151Allow: /fr/profiles/*.css?
152Allow: /es/profiles/*.css?
153Allow: /es-es/profiles/*.css?
154Allow: /it/profiles/*.css?
155Allow: /zh-hk/profiles/*.css?
156Allow: /ko/profiles/*.css?
157Allow: /pt-br/profiles/*.css?
158Allow: /nl/profiles/*.css?
159Allow: /th/profiles/*.css?
160Allow: /profiles/*.js$
161Allow: /en-gb/profiles/*.js$
162Allow: /en-au/profiles/*.js$
163Allow: /de/profiles/*.js$
164Allow: /ja/profiles/*.js$
165Allow: /fr/profiles/*.js$
166Allow: /es/profiles/*.js$
167Allow: /es-es/profiles/*.js$
168Allow: /it/profiles/*.js$
169Allow: /zh-hk/profiles/*.js$
170Allow: /ko/profiles/*.js$
171Allow: /pt-br/profiles/*.js$
172Allow: /nl/profiles/*.js$
173Allow: /th/profiles/*.js$
174Allow: /profiles/*.js?
175Allow: /en-gb/profiles/*.js?
176Allow: /en-au/profiles/*.js?
177Allow: /de/profiles/*.js?
178Allow: /ja/profiles/*.js?
179Allow: /fr/profiles/*.js?
180Allow: /es/profiles/*.js?
181Allow: /es-es/profiles/*.js?
182Allow: /it/profiles/*.js?
183Allow: /zh-hk/profiles/*.js?
184Allow: /ko/profiles/*.js?
185Allow: /pt-br/profiles/*.js?
186Allow: /nl/profiles/*.js?
187Allow: /th/profiles/*.js?
188Allow: /profiles/*.gif
189Allow: /en-gb/profiles/*.gif
190Allow: /en-au/profiles/*.gif
191Allow: /de/profiles/*.gif
192Allow: /ja/profiles/*.gif
193Allow: /fr/profiles/*.gif
194Allow: /es/profiles/*.gif
195Allow: /es-es/profiles/*.gif
196Allow: /it/profiles/*.gif
197Allow: /zh-hk/profiles/*.gif
198Allow: /ko/profiles/*.gif
199Allow: /pt-br/profiles/*.gif
200Allow: /nl/profiles/*.gif
201Allow: /th/profiles/*.gif
202Allow: /profiles/*.jpg
203Allow: /en-gb/profiles/*.jpg
204Allow: /en-au/profiles/*.jpg
205Allow: /de/profiles/*.jpg
206Allow: /ja/profiles/*.jpg
207Allow: /fr/profiles/*.jpg
208Allow: /es/profiles/*.jpg
209Allow: /es-es/profiles/*.jpg
210Allow: /it/profiles/*.jpg
211Allow: /zh-hk/profiles/*.jpg
212Allow: /ko/profiles/*.jpg
213Allow: /pt-br/profiles/*.jpg
214Allow: /nl/profiles/*.jpg
215Allow: /th/profiles/*.jpg
216Allow: /profiles/*.jpeg
217Allow: /en-gb/profiles/*.jpeg
218Allow: /en-au/profiles/*.jpeg
219Allow: /de/profiles/*.jpeg
220Allow: /ja/profiles/*.jpeg
221Allow: /fr/profiles/*.jpeg
222Allow: /es/profiles/*.jpeg
223Allow: /es-es/profiles/*.jpeg
224Allow: /it/profiles/*.jpeg
225Allow: /zh-hk/profiles/*.jpeg
226Allow: /ko/profiles/*.jpeg
227Allow: /pt-br/profiles/*.jpeg
228Allow: /nl/profiles/*.jpeg
229Allow: /th/profiles/*.jpeg
230Allow: /profiles/*.png
231Allow: /en-gb/profiles/*.png
232Allow: /en-au/profiles/*.png
233Allow: /de/profiles/*.png
234Allow: /ja/profiles/*.png
235Allow: /fr/profiles/*.png
236Allow: /es/profiles/*.png
237Allow: /es-es/profiles/*.png
238Allow: /it/profiles/*.png
239Allow: /zh-hk/profiles/*.png
240Allow: /ko/profiles/*.png
241Allow: /pt-br/profiles/*.png
242Allow: /nl/profiles/*.png
243Allow: /th/profiles/*.png
244Allow: /profiles/*.svg
245Allow: /en-gb/profiles/*.svg
246Allow: /en-au/profiles/*.svg
247Allow: /de/profiles/*.svg
248Allow: /ja/profiles/*.svg
249Allow: /fr/profiles/*.svg
250Allow: /es/profiles/*.svg
251Allow: /es-es/profiles/*.svg
252Allow: /it/profiles/*.svg
253Allow: /zh-hk/profiles/*.svg
254Allow: /ko/profiles/*.svg
255Allow: /pt-br/profiles/*.svg
256Allow: /nl/profiles/*.svg
257Allow: /th/profiles/*.svg
258#Directories
259Disallow: /core/
260Disallow: /en-gb/core/
261Disallow: /en-au/core/
262Disallow: /de/core/
263Disallow: /ja/core/
264Disallow: /fr/core/
265Disallow: /es/core/
266Disallow: /es-es/core/
267Disallow: /it/core/
268Disallow: /zh-hk/core/
269Disallow: /ko/core/
270Disallow: /pt-br/core/
271Disallow: /nl/core/
272Disallow: /th/core/
273Disallow: /profiles/
274Disallow: /en-gb/profiles/
275Disallow: /en-au/profiles/
276Disallow: /de/profiles/
277Disallow: /ja/profiles/
278Disallow: /fr/profiles/
279Disallow: /es/profiles/
280Disallow: /es-es/profiles/
281Disallow: /it/profiles/
282Disallow: /zh-hk/profiles/
283Disallow: /ko/profiles/
284Disallow: /pt-br/profiles/
285Disallow: /nl/profiles/
286Disallow: /th/profiles/
287#Files
288Disallow: /README.md
289Disallow: /en-gb/README.md
290Disallow: /en-au/README.md
291Disallow: /de/README.md
292Disallow: /ja/README.md
293Disallow: /fr/README.md
294Disallow: /es/README.md
295Disallow: /es-es/README.md
296Disallow: /it/README.md
297Disallow: /zh-hk/README.md
298Disallow: /ko/README.md
299Disallow: /pt-br/README.md
300Disallow: /nl/README.md
301Disallow: /th/README.md
302Disallow: /composer/Metapackage/README.txt
303Disallow: /en-gb/composer/Metapackage/README.txt
304Disallow: /en-au/composer/Metapackage/README.txt
305Disallow: /de/composer/Metapackage/README.txt
306Disallow: /ja/composer/Metapackage/README.txt
307Disallow: /fr/composer/Metapackage/README.txt
308Disallow: /es/composer/Metapackage/README.txt
309Disallow: /es-es/composer/Metapackage/README.txt
310Disallow: /it/composer/Metapackage/README.txt
311Disallow: /zh-hk/composer/Metapackage/README.txt
312Disallow: /ko/composer/Metapackage/README.txt
313Disallow: /pt-br/composer/Metapackage/README.txt
314Disallow: /nl/composer/Metapackage/README.txt
315Disallow: /th/composer/Metapackage/README.txt
316Disallow: /composer/Plugin/ProjectMessage/README.md
317Disallow: /en-gb/composer/Plugin/ProjectMessage/README.md
318Disallow: /en-au/composer/Plugin/ProjectMessage/README.md
319Disallow: /de/composer/Plugin/ProjectMessage/README.md
320Disallow: /ja/composer/Plugin/ProjectMessage/README.md
321Disallow: /fr/composer/Plugin/ProjectMessage/README.md
322Disallow: /es/composer/Plugin/ProjectMessage/README.md
323Disallow: /es-es/composer/Plugin/ProjectMessage/README.md
324Disallow: /it/composer/Plugin/ProjectMessage/README.md
325Disallow: /zh-hk/composer/Plugin/ProjectMessage/README.md
326Disallow: /ko/composer/Plugin/ProjectMessage/README.md
327Disallow: /pt-br/composer/Plugin/ProjectMessage/README.md
328Disallow: /nl/composer/Plugin/ProjectMessage/README.md
329Disallow: /th/composer/Plugin/ProjectMessage/README.md
330Disallow: /composer/Plugin/Scaffold/README.md
331Disallow: /en-gb/composer/Plugin/Scaffold/README.md
332Disallow: /en-au/composer/Plugin/Scaffold/README.md
333Disallow: /de/composer/Plugin/Scaffold/README.md
334Disallow: /ja/composer/Plugin/Scaffold/README.md
335Disallow: /fr/composer/Plugin/Scaffold/README.md
336Disallow: /es/composer/Plugin/Scaffold/README.md
337Disallow: /es-es/composer/Plugin/Scaffold/README.md
338Disallow: /it/composer/Plugin/Scaffold/README.md
339Disallow: /zh-hk/composer/Plugin/Scaffold/README.md
340Disallow: /ko/composer/Plugin/Scaffold/README.md
341Disallow: /pt-br/composer/Plugin/Scaffold/README.md
342Disallow: /nl/composer/Plugin/Scaffold/README.md
343Disallow: /th/composer/Plugin/Scaffold/README.md
344Disallow: /composer/Plugin/VendorHardening/README.txt
345Disallow: /en-gb/composer/Plugin/VendorHardening/README.txt
346Disallow: /en-au/composer/Plugin/VendorHardening/README.txt
347Disallow: /de/composer/Plugin/VendorHardening/README.txt
348Disallow: /ja/composer/Plugin/VendorHardening/README.txt
349Disallow: /fr/composer/Plugin/VendorHardening/README.txt
350Disallow: /es/composer/Plugin/VendorHardening/README.txt
351Disallow: /es-es/composer/Plugin/VendorHardening/README.txt
352Disallow: /it/composer/Plugin/VendorHardening/README.txt
353Disallow: /zh-hk/composer/Plugin/VendorHardening/README.txt
354Disallow: /ko/composer/Plugin/VendorHardening/README.txt
355Disallow: /pt-br/composer/Plugin/VendorHardening/README.txt
356Disallow: /nl/composer/Plugin/VendorHardening/README.txt
357Disallow: /th/composer/Plugin/VendorHardening/README.txt
358Disallow: /composer/Template/README.txt
359Disallow: /en-gb/composer/Template/README.txt
360Disallow: /en-au/composer/Template/README.txt
361Disallow: /de/composer/Template/README.txt
362Disallow: /ja/composer/Template/README.txt
363Disallow: /fr/composer/Template/README.txt
364Disallow: /es/composer/Template/README.txt
365Disallow: /es-es/composer/Template/README.txt
366Disallow: /it/composer/Template/README.txt
367Disallow: /zh-hk/composer/Template/README.txt
368Disallow: /ko/composer/Template/README.txt
369Disallow: /pt-br/composer/Template/README.txt
370Disallow: /nl/composer/Template/README.txt
371Disallow: /th/composer/Template/README.txt
372Disallow: /modules/README.txt
373Disallow: /en-gb/modules/README.txt
374Disallow: /en-au/modules/README.txt
375Disallow: /de/modules/README.txt
376Disallow: /ja/modules/README.txt
377Disallow: /fr/modules/README.txt
378Disallow: /es/modules/README.txt
379Disallow: /es-es/modules/README.txt
380Disallow: /it/modules/README.txt
381Disallow: /zh-hk/modules/README.txt
382Disallow: /ko/modules/README.txt
383Disallow: /pt-br/modules/README.txt
384Disallow: /nl/modules/README.txt
385Disallow: /th/modules/README.txt
386Disallow: /sites/README.txt
387Disallow: /en-gb/sites/README.txt
388Disallow: /en-au/sites/README.txt
389Disallow: /de/sites/README.txt
390Disallow: /ja/sites/README.txt
391Disallow: /fr/sites/README.txt
392Disallow: /es/sites/README.txt
393Disallow: /es-es/sites/README.txt
394Disallow: /it/sites/README.txt
395Disallow: /zh-hk/sites/README.txt
396Disallow: /ko/sites/README.txt
397Disallow: /pt-br/sites/README.txt
398Disallow: /nl/sites/README.txt
399Disallow: /th/sites/README.txt
400Disallow: /themes/README.txt
401Disallow: /en-gb/themes/README.txt
402Disallow: /en-au/themes/README.txt
403Disallow: /de/themes/README.txt
404Disallow: /ja/themes/README.txt
405Disallow: /fr/themes/README.txt
406Disallow: /es/themes/README.txt
407Disallow: /es-es/themes/README.txt
408Disallow: /it/themes/README.txt
409Disallow: /zh-hk/themes/README.txt
410Disallow: /ko/themes/README.txt
411Disallow: /pt-br/themes/README.txt
412Disallow: /nl/themes/README.txt
413Disallow: /th/themes/README.txt
414Disallow: /web.config
415Disallow: /en-gb/web.config
416Disallow: /en-au/web.config
417Disallow: /de/web.config
418Disallow: /ja/web.config
419Disallow: /fr/web.config
420Disallow: /es/web.config
421Disallow: /es-es/web.config
422Disallow: /it/web.config
423Disallow: /zh-hk/web.config
424Disallow: /ko/web.config
425Disallow: /pt-br/web.config
426Disallow: /nl/web.config
427Disallow: /th/web.config
428# Paths (clean URLs)
429Disallow: /admin/
430Disallow: /en-gb/admin/
431Disallow: /en-au/admin/
432Disallow: /de/admin/
433Disallow: /ja/admin/
434Disallow: /fr/admin/
435Disallow: /es/admin/
436Disallow: /es-es/admin/
437Disallow: /it/admin/
438Disallow: /zh-hk/admin/
439Disallow: /ko/admin/
440Disallow: /pt-br/admin/
441Disallow: /nl/admin/
442Disallow: /th/admin/
443Disallow: /comment/reply/
444Disallow: /en-gb/comment/reply/
445Disallow: /en-au/comment/reply/
446Disallow: /de/comment/reply/
447Disallow: /ja/comment/reply/
448Disallow: /fr/comment/reply/
449Disallow: /es/comment/reply/
450Disallow: /es-es/comment/reply/
451Disallow: /it/comment/reply/
452Disallow: /zh-hk/comment/reply/
453Disallow: /ko/comment/reply/
454Disallow: /pt-br/comment/reply/
455Disallow: /nl/comment/reply/
456Disallow: /th/comment/reply/
457Disallow: /filter/tips
458Disallow: /en-gb/filter/tips
459Disallow: /en-au/filter/tips
460Disallow: /de/filter/tips
461Disallow: /ja/filter/tips
462Disallow: /fr/filter/tips
463Disallow: /es/filter/tips
464Disallow: /es-es/filter/tips
465Disallow: /it/filter/tips
466Disallow: /zh-hk/filter/tips
467Disallow: /ko/filter/tips
468Disallow: /pt-br/filter/tips
469Disallow: /nl/filter/tips
470Disallow: /th/filter/tips
471Disallow: /node/*
472Disallow: /en-gb/node/*
473Disallow: /en-au/node/*
474Disallow: /de/node/*
475Disallow: /ja/node/*
476Disallow: /fr/node/*
477Disallow: /es/node/*
478Disallow: /es-es/node/*
479Disallow: /it/node/*
480Disallow: /zh-hk/node/*
481Disallow: /ko/node/*
482Disallow: /pt-br/node/*
483Disallow: /nl/node/*
484Disallow: /th/node/*
485Disallow: /search/
486Disallow: /en-gb/search/
487Disallow: /en-au/search/
488Disallow: /de/search/
489Disallow: /ja/search/
490Disallow: /fr/search/
491Disallow: /es/search/
492Disallow: /es-es/search/
493Disallow: /it/search/
494Disallow: /zh-hk/search/
495Disallow: /ko/search/
496Disallow: /pt-br/search/
497Disallow: /nl/search/
498Disallow: /th/search/
499Disallow: /user/register
500Disallow: /en-gb/user/register
501Disallow: /en-au/user/register
502Disallow: /de/user/register
503Disallow: /ja/user/register
504Disallow: /fr/user/register
505Disallow: /es/user/register
506Disallow: /es-es/user/register
507Disallow: /it/user/register
508Disallow: /zh-hk/user/register
509Disallow: /ko/user/register
510Disallow: /pt-br/user/register
511Disallow: /nl/user/register
512Disallow: /th/user/register
513Disallow: /user/password
514Disallow: /en-gb/user/password
515Disallow: /en-au/user/password
516Disallow: /de/user/password
517Disallow: /ja/user/password
518Disallow: /fr/user/password
519Disallow: /es/user/password
520Disallow: /es-es/user/password
521Disallow: /it/user/password
522Disallow: /zh-hk/user/password
523Disallow: /ko/user/password
524Disallow: /pt-br/user/password
525Disallow: /nl/user/password
526Disallow: /th/user/password
527Disallow: /user/login
528Disallow: /en-gb/user/login
529Disallow: /en-au/user/login
530Disallow: /de/user/login
531Disallow: /ja/user/login
532Disallow: /fr/user/login
533Disallow: /es/user/login
534Disallow: /es-es/user/login
535Disallow: /it/user/login
536Disallow: /zh-hk/user/login
537Disallow: /ko/user/login
538Disallow: /pt-br/user/login
539Disallow: /nl/user/login
540Disallow: /th/user/login
541Disallow: /user/logout
542Disallow: /en-gb/user/logout
543Disallow: /en-au/user/logout
544Disallow: /de/user/logout
545Disallow: /ja/user/logout
546Disallow: /fr/user/logout
547Disallow: /es/user/logout
548Disallow: /es-es/user/logout
549Disallow: /it/user/logout
550Disallow: /zh-hk/user/logout
551Disallow: /ko/user/logout
552Disallow: /pt-br/user/logout
553Disallow: /nl/user/logout
554Disallow: /th/user/logout
555Disallow: /media/oembed
556Disallow: /en-gb/media/oembed
557Disallow: /en-au/media/oembed
558Disallow: /de/media/oembed
559Disallow: /ja/media/oembed
560Disallow: /fr/media/oembed
561Disallow: /es/media/oembed
562Disallow: /es-es/media/oembed
563Disallow: /it/media/oembed
564Disallow: /zh-hk/media/oembed
565Disallow: /ko/media/oembed
566Disallow: /pt-br/media/oembed
567Disallow: /nl/media/oembed
568Disallow: /th/media/oembed
569Disallow: /*/media/oembed
570Disallow: /en-gb/*/media/oembed
571Disallow: /en-au/*/media/oembed
572Disallow: /de/*/media/oembed
573Disallow: /ja/*/media/oembed
574Disallow: /fr/*/media/oembed
575Disallow: /es/*/media/oembed
576Disallow: /es-es/*/media/oembed
577Disallow: /it/*/media/oembed
578Disallow: /zh-hk/*/media/oembed
579Disallow: /ko/*/media/oembed
580Disallow: /pt-br/*/media/oembed
581Disallow: /nl/*/media/oembed
582Disallow: /th/*/media/oembed
583# Paths (no clean URLs)
584Disallow: /index.php/admin/
585Disallow: /en-gb/index.php/admin/
586Disallow: /en-au/index.php/admin/
587Disallow: /de/index.php/admin/
588Disallow: /ja/index.php/admin/
589Disallow: /fr/index.php/admin/
590Disallow: /es/index.php/admin/
591Disallow: /es-es/index.php/admin/
592Disallow: /it/index.php/admin/
593Disallow: /zh-hk/index.php/admin/
594Disallow: /ko/index.php/admin/
595Disallow: /pt-br/index.php/admin/
596Disallow: /nl/index.php/admin/
597Disallow: /th/index.php/admin/
598Disallow: /index.php/comment/reply/
599Disallow: /en-gb/index.php/comment/reply/
600Disallow: /en-au/index.php/comment/reply/
601Disallow: /de/index.php/comment/reply/
602Disallow: /ja/index.php/comment/reply/
603Disallow: /fr/index.php/comment/reply/
604Disallow: /es/index.php/comment/reply/
605Disallow: /es-es/index.php/comment/reply/
606Disallow: /it/index.php/comment/reply/
607Disallow: /zh-hk/index.php/comment/reply/
608Disallow: /ko/index.php/comment/reply/
609Disallow: /pt-br/index.php/comment/reply/
610Disallow: /nl/index.php/comment/reply/
611Disallow: /th/index.php/comment/reply/
612Disallow: /index.php/filter/tips
613Disallow: /en-gb/index.php/filter/tips
614Disallow: /en-au/index.php/filter/tips
615Disallow: /de/index.php/filter/tips
616Disallow: /ja/index.php/filter/tips
617Disallow: /fr/index.php/filter/tips
618Disallow: /es/index.php/filter/tips
619Disallow: /es-es/index.php/filter/tips
620Disallow: /it/index.php/filter/tips
621Disallow: /zh-hk/index.php/filter/tips
622Disallow: /ko/index.php/filter/tips
623Disallow: /pt-br/index.php/filter/tips
624Disallow: /nl/index.php/filter/tips
625Disallow: /th/index.php/filter/tips
626Disallow: /index.php/node/*
627Disallow: /en-gb/index.php/node/*
628Disallow: /en-au/index.php/node/*
629Disallow: /de/index.php/node/*
630Disallow: /ja/index.php/node/*
631Disallow: /fr/index.php/node/*
632Disallow: /es/index.php/node/*
633Disallow: /es-es/index.php/node/*
634Disallow: /it/index.php/node/*
635Disallow: /zh-hk/index.php/node/*
636Disallow: /ko/index.php/node/*
637Disallow: /pt-br/index.php/node/*
638Disallow: /nl/index.php/node/*
639Disallow: /th/index.php/node/*
640Disallow: /index.php/search/
641Disallow: /en-gb/index.php/search/
642Disallow: /en-au/index.php/search/
643Disallow: /de/index.php/search/
644Disallow: /ja/index.php/search/
645Disallow: /fr/index.php/search/
646Disallow: /es/index.php/search/
647Disallow: /es-es/index.php/search/
648Disallow: /it/index.php/search/
649Disallow: /zh-hk/index.php/search/
650Disallow: /ko/index.php/search/
651Disallow: /pt-br/index.php/search/
652Disallow: /nl/index.php/search/
653Disallow: /th/index.php/search/
654Disallow: /index.php/user/password
655Disallow: /en-gb/index.php/user/password
656Disallow: /en-au/index.php/user/password
657Disallow: /de/index.php/user/password
658Disallow: /ja/index.php/user/password
659Disallow: /fr/index.php/user/password
660Disallow: /es/index.php/user/password
661Disallow: /es-es/index.php/user/password
662Disallow: /it/index.php/user/password
663Disallow: /zh-hk/index.php/user/password
664Disallow: /ko/index.php/user/password
665Disallow: /pt-br/index.php/user/password
666Disallow: /nl/index.php/user/password
667Disallow: /th/index.php/user/password
668Disallow: /index.php/user/register
669Disallow: /en-gb/index.php/user/register
670Disallow: /en-au/index.php/user/register
671Disallow: /de/index.php/user/register
672Disallow: /ja/index.php/user/register
673Disallow: /fr/index.php/user/register
674Disallow: /es/index.php/user/register
675Disallow: /es-es/index.php/user/register
676Disallow: /it/index.php/user/register
677Disallow: /zh-hk/index.php/user/register
678Disallow: /ko/index.php/user/register
679Disallow: /pt-br/index.php/user/register
680Disallow: /nl/index.php/user/register
681Disallow: /th/index.php/user/register
682Disallow: /index.php/user/login
683Disallow: /en-gb/index.php/user/login
684Disallow: /en-au/index.php/user/login
685Disallow: /de/index.php/user/login
686Disallow: /ja/index.php/user/login
687Disallow: /fr/index.php/user/login
688Disallow: /es/index.php/user/login
689Disallow: /es-es/index.php/user/login
690Disallow: /it/index.php/user/login
691Disallow: /zh-hk/index.php/user/login
692Disallow: /ko/index.php/user/login
693Disallow: /pt-br/index.php/user/login
694Disallow: /nl/index.php/user/login
695Disallow: /th/index.php/user/login
696Disallow: /index.php/user/logout
697Disallow: /en-gb/index.php/user/logout
698Disallow: /en-au/index.php/user/logout
699Disallow: /de/index.php/user/logout
700Disallow: /ja/index.php/user/logout
701Disallow: /fr/index.php/user/logout
702Disallow: /es/index.php/user/logout
703Disallow: /es-es/index.php/user/logout
704Disallow: /it/index.php/user/logout
705Disallow: /zh-hk/index.php/user/logout
706Disallow: /ko/index.php/user/logout
707Disallow: /pt-br/index.php/user/logout
708Disallow: /nl/index.php/user/logout
709Disallow: /th/index.php/user/logout
710Disallow: /index.php/media/oembed
711Disallow: /en-gb/index.php/media/oembed
712Disallow: /en-au/index.php/media/oembed
713Disallow: /de/index.php/media/oembed
714Disallow: /ja/index.php/media/oembed
715Disallow: /fr/index.php/media/oembed
716Disallow: /es/index.php/media/oembed
717Disallow: /es-es/index.php/media/oembed
718Disallow: /it/index.php/media/oembed
719Disallow: /zh-hk/index.php/media/oembed
720Disallow: /ko/index.php/media/oembed
721Disallow: /pt-br/index.php/media/oembed
722Disallow: /nl/index.php/media/oembed
723Disallow: /th/index.php/media/oembed
724Disallow: /index.php/*/media/oembed
725Disallow: /en-gb/index.php/*/media/oembed
726Disallow: /en-au/index.php/*/media/oembed
727Disallow: /de/index.php/*/media/oembed
728Disallow: /ja/index.php/*/media/oembed
729Disallow: /fr/index.php/*/media/oembed
730Disallow: /es/index.php/*/media/oembed
731Disallow: /es-es/index.php/*/media/oembed
732Disallow: /it/index.php/*/media/oembed
733Disallow: /zh-hk/index.php/*/media/oembed
734Disallow: /ko/index.php/*/media/oembed
735Disallow: /pt-br/index.php/*/media/oembed
736Disallow: /nl/index.php/*/media/oembed
737Disallow: /th/index.php/*/media/oembed
738#Support site
739Disallow: /support/tag/*
740Disallow: /en-gb/support/tag/*
741Disallow: /en-au/support/tag/*
742Disallow: /de/support/tag/*
743Disallow: /ja/support/tag/*
744Disallow: /fr/support/tag/*
745Disallow: /es/support/tag/*
746Disallow: /es-es/support/tag/*
747Disallow: /it/support/tag/*
748Disallow: /zh-hk/support/tag/*
749Disallow: /ko/support/tag/*
750Disallow: /pt-br/support/tag/*
751Disallow: /nl/support/tag/*
752Disallow: /th/support/tag/*
753Disallow: /support/category/*
754Disallow: /en-gb/support/category/*
755Disallow: /en-au/support/category/*
756Disallow: /de/support/category/*
757Disallow: /ja/support/category/*
758Disallow: /fr/support/category/*
759Disallow: /es/support/category/*
760Disallow: /es-es/support/category/*
761Disallow: /it/support/category/*
762Disallow: /zh-hk/support/category/*
763Disallow: /ko/support/category/*
764Disallow: /pt-br/support/category/*
765Disallow: /nl/support/category/*
766Disallow: /th/support/category/*
767Disallow: /support/custom_resource/*
768Disallow: /en-gb/support/custom_resource/*
769Disallow: /en-au/support/custom_resource/*
770Disallow: /de/support/custom_resource/*
771Disallow: /ja/support/custom_resource/*
772Disallow: /fr/support/custom_resource/*
773Disallow: /es/support/custom_resource/*
774Disallow: /es-es/support/custom_resource/*
775Disallow: /it/support/custom_resource/*
776Disallow: /zh-hk/support/custom_resource/*
777Disallow: /ko/support/custom_resource/*
778Disallow: /pt-br/support/custom_resource/*
779Disallow: /nl/support/custom_resource/*
780Disallow: /th/support/custom_resource/*
781Disallow: /custom_banner/*
782Disallow: /en-gb/custom_banner/*
783Disallow: /en-au/custom_banner/*
784Disallow: /de/custom_banner/*
785Disallow: /ja/custom_banner/*
786Disallow: /fr/custom_banner/*
787Disallow: /es/custom_banner/*
788Disallow: /es-es/custom_banner/*
789Disallow: /it/custom_banner/*
790Disallow: /zh-hk/custom_banner/*
791Disallow: /ko/custom_banner/*
792Disallow: /pt-br/custom_banner/*
793Disallow: /nl/custom_banner/*
794Disallow: /th/custom_banner/*
795Disallow: /support/search/*
796Disallow: /en-gb/support/search/*
797Disallow: /en-au/support/search/*
798Disallow: /de/support/search/*
799Disallow: /ja/support/search/*
800Disallow: /fr/support/search/*
801Disallow: /es/support/search/*
802Disallow: /es-es/support/search/*
803Disallow: /it/support/search/*
804Disallow: /zh-hk/support/search/*
805Disallow: /ko/support/search/*
806Disallow: /pt-br/support/search/*
807Disallow: /nl/support/search/*
808Disallow: /th/support/search/*
809#WP rules
810Disallow: */feed/
811Disallow: */rss2/
812Disallow: /blog/search/
813Disallow: /en-gb/blog/search/
814Disallow: /en-au/blog/search/
815Disallow: /de/blog/search/
816Disallow: /ja/blog/search/
817Disallow: /fr/blog/search/
818Disallow: /es/blog/search/
819Disallow: /es-es/blog/search/
820Disallow: /it/blog/search/
821Disallow: /zh-hk/blog/search/
822Disallow: /ko/blog/search/
823Disallow: /pt-br/blog/search/
824Disallow: /nl/blog/search/
825Disallow: /th/blog/search/
826Disallow: /blog/topic/
827Disallow: /en-gb/blog/topic/
828Disallow: /en-au/blog/topic/
829Disallow: /de/blog/topic/
830Disallow: /ja/blog/topic/
831Disallow: /fr/blog/topic/
832Disallow: /es/blog/topic/
833Disallow: /es-es/blog/topic/
834Disallow: /it/blog/topic/
835Disallow: /zh-hk/blog/topic/
836Disallow: /ko/blog/topic/
837Disallow: /pt-br/blog/topic/
838Disallow: /nl/blog/topic/
839Disallow: /th/blog/topic/
840#Content rules per crawley
841Disallow: /docs/
842Disallow: /en-gb/docs/
843Disallow: /en-au/docs/
844Disallow: /de/docs/
845Disallow: /ja/docs/
846Disallow: /fr/docs/
847Disallow: /es/docs/
848Disallow: /es-es/docs/
849Disallow: /it/docs/
850Disallow: /zh-hk/docs/
851Disallow: /ko/docs/
852Disallow: /pt-br/docs/
853Disallow: /nl/docs/
854Disallow: /th/docs/
855Disallow: /m/assets/wp-content/uploads/*.pdf
856Disallow: /en-gb/m/assets/wp-content/uploads/*.pdf
857Disallow: /en-au/m/assets/wp-content/uploads/*.pdf
858Disallow: /de/m/assets/wp-content/uploads/*.pdf
859Disallow: /ja/m/assets/wp-content/uploads/*.pdf
860Disallow: /fr/m/assets/wp-content/uploads/*.pdf
861Disallow: /es/m/assets/wp-content/uploads/*.pdf
862Disallow: /es-es/m/assets/wp-content/uploads/*.pdf
863Disallow: /it/m/assets/wp-content/uploads/*.pdf
864Disallow: /zh-hk/m/assets/wp-content/uploads/*.pdf
865Disallow: /ko/m/assets/wp-content/uploads/*.pdf
866Disallow: /pt-br/m/assets/wp-content/uploads/*.pdf
867Disallow: /nl/m/assets/wp-content/uploads/*.pdf
868Disallow: /th/m/assets/wp-content/uploads/*.pdf
869#In product frames
870Disallow: /in-product/
871Disallow: /en-gb/in-product/
872Disallow: /en-au/in-product/
873Disallow: /de/in-product/
874Disallow: /ja/in-product/
875Disallow: /fr/in-product/
876Disallow: /es/in-product/
877Disallow: /es-es/in-product/
878Disallow: /it/in-product/
879Disallow: /zh-hk/in-product/
880Disallow: /ko/in-product/
881Disallow: /pt-br/in-product/
882Disallow: /nl/in-product/
883Disallow: /th/in-product/
884Disallow: /total-leadership/
885Disallow: /en-gb/total-leadership/
886Disallow: /en-au/total-leadership/
887Disallow: /de/total-leadership/
888Disallow: /ja/total-leadership/
889Disallow: /fr/total-leadership/
890Disallow: /es/total-leadership/
891Disallow: /es-es/total-leadership/
892Disallow: /it/total-leadership/
893Disallow: /zh-hk/total-leadership/
894Disallow: /ko/total-leadership/
895Disallow: /pt-br/total-leadership/
896Disallow: /nl/total-leadership/
897Disallow: /th/total-leadership/
898#Campaign and ABM pages
899Disallow: /hidden/
900Disallow: /en-gb/hidden/
901Disallow: /en-au/hidden/
902Disallow: /de/hidden/
903Disallow: /ja/hidden/
904Disallow: /fr/hidden/
905Disallow: /es/hidden/
906Disallow: /es-es/hidden/
907Disallow: /it/hidden/
908Disallow: /zh-hk/hidden/
909Disallow: /ko/hidden/
910Disallow: /pt-br/hidden/
911Disallow: /nl/hidden/
912Disallow: /th/hidden/
913#Careers staging site
914Disallow: /phenom/
915Disallow: /en-gb/phenom/
916Disallow: /en-au/phenom/
917Disallow: /de/phenom/
918Disallow: /ja/phenom/
919Disallow: /fr/phenom/
920Disallow: /es/phenom/
921Disallow: /es-es/phenom/
922Disallow: /it/phenom/
923Disallow: /zh-hk/phenom/
924Disallow: /ko/phenom/
925Disallow: /pt-br/phenom/
926Disallow: /nl/phenom/
927Disallow: /th/phenom/
928#General no follow paths
929Disallow: /no-follow/*
930Disallow: /en-gb/no-follow/*
931Disallow: /en-au/no-follow/*
932Disallow: /de/no-follow/*
933Disallow: /ja/no-follow/*
934Disallow: /fr/no-follow/*
935Disallow: /es/no-follow/*
936Disallow: /es-es/no-follow/*
937Disallow: /it/no-follow/*
938Disallow: /zh-hk/no-follow/*
939Disallow: /ko/no-follow/*
940Disallow: /pt-br/no-follow/*
941Disallow: /nl/no-follow/*
942Disallow: /th/no-follow/*
943Disallow: /media/*
944Disallow: /en-gb/media/*
945Disallow: /en-au/media/*
946Disallow: /de/media/*
947Disallow: /ja/media/*
948Disallow: /fr/media/*
949Disallow: /es/media/*
950Disallow: /es-es/media/*
951Disallow: /it/media/*
952Disallow: /zh-hk/media/*
953Disallow: /ko/media/*
954Disallow: /pt-br/media/*
955Disallow: /nl/media/*
956Disallow: /th/media/*
957Disallow: /admin/*
958Disallow: /en-gb/admin/*
959Disallow: /en-au/admin/*
960Disallow: /de/admin/*
961Disallow: /ja/admin/*
962Disallow: /fr/admin/*
963Disallow: /es/admin/*
964Disallow: /es-es/admin/*
965Disallow: /it/admin/*
966Disallow: /zh-hk/admin/*
967Disallow: /ko/admin/*
968Disallow: /pt-br/admin/*
969Disallow: /nl/admin/*
970Disallow: /th/admin/*
971Disallow: /page-not-found/
972Disallow: /en-gb/page-not-found/
973Disallow: /en-au/page-not-found/
974Disallow: /de/page-not-found/
975Disallow: /ja/page-not-found/
976Disallow: /fr/page-not-found/
977Disallow: /es/page-not-found/
978Disallow: /es-es/page-not-found/
979Disallow: /it/page-not-found/
980Disallow: /zh-hk/page-not-found/
981Disallow: /ko/page-not-found/
982Disallow: /pt-br/page-not-found/
983Disallow: /nl/page-not-found/
984Disallow: /th/page-not-found/
985Disallow: /404-page-not-found/
986Disallow: /en-gb/404-page-not-found/
987Disallow: /en-au/404-page-not-found/
988Disallow: /de/404-page-not-found/
989Disallow: /ja/404-page-not-found/
990Disallow: /fr/404-page-not-found/
991Disallow: /es/404-page-not-found/
992Disallow: /es-es/404-page-not-found/
993Disallow: /it/404-page-not-found/
994Disallow: /zh-hk/404-page-not-found/
995Disallow: /ko/404-page-not-found/
996Disallow: /pt-br/404-page-not-found/
997Disallow: /nl/404-page-not-found/
998Disallow: /th/404-page-not-found/
999Disallow: /403-forbidden/
1000Disallow: /en-gb/403-forbidden/
1001Disallow: /en-au/403-forbidden/
1002Disallow: /de/403-forbidden/
1003Disallow: /ja/403-forbidden/
1004Disallow: /fr/403-forbidden/
1005Disallow: /es/403-forbidden/
1006Disallow: /es-es/403-forbidden/
1007Disallow: /it/403-forbidden/
1008Disallow: /zh-hk/403-forbidden/
1009Disallow: /ko/403-forbidden/
1010Disallow: /pt-br/403-forbidden/
1011Disallow: /nl/403-forbidden/
1012Disallow: /th/403-forbidden/
1013Sitemap: https://www.qualtrics.com/sitemaps/index/sitemap.xml
What do the bots actually get?
This page reads robots.txt, which states what qualtrics.com asks of crawlers. A firewall or CDN can still refuse a bot that robots.txt allows. The live check requests the page as each bot and shows the status it gets.
Run a live check on qualtrics.com Test a path in the robots.txt tester
History
- 19 October 2026: first checked.
Questions
Does qualtrics.com block GPTBot?
No. qualtrics.com’s robots.txt lets GPTBot crawl the site. GPTBot is OpenAI’s crawler for training data; blocking it doesn’t affect ChatGPT search, which uses OAI-SearchBot. Checked 9 November 2026.
Does qualtrics.com block ClaudeBot?
No. qualtrics.com’s robots.txt lets ClaudeBot crawl the site. ClaudeBot is Anthropic’s crawler for training data. Checked 9 November 2026.
Does qualtrics.com block Google-Extended?
No. qualtrics.com’s robots.txt lets Google-Extended crawl the site. Google-Extended is the token that controls whether Google may use pages for Gemini training and grounding; it doesn’t affect Google Search. Checked 9 November 2026.
Does qualtrics.com block PerplexityBot?
No. qualtrics.com’s robots.txt lets PerplexityBot crawl the site. PerplexityBot is the crawler that indexes pages for Perplexity’s answers. Checked 9 November 2026.
Can ChatGPT search find qualtrics.com?
Yes. qualtrics.com’s robots.txt lets OAI-SearchBot crawl the site. OAI-SearchBot is the crawler behind ChatGPT search; blocking it keeps the site out of ChatGPT’s search answers. Checked 9 November 2026.