Who blocks AI · #259 in the Majestic Million
robots.txt · checked 9 Nov 2026
Does dailymotion.com block AI crawlers?
No. dailymotion.com’s robots.txt lets all 19 AI crawlers we track crawl the site. Search engines such as Googlebot and Bingbot may crawl it.
GPTBotAllowedOAI-SearchBotAllowedClaudeBotAllowedPerplexityBotAllowedGoogle-ExtendedAllowedCCBotAllowed- robots.txt
- www.dailymotion.com/robots.txt · 774 lines
- llms.txt
- found
- Checked
- 9 November 2026, as canaicrawl. We check again every week.
Every bot, and the line that decides
Search engines
| Bot | Operator | robots.txt | Deciding line |
|---|---|---|---|
Googlebot | Partly blocked | line 113 · Disallow: /a/* line 114 · Disallow: /abuse/group/ and 105 more | |
Bingbot | Microsoft | Allowed | no rule matches the home page |
DuckDuckBot | DuckDuckGo | Allowed | no rule matches the home page |
Applebot | Apple | Partly blocked | line 113 · Disallow: /a/* line 114 · Disallow: /abuse/group/ and 105 more |
PetalBot | Huawei | Allowed | no rule matches the home page |
YandexBot | Yandex | Partly blocked | line 325 · Disallow: /a/* line 326 · Disallow: /abuse/group/ and 104 more |
Baiduspider | Baidu | Allowed | no rule matches the home page |
AI search
| Bot | Operator | robots.txt | Deciding line |
|---|---|---|---|
OAI-SearchBot | OpenAI | Allowed | no rule matches the home page |
PerplexityBot | Perplexity | Allowed | no rule matches the home page |
Claude-SearchBot | Anthropic | Allowed | no rule matches the home page |
DuckAssistBot | DuckDuckGo | Allowed | no rule matches the home page |
Amazonbot | Amazon | Allowed | no rule matches the home page |
YouBot | You.com | Allowed | no rule matches the home page |
AI training
| Bot | Operator | robots.txt | Deciding line |
|---|---|---|---|
GPTBot | OpenAI | Allowed | no rule matches the home page |
ClaudeBot | Anthropic | Allowed | no rule matches the home page |
Google-Extended | Allowed | no rule matches the home page | |
CCBot | Common Crawl | Allowed | no rule matches the home page |
Applebot-Extended | Apple | Allowed | no rule matches the home page |
GoogleOther | Allowed | no rule matches the home page | |
Meta-ExternalAgent | Meta | Allowed | no rule matches the home page |
Bytespider | ByteDance | Allowed | no rule matches the home page |
User-triggered fetchers
| Bot | Operator | robots.txt | Deciding line |
|---|---|---|---|
ChatGPT-User | OpenAI | Allowed | no rule matches the home page |
Claude-User | Anthropic | Allowed | no rule matches the home page |
Perplexity-User | Perplexity | Allowed | no rule matches the home page |
MistralAI-User | Mistral | Allowed | no rule matches the home page |
Meta-ExternalFetcher | Meta | Allowed | no rule matches the home page |
SEO tools
| Bot | Operator | robots.txt | Deciding line |
|---|---|---|---|
AhrefsBot | Ahrefs | Allowed | no rule matches the home page |
SemrushBot | Semrush | Allowed | no rule matches the home page |
MJ12bot | Majestic | Allowed | no rule matches the home page |
DotBot | Moz | Allowed | no rule matches the home page |
View www.dailymotion.com/robots.txt · 774 lines
1User-agent: *
2Disallow: /a/*
3Disallow: /abuse/group/
4Disallow: /activate
5Disallow: */adfit/*
6Disallow: /ajax/user
7Disallow: */alphaaz/
8Disallow: */alphaza/
9Disallow: */bookmarks/
10Disallow: /controller/
11Disallow: */cookie/dmaid/*
12Disallow: */country/
13Disallow: */created-after/
14Disallow: */creative-official+internal/
15Disallow: /edit/
16Disallow: */edited/
17Disallow: /factory/
18Disallow: /family_filter
19Disallow: */featured/*
20Disallow: */featuredby/
21Disallow: /followers/
22Disallow: */group/*
23Disallow: /group/terms/
24Disallow: /groups/active/user/
25Disallow: /groups/user/
26Disallow: /history/log/
27Disallow: */internal+no-explicit/
28Disallow: /json/
29Disallow: */lang/
30Disallow: */least/
31Disallow: */library/*
32Disallow: /logger/
33Disallow: /middle
34Disallow: */most/
35Disallow: */mychannel/
36Disallow: */official+internal/
37Disallow: */official/*
38Disallow: /page/html/
39Disallow: /pageitem/
40Disallow: /password/*
41Disallow: /player/metadata/video/
42Disallow: /playlists/*/user/
43Disallow: */playlists/relevance/*
44Disallow: */popular/*/channel/
45Disallow: */popular-month/*
46Disallow: */popular-month/*/channel/
47Disallow: */popular-week/*
48Disallow: */popular-week/*/channel/
49Disallow: /promote/
50Disallow: */random/
51Disallow: /register/*
52Disallow: */related/
53Disallow: /rss/
54Disallow: */search/
55Disallow: */settings/*
56Disallow: /signin
57Disallow: */signin
58Disallow: */skip-video/
59Disallow: */stag/
60Disallow: */subscribedto/
61Disallow: /subscriptions/
62Disallow: */tag/
63Disallow: */trending/*
64Disallow: /&tid=generator
65Disallow: /user/*/channel/
66Disallow: */user_list/
67Disallow: */users/group/
68Disallow: */users/*/group/
69Disallow: */users/popular-week/
70Disallow: /_v1st
71Disallow: /video/edit
72Disallow: */vids/*
73Disallow: */visited/group/
74Disallow: */visited/*/group/
75Disallow: */visited-hour/
76Disallow: */visited-month/
77Disallow: */visited-today/
78Disallow: /widget_chunks/
79Disallow: /*?af=*
80Disallow: /*?autoenter=*
81Disallow: /*?autoplay=*
82Disallow: /*?betaplayer=*
83Disallow: /*?edit=*
84Disallow: /*?ei=*
85Disallow: /*?embed=*
86Disallow: /*?fbc=*
87Disallow: /*?format=*
88Disallow: /*?hmz=*
89Disallow: /*?iframe=*
90Disallow: /*?last_metric=*
91Disallow: /*?o=*
92Disallow: /*?pmk=*
93Disallow: /*?printable=*
94Disallow: /*?q=*
95Disallow: /*?sa=*
96Disallow: /*?source=*
97Disallow: /*?start=*
98Disallow: /*?subtitle=*
99Disallow: /*?t=*
100Disallow: /*?type=*
101Disallow: /*?ved=*
102Disallow: /*?vsfrom=*
103Disallow: */en/categories/*
104Disallow: */en/no-ad/*
105Disallow: */opensearch/*
106Disallow: */widget/*
107
108# Disallow access to old sitemaps (DAILY-63261)
109Disallow: /map-regular.xml
110Disallow: /map-videofull.xml
111
112User-agent: Googlebot
113Disallow: /a/*
114Disallow: /abuse/group/
115Disallow: /activate
116Disallow: */adfit/*
117Disallow: /ajax/user
118Disallow: */alphaaz/
119Disallow: */alphaza/
120Disallow: */bookmarks/
121Disallow: /controller/
122Disallow: */cookie/dmaid/*
123Disallow: */country/
124Disallow: */created-after/
125Disallow: */creative-official+internal/
126Disallow: /edit/
127Disallow: */edited/
128Disallow: /factory/
129Disallow: /family_filter
130Disallow: */featured/*
131Disallow: */featuredby/
132Disallow: /followers/
133Disallow: */group/*
134Disallow: /group/terms/
135Disallow: /groups/active/user/
136Disallow: /groups/user/
137Disallow: /history/log/
138Disallow: */internal+no-explicit/
139Disallow: /json/
140Disallow: */lang/
141Disallow: */least/
142Disallow: */library/*
143Disallow: /logger/
144Disallow: /middle
145Disallow: */most/
146Disallow: */mychannel/
147Disallow: */official+internal/
148Disallow: */official/*
149Disallow: /page/html/
150Disallow: /pageitem/
151Disallow: /password/*
152Disallow: /player/metadata/video/
153Disallow: /playlists/*/user/
154Disallow: */playlists/relevance/*
155Disallow: */popular/*/channel/
156Disallow: */popular-month/*
157Disallow: */popular-month/*/channel/
158Disallow: */popular-week/*
159Disallow: */popular-week/*/channel/
160Disallow: /promote/
161Disallow: */random/
162Disallow: /register/*
163Disallow: */related/
164Disallow: /rss/
165Disallow: /signin
166Disallow: */signin
167Disallow: */search/
168Disallow: */settings/*
169Disallow: */skip-video/
170Disallow: */stag/
171Disallow: */subscribedto/
172Disallow: /subscriptions/
173Disallow: */tag/
174Disallow: */trending/*
175Disallow: /&tid=generator
176Disallow: /user/*/channel/
177Disallow: */user_list/
178Disallow: */users/group/
179Disallow: */users/*/group/
180Disallow: */users/popular-week/
181Disallow: /_v1st
182Disallow: /video/edit
183Disallow: */vids/*
184Disallow: */visited/group/
185Disallow: */visited/*/group/
186Disallow: */visited-hour/
187Disallow: */visited-month/
188Disallow: */visited-today/
189Disallow: /widget_chunks/
190Disallow: /*?af=*
191Disallow: /*?autoenter=*
192Disallow: /*?autoplay=*
193Disallow: /*?betaplayer=*
194Disallow: /*?edit=*
195Disallow: /*?ei=*
196Disallow: /*?embed=*
197Disallow: /*?fbc=*
198Disallow: /*?format=*
199Disallow: /*?hmz=*
200Disallow: /*?iframe=*
201Disallow: /*?last_metric=*
202Disallow: /*?o=*
203Disallow: /*?pmk=*
204Disallow: /*?printable=*
205Disallow: /*?q=*
206Disallow: /*?sa=*
207Disallow: /*?source=*
208Disallow: /*?start=*
209Disallow: /*?subtitle=*
210Disallow: /*?t=*
211Disallow: /*?type=*
212Disallow: /*?ved=*
213Disallow: /*?vsfrom=*
214Disallow: */en/categories/*
215Disallow: */en/no-ad/*
216Disallow: */opensearch/*
217Disallow: */widget/*
218
219# Disallow access to old sitemaps (DAILY-63261)
220Disallow: /map-regular.xml
221Disallow: /map-videofull.xml
222
223# Mediapartners can crawl more routes than other bots, this is as designed
224User-agent: Mediapartners-Google
225Disallow: /a/*
226Disallow: /abuse/group/
227Disallow: /activate
228Disallow: */adfit/*
229Disallow: */alphaaz/
230Disallow: */alphaza/
231Disallow: /controller/
232Disallow: */cookie/dmaid/*
233Disallow: */country/
234Disallow: */created-after/
235Disallow: */creative-official+internal/
236Disallow: /edit/
237Disallow: */edited/
238Disallow: /factory/
239Disallow: /family_filter
240Disallow: */featured/*
241Disallow: */featuredby/
242Disallow: /followers/
243Disallow: */group/*
244Disallow: /group/terms/
245Disallow: /groups/active/user/
246Disallow: /groups/user/
247Disallow: /history/log/
248Disallow: */internal+no-explicit/
249Disallow: /json/
250Disallow: */lang/
251Disallow: */least/
252Disallow: */library/*
253Disallow: /logger/
254Disallow: /middle
255Disallow: */most/
256Disallow: */mychannel/
257Disallow: */official+internal/
258Disallow: */official/*
259Disallow: /page/html/
260Disallow: /pageitem/
261Disallow: /password/*
262Disallow: /player/metadata/video/
263Disallow: /playlists/*/user/
264Disallow: */playlists/relevance/*
265Disallow: */popular-month/*
266Disallow: */popular/*/channel/
267Disallow: */popular-month/*/channel/
268Disallow: */popular-week/*
269Disallow: */popular-week/*/channel/
270Disallow: /promote/
271Disallow: */random/
272Disallow: /register/*
273Disallow: /rss/
274Disallow: */search/
275Disallow: */settings/*
276Disallow: /signin
277Disallow: */signin
278Disallow: /_v1st
279Disallow: */stag/
280Disallow: /subscriptions/
281Disallow: /&tid=generator
282Disallow: */trending/*
283Disallow: /user/*/channel/
284Disallow: */user_list/
285Disallow: */users/group/
286Disallow: */users/*/group/
287Disallow: */users/popular-week/
288Disallow: /video/edit
289Disallow: */vids/*
290Disallow: /widget_chunks/
291Disallow: /*?af=*
292Disallow: /*?autoenter=*
293Disallow: /*?autoplay=*
294Disallow: /*?betaplayer=*
295Disallow: /*?edit=*
296Disallow: /*?ei=*
297Disallow: /*?embed=*
298Disallow: /*?fbc=*
299Disallow: /*?format=*
300Disallow: /*?hmz=*
301Disallow: /*?iframe=*
302Disallow: /*?last_metric=*
303Disallow: /*?o=*
304Disallow: /*?pmk=*
305Disallow: /*?printable=*
306Disallow: /*?q=*
307Disallow: /*?sa=*
308Disallow: /*?source=*
309Disallow: /*?start=*
310Disallow: /*?subtitle=*
311Disallow: /*?t=*
312Disallow: /*?type=*
313Disallow: /*?ved=*
314Disallow: /*?vsfrom=*
315Disallow: */en/categories/*
316Disallow: */en/no-ad/*
317Disallow: */opensearch/*
318Disallow: */widget/*
319
320# Disallow access to old sitemaps (DAILY-63261)
321Disallow: /map-regular.xml
322Disallow: /map-videofull.xml
323
324User-agent: YandexBot
325Disallow: /a/*
326Disallow: /abuse/group/
327Disallow: /activate
328Disallow: */adfit/*
329Disallow: */alphaaz/
330Disallow: */alphaza/
331Disallow: */bookmarks/
332Disallow: /controller/
333Disallow: */cookie/dmaid/*
334Disallow: */country/
335Disallow: */created-after/
336Disallow: */creative-official+internal/
337Disallow: /edit/
338Disallow: */edited/
339Disallow: /factory/
340Disallow: /family_filter
341Disallow: */featured/*
342Disallow: */featuredby/
343Disallow: /followers/
344Disallow: */group/*
345Disallow: /group/terms/
346Disallow: /groups/active/user/
347Disallow: /groups/user/
348Disallow: /history/log/
349Disallow: */internal+no-explicit/
350Disallow: /json/
351Disallow: */lang/
352Disallow: */least/
353Disallow: */library/*
354Disallow: /logger/
355Disallow: /middle
356Disallow: */most/
357Disallow: */mychannel/
358Disallow: */official/*
359Disallow: */official+internal/
360Disallow: /page/html/
361Disallow: /pageitem/
362Disallow: /password/*
363Disallow: /player/metadata/video/
364Disallow: /playlists/*/user/
365Disallow: */playlists/relevance/*
366Disallow: */popular/*/channel/
367Disallow: */popular-month/*
368Disallow: */popular-month/*/channel/
369Disallow: */popular-week/*
370Disallow: */popular-week/*/channel/
371Disallow: /promote/
372Disallow: */random/
373Disallow: /register/*
374Disallow: */related/
375Disallow: /rss/
376Disallow: */search/
377Disallow: */settings/*
378Disallow: /signin
379Disallow: */signin
380Disallow: */skip-video/
381Disallow: */stag/
382Disallow: */subscribedto/
383Disallow: /subscriptions/
384Disallow: */tag/
385Disallow: */trending/*
386Disallow: /&tid=generator
387Disallow: /user/*/channel/
388Disallow: */user_list/
389Disallow: */users/group/
390Disallow: */users/*/group/
391Disallow: */users/popular-week/
392Disallow: /_v1st
393Disallow: /video/edit
394Disallow: */vids/*
395Disallow: */visited/group/
396Disallow: */visited/*/group/
397Disallow: */visited-hour/
398Disallow: */visited-month/
399Disallow: */visited-today/
400Disallow: /widget_chunks/
401Disallow: /*?af=*
402Disallow: /*?autoenter=*
403Disallow: /*?autoplay=*
404Disallow: /*?betaplayer=*
405Disallow: /*?edit=*
406Disallow: /*?ei=*
407Disallow: /*?embed=*
408Disallow: /*?fbc=*
409Disallow: /*?format=*
410Disallow: /*?hmz=*
411Disallow: /*?iframe=*
412Disallow: /*?last_metric=*
413Disallow: /*?o=*
414Disallow: /*?pmk=*
415Disallow: /*?printable=*
416Disallow: /*?q=*
417Disallow: /*?sa=*
418Disallow: /*?source=*
419Disallow: /*?start=*
420Disallow: /*?subtitle=*
421Disallow: /*?t=*
422Disallow: /*?type=*
423Disallow: /*?ved=*
424Disallow: /*?vsfrom=*
425Disallow: */en/categories/*
426Disallow: */en/no-ad/*
427Disallow: */opensearch/*
428Disallow: */widget/*
429
430# Disallow access to old sitemaps (DAILY-63261)
431Disallow: /map-regular.xml
432Disallow: /map-videofull.xml
433
434User-agent: YandexVideo
435Disallow: /a/*
436Disallow: /abuse/group/
437Disallow: /activate
438Disallow: */adfit/*
439Disallow: */alphaaz/
440Disallow: */alphaza/
441Disallow: */bookmarks/
442Disallow: /controller/
443Disallow: */cookie/dmaid/*
444Disallow: */country/
445Disallow: */created-after/
446Disallow: */creative-official+internal/
447Disallow: /edit/
448Disallow: */edited/
449Disallow: /factory/
450Disallow: /family_filter
451Disallow: */featured/*
452Disallow: */featuredby/
453Disallow: /followers/
454Disallow: */group/*
455Disallow: /group/terms/
456Disallow: /groups/active/user/
457Disallow: /groups/user/
458Disallow: /history/log/
459Disallow: */internal+no-explicit/
460Disallow: /json/
461Disallow: */lang/
462Disallow: */least/
463Disallow: */library/*
464Disallow: /logger/
465Disallow: /middle
466Disallow: */most/
467Disallow: */mychannel/
468Disallow: */official/*
469Disallow: */official+internal/
470Disallow: /page/html/
471Disallow: /pageitem/
472Disallow: /password/*
473Disallow: /player/metadata/video/
474Disallow: /playlists/*/user/
475Disallow: */playlists/relevance/*
476Disallow: */popular/*/channel/
477Disallow: */popular-month/*
478Disallow: */popular-month/*/channel/
479Disallow: */popular-week/*
480Disallow: */popular-week/*/channel/
481Disallow: /promote/
482Disallow: */random/
483Disallow: /register/*
484Disallow: */related/
485Disallow: /rss/
486Disallow: */search/
487Disallow: */settings/*
488Disallow: /signin
489Disallow: */signin
490Disallow: */skip-video/
491Disallow: */stag/
492Disallow: */subscribedto/
493Disallow: /subscriptions/
494Disallow: */tag/
495Disallow: */trending/*
496Disallow: /&tid=generator
497Disallow: /user/*/channel/
498Disallow: */user_list/
499Disallow: */users/group/
500Disallow: */users/*/group/
501Disallow: */users/popular-week/
502Disallow: /_v1st
503Disallow: /video/edit
504Disallow: */vids/*
505Disallow: */visited/group/
506Disallow: */visited/*/group/
507Disallow: */visited-hour/
508Disallow: */visited-month/
509Disallow: */visited-today/
510Disallow: /widget_chunks/
511Disallow: /*?af=*
512Disallow: /*?autoenter=*
513Disallow: /*?autoplay=*
514Disallow: /*?betaplayer=*
515Disallow: /*?edit=*
516Disallow: /*?ei=*
517Disallow: /*?embed=*
518Disallow: /*?fbc=*
519Disallow: /*?format=*
520Disallow: /*?hmz=*
521Disallow: /*?iframe=*
522Disallow: /*?last_metric=*
523Disallow: /*?o=*
524Disallow: /*?pmk=*
525Disallow: /*?printable=*
526Disallow: /*?q=*
527Disallow: /*?sa=*
528Disallow: /*?source=*
529Disallow: /*?start=*
530Disallow: /*?subtitle=*
531Disallow: /*?t=*
532Disallow: /*?type=*
533Disallow: /*?ved=*
534Disallow: /*?vsfrom=*
535Disallow: */en/categories/*
536Disallow: */en/no-ad/*
537Disallow: */opensearch/*
538Disallow: */widget/*
539
540# Disallow access to old sitemaps (DAILY-63261)
541Disallow: /map-regular.xml
542Disallow: /map-videofull.xml
543
544User-agent: msnbot-media
545Disallow: /a/*
546Disallow: /abuse/group/
547Disallow: /activate
548Disallow: */adfit/*
549Disallow: */alphaaz/
550Disallow: */alphaza/
551Disallow: */bookmarks/
552Disallow: /controller/
553Disallow: */cookie/dmaid/*
554Disallow: */country/
555Disallow: */created-after/
556Disallow: */creative-official+internal/
557Disallow: /edit/
558Disallow: */edited/
559Disallow: /factory/
560Disallow: /family_filter
561Disallow: */featured/*
562Disallow: */featuredby/
563Disallow: /followers/
564Disallow: */group/*
565Disallow: /group/terms/
566Disallow: /groups/active/user/
567Disallow: /groups/user/
568Disallow: /history/log/
569Disallow: */internal+no-explicit/
570Disallow: /json/
571Disallow: */lang/
572Disallow: */least/
573Disallow: */library/*
574Disallow: /logger/
575Disallow: /middle
576Disallow: */most/
577Disallow: */mychannel/
578Disallow: */official/*
579Disallow: */official+internal/
580Disallow: /page/html/
581Disallow: /pageitem/
582Disallow: /password/*
583Disallow: /player/metadata/video/
584Disallow: /playlists/*/user/
585Disallow: */playlists/relevance/*
586Disallow: */popular/*/channel/
587Disallow: */popular-month/*
588Disallow: */popular-month/*/channel/
589Disallow: */popular-week/*
590Disallow: */popular-week/*/channel/
591Disallow: /promote/
592Disallow: */random/
593Disallow: /register/*
594Disallow: */related/
595Disallow: /rss/
596Disallow: */search/
597Disallow: */settings/*
598Disallow: /signin
599Disallow: */signin
600Disallow: */skip-video/
601Disallow: */stag/
602Disallow: */subscribedto/
603Disallow: /subscriptions/
604Disallow: */tag/
605Disallow: */trending/*
606Disallow: /&tid=generator
607Disallow: /user/*/channel/
608Disallow: */user_list/
609Disallow: */users/group/
610Disallow: */users/*/group/
611Disallow: */users/popular-week/
612Disallow: /_v1st
613Disallow: /video/edit
614Disallow: */vids/*
615Disallow: */visited/group/
616Disallow: */visited/*/group/
617Disallow: */visited-hour/
618Disallow: */visited-month/
619Disallow: */visited-today/
620Disallow: /widget_chunks/
621Disallow: /*?af=*
622Disallow: /*?autoenter=*
623Disallow: /*?autoplay=*
624Disallow: /*?betaplayer=*
625Disallow: /*?edit=*
626Disallow: /*?ei=*
627Disallow: /*?embed=*
628Disallow: /*?fbc=*
629Disallow: /*?format=*
630Disallow: /*?hmz=*
631Disallow: /*?iframe=*
632Disallow: /*?last_metric=*
633Disallow: /*?o=*
634Disallow: /*?pmk=*
635Disallow: /*?printable=*
636Disallow: /*?q=*
637Disallow: /*?sa=*
638Disallow: /*?source=*
639Disallow: /*?start=*
640Disallow: /*?subtitle=*
641Disallow: /*?t=*
642Disallow: /*?type=*
643Disallow: /*?ved=*
644Disallow: /*?vsfrom=*
645Disallow: */en/categories/*
646Disallow: */en/no-ad/*
647Disallow: */opensearch/*
648Disallow: */widget/*
649
650# Disallow access to old sitemaps (DAILY-63261)
651Disallow: /map-regular.xml
652Disallow: /map-videofull.xml
653
654User-agent: Botify
655Disallow: /a/*
656Disallow: /abuse/group/
657Disallow: /activate
658Disallow: */adfit/*
659Disallow: */alphaaz/
660Disallow: */alphaza/
661Disallow: /archived/ # special-case Botify
662Disallow: */bookmarks/
663Disallow: /controller/
664Disallow: */cookie/dmaid/*
665Disallow: */country/
666Disallow: */created-after/
667Disallow: */creative-official+internal/
668Disallow: /edit/
669Disallow: */edited/
670Disallow: /factory/
671Disallow: /family_filter
672Disallow: */featured/*
673Disallow: */featuredby/
674Disallow: /followers/
675Disallow: */group/*
676Disallow: /group/terms/
677Disallow: /groups/active/user/
678Disallow: /groups/user/
679Disallow: /history/log/
680Disallow: */internal+no-explicit/
681Disallow: /json/
682Disallow: */lang/
683Disallow: */least/
684Disallow: */library/*
685Disallow: /logger/
686Disallow: /middle
687Disallow: */most/
688Disallow: */mychannel/
689Disallow: */official/*
690Disallow: */official+internal/
691Disallow: /page/html/
692Disallow: /pageitem/
693Disallow: /password/*
694Disallow: /player/metadata/video/
695Disallow: /playlists/*/user/
696Disallow: */playlists/relevance/*
697Disallow: */popular/*/channel/
698Disallow: */popular-month/*
699Disallow: */popular-month/*/channel/
700Disallow: */popular-week/*
701Disallow: */popular-week/*/channel/
702Disallow: /promote/
703Disallow: */random/
704Disallow: /register/*
705Disallow: */related/
706Disallow: /rss/
707Disallow: */search/
708Disallow: */settings/*
709Disallow: /signin
710Disallow: */signin
711Disallow: */skip-video/
712Disallow: */stag/
713Disallow: */subscribedto/
714Disallow: /subscriptions/
715Disallow: */tag/
716Disallow: */trending/*
717Disallow: /&tid=generator
718Disallow: /user/*/channel/
719Disallow: */user_list/
720Disallow: */users/group/
721Disallow: */users/*/group/
722Disallow: */users/popular-week/
723Disallow: /_v1st
724Disallow: /video/edit
725Disallow: */vids/*
726Disallow: */visited/group/
727Disallow: */visited/*/group/
728Disallow: */visited-hour/
729Disallow: */visited-month/
730Disallow: */visited-today/
731Disallow: /widget_chunks/
732Disallow: /*?af=*
733Disallow: /*?autoenter=*
734Disallow: /*?autoplay=*
735Disallow: /*?betaplayer=*
736Disallow: /*?edit=*
737Disallow: /*?ei=*
738Disallow: /*?embed=*
739Disallow: /*?fbc=*
740Disallow: /*?format=*
741Disallow: /*?hmz=*
742Disallow: /*?iframe=*
743Disallow: /*?last_metric=*
744Disallow: /*?o=*
745Disallow: /*?pmk=*
746Disallow: /*?printable=*
747Disallow: /*?q=*
748Disallow: /*?sa=*
749Disallow: /*?source=*
750Disallow: /*?start=*
751Disallow: /*?subtitle=*
752Disallow: /*?t=*
753Disallow: /*?type=*
754Disallow: /*?ved=*
755Disallow: /*?vsfrom=*
756Disallow: */en/categories/*
757Disallow: */en/no-ad/*
758Disallow: */opensearch/*
759Disallow: */widget/*
760
761# Disallow access to old sitemaps (DAILY-63261)
762Disallow: /map-regular.xml
763Disallow: /map-videofull.xml
764
765Sitemap: https://www.dailymotion.com/map-videos-latest.xml
766Sitemap: https://www.dailymotion.com/map-videos-default-strategic.xml
767Sitemap: https://www.dailymotion.com/map-videos-default-partner.xml
768Sitemap: https://www.dailymotion.com/map-videos-default-user.xml
769Sitemap: https://www.dailymotion.com/map-channels-strategic.xml
770Sitemap: https://www.dailymotion.com/map-pages-default.xml
771Sitemap: https://www.dailymotion.com/map-videos-default-heuristic.xml
772Sitemap: https://www.dailymotion.com/map-videos-latest-heuristic.xml
773Sitemap: https://www.dailymotion.com/map-corners-default.xml
774
What do the bots actually get?
This page reads robots.txt, which states what dailymotion.com asks of crawlers. A firewall or CDN can still refuse a bot that robots.txt allows. The live check requests the page as each bot and shows the status it gets.
Run a live check on dailymotion.com Test a path in the robots.txt tester
History
- 19 October 2026: first checked.
Questions
Does dailymotion.com block GPTBot?
No. dailymotion.com’s robots.txt lets GPTBot crawl the site. GPTBot is OpenAI’s crawler for training data; blocking it doesn’t affect ChatGPT search, which uses OAI-SearchBot. Checked 9 November 2026.
Does dailymotion.com block ClaudeBot?
No. dailymotion.com’s robots.txt lets ClaudeBot crawl the site. ClaudeBot is Anthropic’s crawler for training data. Checked 9 November 2026.
Does dailymotion.com block Google-Extended?
No. dailymotion.com’s robots.txt lets Google-Extended crawl the site. Google-Extended is the token that controls whether Google may use pages for Gemini training and grounding; it doesn’t affect Google Search. Checked 9 November 2026.
Does dailymotion.com block PerplexityBot?
No. dailymotion.com’s robots.txt lets PerplexityBot crawl the site. PerplexityBot is the crawler that indexes pages for Perplexity’s answers. Checked 9 November 2026.
Can ChatGPT search find dailymotion.com?
Yes. dailymotion.com’s robots.txt lets OAI-SearchBot crawl the site. OAI-SearchBot is the crawler behind ChatGPT search; blocking it keeps the site out of ChatGPT’s search answers. Checked 9 November 2026.