Who blocks AI · #223 in the Majestic Million
robots.txt · checked 9 Nov 2026
Does yandex.ru block AI crawlers?
No. yandex.ru’s robots.txt lets all 19 AI crawlers we track crawl the site, though it keeps OAI-SearchBot out of some paths. Search engines such as Googlebot and Bingbot may crawl it.
GPTBotAllowedOAI-SearchBotPartly blockedClaudeBotAllowedPerplexityBotAllowedGoogle-ExtendedAllowedCCBotAllowed- robots.txt
- yandex.ru/robots.txt · 1,397 lines
- llms.txt
- none
- Checked
- 9 November 2026, as canaicrawl. We check again every week.
Every bot, and the line that decides
Search engines
| Bot | Operator | robots.txt | Deciding line |
|---|---|---|---|
Googlebot | Partly blocked | line 800 · Disallow: /? line 801 · Disallow: /403.html and 227 more | |
Bingbot | Microsoft | Partly blocked | line 288 · Disallow: /? line 289 · Disallow: /403.html and 222 more |
DuckDuckBot | DuckDuckGo | Allowed | no rule matches the home page |
Applebot | Apple | Partly blocked | line 800 · Disallow: /? line 801 · Disallow: /403.html and 227 more |
PetalBot | Huawei | Allowed | no rule matches the home page |
YandexBot | Yandex | Allowed | no rule matches the home page |
Baiduspider | Baidu | Allowed | no rule matches the home page |
AI search
| Bot | Operator | robots.txt | Deciding line |
|---|---|---|---|
OAI-SearchBot | OpenAI | Partly blocked | line 1086 · Disallow: /? line 1087 · Disallow: /403.html and 226 more |
PerplexityBot | Perplexity | Allowed | no rule matches the home page |
Claude-SearchBot | Anthropic | Allowed | no rule matches the home page |
DuckAssistBot | DuckDuckGo | Allowed | no rule matches the home page |
Amazonbot | Amazon | Allowed | no rule matches the home page |
YouBot | You.com | Allowed | no rule matches the home page |
AI training
| Bot | Operator | robots.txt | Deciding line |
|---|---|---|---|
GPTBot | OpenAI | Allowed | no rule matches the home page |
ClaudeBot | Anthropic | Allowed | no rule matches the home page |
Google-Extended | Allowed | no rule matches the home page | |
CCBot | Common Crawl | Allowed | no rule matches the home page |
Applebot-Extended | Apple | Allowed | no rule matches the home page |
GoogleOther | Allowed | no rule matches the home page | |
Meta-ExternalAgent | Meta | Allowed | no rule matches the home page |
Bytespider | ByteDance | Allowed | no rule matches the home page |
User-triggered fetchers
| Bot | Operator | robots.txt | Deciding line |
|---|---|---|---|
ChatGPT-User | OpenAI | Allowed | no rule matches the home page |
Claude-User | Anthropic | Allowed | no rule matches the home page |
Perplexity-User | Perplexity | Allowed | no rule matches the home page |
MistralAI-User | Mistral | Allowed | no rule matches the home page |
Meta-ExternalFetcher | Meta | Allowed | no rule matches the home page |
SEO tools
| Bot | Operator | robots.txt | Deciding line |
|---|---|---|---|
AhrefsBot | Ahrefs | Allowed | no rule matches the home page |
SemrushBot | Semrush | Allowed | no rule matches the home page |
MJ12bot | Majestic | Allowed | no rule matches the home page |
DotBot | Moz | Allowed | no rule matches the home page |
View yandex.ru/robots.txt · 1,397 lines
1# yandex.ru
2User-agent: *
3Disallow: /?
4Disallow: /403.html
5Disallow: /404.html
6Disallow: /500.html
7Disallow: /adddata
8Disallow: /adresa-segmentator
9Disallow: /advanced_engl.html
10Disallow: /advertising
11Disallow: /alice/term/
12Disallow: /alice/*/term/
13Disallow: /alice/old-browser
14Disallow: /alice/store/orders/
15Disallow: /alice*?
16Disallow: /alice/*&
17Disallow: /alice/chat/
18Disallow: /alice?share=
19Disallow: /all-supported-params
20Disallow: /articles
21Disallow: /aura/
22Allow: /aura/promo/
23Disallow: /blog/*?text=
24Disallow: /blog/*?tag=
25Disallow: /blog/*/*/*
26Disallow: /blog/punto
27Disallow: /MAPS/
28Disallow: /MaPS/
29Disallow: /MapS/
30Disallow: /Maps/
31Disallow: /mApS/
32Disallow: /harita/business/
33Disallow: /maps/business/
34Disallow: /maps-api/docs/js-api/reference-guide/instruction-gxs.html
35Disallow: /maps-api/docs/js-api/reference-guide/instruction-rs.html
36Disallow: /catalog/?text=
37Disallow: /chat
38Disallow: /cgi-bin/
39Disallow: /cgi/
40Disallow: /clck
41Disallow: /collections/
42Disallow: /company/*.rss
43Disallow: /company/search
44Disallow: /comments/*
45Disallow: /courier
46Disallow: /conflagexp
47Disallow: /cy
48Disallow: /cycounter
49Disallow: /dzen
50Disallow: /experiments.xml
51Disallow: /formfeedback
52Disallow: /fresh
53Disallow: /goto_issue/
54Disallow: /goto_rubric/
55Disallow: /gundem
56Disallow: /i/
57Disallow: /images-data
58Disallow: /images.html
59Disallow: /images/*
60Disallow: /images-apphost/*
61Allow: /images/$
62Allow: /images/smart/$
63Allow: /images/touch/$
64Allow: /images/touch/?
65Allow: /images/search?text=*&source=morda*
66Allow: /images/search?rpt=imageview
67Allow: /images/touch/search?text=*&source=morda*
68Allow: /images/touch/search?rpt=imageview
69Allow: /images/pad/search?text=*&source=morda*
70Allow: /images/pad/search?rpt=imageview
71Disallow: /index_m
72Disallow: /iznanka/
73Disallow: /int_search_summary
74Disallow: /delivery_tracking
75Disallow: /jobs/skill-diagnostic/private/*
76Disallow: /keyboard_qwerty.html
77Disallow: /logotypes
78Disallow: /business/widget
79Disallow: /local/
80Disallow: /lab/neurodetector
81Disallow: /lab/habr-detector
82Disallow: /more_samples
83Disallow: /msearch
84Disallow: /map-constructor/loader*
85Disallow: /maps/print/*
86Allow: /maps/*?lang=ru$
87Allow: /maps/*?lang=uk$
88Allow: /maps/*?lang=kk$
89Allow: /maps/*?lang=uz$
90Disallow: /nmaps/*?
91Disallow: /mapeditor/*?
92Disallow: /metro/*?from
93Disallow: /masters
94Disallow: /services/executor/
95Disallow: /n?
96Disallow: /n$
97Disallow: /n/
98Disallow: /neuralsearch/api
99Disallow: /norobot
100Disallow: /opensearch.xml
101Disallow: /padsearch
102Disallow: /person
103Disallow: /podpiska/login.pl
104Disallow: /pogoda/search
105Disallow: /pogoda/404
106Disallow: /pogoda/0
107Disallow: /polling
108Disallow: /poll/
109Disallow: /portal/set/
110Disallow: /portal/tune/
111Disallow: /prefetch
112Disallow: /promo/*goodbye*
113Disallow: /promo/diskelement
114Disallow: /promo/launcher/mgoodbye/*
115Disallow: /promo/*welcome*
116Disallow: /promo/yobject/changelog*
117Disallow: /project/eda/partnership_services/$
118Disallow: /q/profile/*/answers
119Disallow: /q/profile/*/questions
120Disallow: /q/profile/*/verifies
121Disallow: /q/profile/*/articles
122Disallow: /q/profile/*/subscribers
123Disallow: /q/profile/*/org_answers
124Disallow: /q/user/*/answers
125Disallow: /q/user/*/questions
126Disallow: /q/user/*/verifies
127Disallow: /q/user/*/articles
128Disallow: /q/user/*/subscribers
129Disallow: /q/user/*/org_answers
130Disallow: /soft/bm/goodbye
131Disallow: /soft/chrome/ext-install/*
132Disallow: /soft/chrome/searchline-install/*
133Disallow: /soft/*goodbye*
134Disallow: /soft/punto/mac/uninstall/*
135Disallow: /soft/punto/win/uninstall/*
136Disallow: /soft/*welcome*
137Disallow: /soft/win/?*
138Disallow: /quotes
139Disallow: /realty*?*pinned_offer_id=
140Disallow: /realty*?*pinned_nb_id=
141Disallow: /realty/search
142Disallow: /realty*?*text=
143Disallow: /realty/result
144Disallow: /realty/map_pins
145Disallow: /realty/map_dust
146Disallow: /realty/callme
147Disallow: /redir
148Disallow: /region_map
149Disallow: /regions_list.xml
150Disallow: /regions.html?
151Disallow: /s/
152Disallow: /save
153Disallow: /safety/?
154Disallow: /safety?
155Disallow: /search
156Allow: /search/entity/touch/
157Disallow: /setup
158Disallow: /showcaptcha
159Disallow: /sitesearch
160Disallow: /sl/*.html
161Disallow: /soft/extensions/goodbye
162Disallow: /sportagent
163Disallow: /storeclick
164Disallow: /storerequest
165Disallow: /subscribe/confirm.pl
166Disallow: /subscribe/view.pl
167Allow: /support/
168Disallow: /support/direct-images
169Disallow: /support/direct-tooltips
170Disallow: /support/distr
171Disallow: /support/dsp
172Disallow: /support/fe4be44a295cc679e19bf0b8f133083d
173Disallow: /support/maps-beta
174Disallow: /support/market-images
175Disallow: /support/security
176Disallow: /support/webmaster-images
177Disallow: /support/*zout_
178Disallow: /support/search-results/
179Disallow: /support/praktikum/flow.html
180Disallow: /support/praktikum-english/
181Disallow: /telsearch
182Disallow: /themes
183Disallow: /toggle-experiment
184Disallow: /touchsearch
185Disallow: /tune*retpath=
186Disallow: /turbo
187Allow: /ugcpub/
188Disallow: /ugcpub/cabinet
189Disallow: /v$
190Disallow: /viewconfig$
191Disallow: /images/v$
192Disallow: /images/viewconfig$
193Allow: /tutor
194Disallow: /tutor/admin
195Disallow: /tutor/search/problems
196Disallow: /versions
197Disallow: /video/*
198Allow: /video/$
199Allow: /video/?
200Allow: /video/sitemap
201Allow: /video/movies/entity
202Allow: /video/touch/movies/entity
203Allow: /video/touch/$
204Allow: /video/touch/?
205Allow: /video/preview
206Allow: /video/touch/preview
207Allow: /video/search?text=video$
208Allow: /video/touch/search?text=video$
209Allow: /video/search?text=%D0%B2%D0%B8%D0%B4%D0%B5%D0%BE$
210Allow: /video/touch/search?text=%D0%B2%D0%B8%D0%B4%D0%B5%D0%BE$
211Allow: /video/video_sitemap_*.xml
212Allow: /video/movies_sitemap_*.xml
213Disallow: /xmlsearch
214Disallow: /yandsearch
215Disallow: /yca/cy
216Disallow: /soft/distribution
217Disallow: /soft/?*
218Disallow: /promo/launcher/?*
219Disallow: /opera/?*
220Disallow: /firefox/?*
221Disallow: /soft/bm/?*
222Disallow: /soft/browsers/?*
223Disallow: /soft/punto/?*
224Disallow: /ie/?*
225Disallow: /soft/*goodbye*
226Disallow: /adult
227Disallow: /addappterless
228Disallow: /archive/api/image.jpg*
229Allow: /archive$
230Allow: /archive/project/sovsport$
231Disallow: /all?
232Disallow: /games/*?*reqId*
233Disallow: /games/*?*pageId*
234Disallow: /games/*?experimental=
235Disallow: /games/*?*app-id=
236Disallow: /games/*?*game-id=
237Disallow: /games/*?*div-rtx-reqid=
238Disallow: /games/*?*header=
239Disallow: /games/*?*from=
240Disallow: /games/*?*clid=
241Disallow: /games/*?*deviceid=
242Disallow: /games/*?*flags=
243Disallow: /games/*?*inapp_id=
244Disallow: /games/*?*k50id=
245Disallow: /games/*?*lang=
246Disallow: /games/*?*payload=
247Disallow: /games/*?*pfid=
248Disallow: /games/*?*promo_id=
249Disallow: /games/*?*promo_intent=
250Disallow: /games/*?*referrer=
251Disallow: /games/*?*utm_
252Disallow: /games/*?*ypr=
253Disallow: /familysearch
254Disallow: /schoolsearch
255Disallow: /yandpage
256Disallow: *maps/covid19*
257Disallow: /promo/market/mobile/app*?from=
258Disallow: /support2/*zout_
259Disallow: /activity/
260Disallow: /sport
261Disallow: /support2/sport
262
263Allow: /medicine
264Disallow: /medicine/search
265Disallow: /medicine?text=
266Disallow: /finance
267Allow: /finance/reviews
268Allow: /finance/banks/*/reviews
269Disallow: /finance/reviews*?*
270Disallow: /finance/banks/*/reviews*?
271
272Sitemap: https://yandex.ru/support/sitemap.xml
273Sitemap: https://yandex.ru/blog/sitemap.xml
274Sitemap: https://frontend.s3.yandex.net/health/sitemap.xml
275Sitemap: https://yandex.ru/uslugi/sitemap/sitemap.xml.gz
276Sitemap: https://yandex.ru/turbo/public/sitemap.xml
277Sitemap: https://yandex.ru/tutor/sitemap/?sitemap=sitemap.xml
278Sitemap: https://yandex.ru/turbo/talk-sitemap-index.xml
279Sitemap: https://yandex.ru/games/sitemaps/sitemap.index.xml
280Sitemap: https://yandex.ru/q/sitemap/sitemap-index.xml
281Sitemap: https://yandex.ru/images/sitemap.xml
282Sitemap: https://yandex.ru/medicine/sitemaps/sitemap.xml
283Sitemap: https://yandex.ru/finance/sitemaps/sitemap.xml
284Sitemap: https://yandex.ru/yandexapp/ru/callerid/sitemap.xml
285Sitemap: https://yandex.ru/video/sitemap_index.xml
286
287User-agent: Bingbot
288Disallow: /?
289Disallow: /403.html
290Disallow: /404.html
291Disallow: /500.html
292Disallow: /adddata
293Disallow: /adresa-segmentator
294Disallow: /advanced_engl.html
295Disallow: /advertising
296Disallow: /alice/term/
297Disallow: /alice/*/term/
298Disallow: /alice/old-browser
299Disallow: /alice/store/orders/
300Disallow: /alice*?
301Disallow: /alice/*&
302Disallow: /alice/chat/
303Disallow: /alice?share=
304Disallow: /all-supported-params
305Disallow: /articles
306Disallow: /aura/
307Allow: /aura/promo/
308Disallow: /blog/*?text=
309Disallow: /blog/*?tag=
310Disallow: /blog/*/*/*
311Disallow: /blog/punto
312Disallow: /MAPS/
313Disallow: /MaPS/
314Disallow: /MapS/
315Disallow: /Maps/
316Disallow: /mApS/
317Disallow: /maps-api/docs/js-api/reference-guide/instruction-gxs.html
318Disallow: /maps-api/docs/js-api/reference-guide/instruction-rs.html
319Disallow: /catalog/?text=
320Disallow: /chat
321Disallow: /cgi-bin/
322Disallow: /cgi/
323Disallow: /clck
324Disallow: /collections/
325Disallow: /company/*.rss
326Disallow: /company/search
327Disallow: /comments/*
328Disallow: /courier
329Disallow: /conflagexp
330Disallow: /cy
331Disallow: /cycounter
332Disallow: /dzen
333Disallow: /experiments.xml
334Disallow: /formfeedback
335Disallow: /fresh
336Disallow: /goto_issue/
337Disallow: /goto_rubric/
338Disallow: /i/
339Disallow: /images-data
340Disallow: /images.html
341Disallow: /images/*
342Disallow: /images-apphost/*
343Allow: /images/$
344Allow: /images/smart/$
345Allow: /images/touch/$
346Allow: /images/touch/?
347Allow: /images/search?text=*&source=morda*
348Allow: /images/search?rpt=imageview
349Allow: /images/touch/search?text=*&source=morda*
350Allow: /images/touch/search?rpt=imageview
351Allow: /images/pad/search?text=*&source=morda*
352Allow: /images/pad/search?rpt=imageview
353Disallow: /index_m
354Disallow: /iznanka/
355Disallow: /int_search_summary
356Disallow: /delivery_tracking
357Disallow: /gundem
358Disallow: /jobs/skill-diagnostic/private/*
359Disallow: /keyboard_qwerty.html
360Disallow: /logotypes
361Disallow: /business/widget
362Disallow: /local/
363Disallow: /lab/neurodetector
364Disallow: /lab/habr-detector
365Disallow: /more_samples
366Disallow: /msearch
367Disallow: /map-constructor/loader*
368Disallow: /maps/print/*
369Allow: /maps/*?lang=ru$
370Allow: /maps/*?lang=uk$
371Allow: /maps/*?lang=kk$
372Allow: /maps/*?lang=uz$
373Disallow: /nmaps/*?
374Disallow: /mapeditor/*?
375Disallow: /metro/*?from
376Disallow: /masters
377Disallow: /services/executor/
378Disallow: /n?
379Disallow: /n$
380Disallow: /n/
381Disallow: /norobot
382Disallow: /opensearch.xml
383Disallow: /padsearch
384Disallow: /person
385Disallow: /podpiska/login.pl
386Disallow: /pogoda/search
387Disallow: /pogoda/404
388Disallow: /polling
389Disallow: /poll/
390Disallow: /portal/set/
391Disallow: /portal/tune/
392Disallow: /prefetch
393Disallow: /promo/*goodbye*
394Disallow: /promo/diskelement
395Disallow: /promo/launcher/mgoodbye/*
396Disallow: /promo/*welcome*
397Disallow: /promo/yobject/changelog*
398Disallow: /project/eda/partnership_services/$
399Disallow: /q/profile/*/answers
400Disallow: /q/profile/*/questions
401Disallow: /q/profile/*/verifies
402Disallow: /q/profile/*/articles
403Disallow: /q/profile/*/subscribers
404Disallow: /q/profile/*/org_answers
405Disallow: /q/user/*/answers
406Disallow: /q/user/*/questions
407Disallow: /q/user/*/verifies
408Disallow: /q/user/*/articles
409Disallow: /q/user/*/subscribers
410Disallow: /q/user/*/org_answers
411Disallow: /soft/bm/goodbye
412Disallow: /soft/chrome/ext-install/*
413Disallow: /soft/chrome/searchline-install/*
414Disallow: /soft/*goodbye*
415Disallow: /soft/punto/mac/uninstall/*
416Disallow: /soft/punto/win/uninstall/*
417Disallow: /soft/*welcome*
418Disallow: /soft/win/?*
419Disallow: /quotes
420Disallow: /realty*?*pinned_offer_id=
421Disallow: /realty*?*pinned_nb_id=
422Disallow: /realty/search
423Disallow: /realty*?*text=
424Disallow: /realty/result
425Disallow: /realty/map_pins
426Disallow: /realty/map_dust
427Disallow: /realty/callme
428Disallow: /redir
429Disallow: /region_map
430Disallow: /regions_list.xml
431Disallow: /regions.html?
432Disallow: /s/
433Disallow: /save
434Disallow: /safety/?
435Disallow: /safety?
436Disallow: /search
437Allow: /search/entity/touch/
438Allow: /search?products_mode=1
439Allow: /search/?products_mode=1
440Allow: /search?*&products_mode=1
441Allow: /search/?*&products_mode=1
442Allow: /search/touch?products_mode=1
443Allow: /search/touch/?products_mode=1
444Allow: /search/touch?*&products_mode=1
445Allow: /search/touch/?*&products_mode=1
446Allow: /search/products
447Allow: /products/$
448Allow: /products$
449Disallow: /setup
450Disallow: /showcaptcha
451Disallow: /sitesearch
452Disallow: /sl/*.html
453Disallow: /soft/extensions/goodbye
454Disallow: /sportagent
455Disallow: /storeclick
456Disallow: /storerequest
457Disallow: /subscribe/confirm.pl
458Disallow: /subscribe/view.pl
459Allow: /support/
460Disallow: /support/direct-images
461Disallow: /support/direct-tooltips
462Disallow: /support/distr
463Disallow: /support/dsp
464Disallow: /support/fe4be44a295cc679e19bf0b8f133083d
465Disallow: /support/maps-beta
466Disallow: /support/market-images
467Disallow: /support/security
468Disallow: /support/webmaster-images
469Disallow: /support/*zout_
470Disallow: /support/search-results/
471Disallow: /support/praktikum/flow.html
472Disallow: /support/praktikum-english/
473Disallow: /telsearch
474Disallow: /themes
475Disallow: /toggle-experiment
476Disallow: /touchsearch
477Disallow: /tune*retpath=
478Allow: /ugcpub/
479Disallow: /ugcpub/cabinet
480Disallow: /v$
481Disallow: /viewconfig$
482Disallow: /images/v$
483Disallow: /images/viewconfig$
484Allow: /tutor
485Disallow: /tutor/admin
486Disallow: /tutor/search/problems
487Disallow: /turbo
488Disallow: /versions
489Disallow: /video/*
490Allow: /video/$
491Allow: /video/?
492Allow: /video/sitemap
493Allow: /video/movies/entity
494Allow: /video/touch/movies/entity
495Allow: /video/touch/$
496Allow: /video/touch/?
497Allow: /video/preview
498Allow: /video/touch/preview
499Allow: /video/search?text=video$
500Allow: /video/touch/search?text=video$
501Allow: /video/search?text=%D0%B2%D0%B8%D0%B4%D0%B5%D0%BE$
502Allow: /video/touch/search?text=%D0%B2%D0%B8%D0%B4%D0%B5%D0%BE$
503Allow: /video/video_sitemap_*.xml
504Allow: /video/movies_sitemap_*.xml
505Disallow: /xmlsearch
506Disallow: /yandsearch
507Disallow: /yca/cy
508Disallow: /soft/distribution
509Disallow: /soft/?*
510Disallow: /promo/launcher/?*
511Disallow: /opera/?*
512Disallow: /firefox/?*
513Disallow: /soft/bm/?*
514Disallow: /soft/browsers/?*
515Disallow: /soft/punto/?*
516Disallow: /ie/?*
517Disallow: /soft/*goodbye*
518Disallow: /adult
519Disallow: /addappterless
520Disallow: /archive/api/image.jpg*
521Allow: /archive$
522Allow: /archive/project/sovsport$
523Disallow: /all?
524Disallow: /games/*?*reqId*
525Disallow: /games/*?*pageId*
526Disallow: /games/*?experimental=
527Disallow: /games/*?*app-id=
528Disallow: /games/*?*game-id=
529Disallow: /games/*?*div-rtx-reqid=
530Disallow: /games/*?*header=
531Disallow: /games/*?*from=
532Disallow: /games/*?*clid=
533Disallow: /games/*?*deviceid=
534Disallow: /games/*?*flags=
535Disallow: /games/*?*inapp_id=
536Disallow: /games/*?*k50id=
537Disallow: /games/*?*lang=
538Disallow: /games/*?*payload=
539Disallow: /games/*?*pfid=
540Disallow: /games/*?*promo_id=
541Disallow: /games/*?*promo_intent=
542Disallow: /games/*?*referrer=
543Disallow: /games/*?*utm_
544Disallow: /games/*?*ypr=
545Disallow: /products
546Disallow: /familysearch
547Disallow: /schoolsearch
548Disallow: /yandpage
549Disallow: *maps/covid19*
550Disallow: /promo/market/mobile/app*?from=
551Disallow: /support2/*zout_
552Disallow: /activity/
553Disallow: /sport
554Disallow: /support2/sport*
555
556Allow: /medicine
557Disallow: /medicine/search
558Disallow: /medicine?text=
559Disallow: /finance*?
560Disallow: /finance/assistant
561
562User-agent: Yandex
563Disallow: /?
564Disallow: /403.html
565Disallow: /404.html
566Disallow: /500.html
567Disallow: /adddata
568Disallow: /adresa-segmentator
569Disallow: /advanced_engl.html
570Disallow: /advertising
571Disallow: /adv/news/vystavka-prodazha-na-poiske-poyavilas-tovarnaya-galereya
572Disallow: /adv?nw=
573Disallow: /adv?from=
574Disallow: /adv?email_form=
575Disallow: /adv?ref=
576Disallow: /alice/term/
577Disallow: /alice/*/term/
578Disallow: /alice/old-browser
579Disallow: /alice/chat/
580Disallow: /alice?share=
581Disallow: /alice*?
582Disallow: /all-supported-params
583Disallow: /articles
584Disallow: /aura/
585Allow: /aura/promo/
586Disallow: /blog/*?text=
587Disallow: /blog/*?tag=
588Disallow: /blog/*/*/*
589Disallow: /blog/punto
590Disallow: /MAPS/
591Disallow: /MaPS/
592Disallow: /MapS/
593Disallow: /Maps/
594Disallow: /mApS/
595Disallow: /catalog/?text=
596Disallow: /chat
597Disallow: /cgi-bin/
598Disallow: /cgi/
599Disallow: /clck
600Disallow: /collections/
601Disallow: /company/*.rss
602Disallow: /company/search
603Disallow: /business/widget
604Disallow: /comments/*
605Disallow: /courier
606Disallow: /products
607Disallow: /conflagexp
608Disallow: /cy
609Disallow: /cycounter
610Disallow: /dzen
611Disallow: /experiments.xml
612Disallow: /formfeedback
613Disallow: /fresh
614Disallow: /games/*?experimental=
615Disallow: /goto_issue/
616Disallow: /goto_rubric/
617Disallow: /i/
618Disallow: /images-data
619Disallow: /images.html
620Disallow: /images/*
621Allow: /images/$
622Allow: /images/smart/$
623Allow: /images/touch/$
624Allow: /images/touch/?
625Allow: /images/search?text=*&source=morda*
626Allow: /images/search?rpt=imageview
627Allow: /images/touch/search?text=*&source=morda*
628Allow: /images/touch/search?rpt=imageview
629Allow: /images/pad/search?text=*&source=morda*
630Allow: /images/pad/search?rpt=imageview
631Disallow: /index_m
632Disallow: /iznanka/
633Disallow: /int_search_summary
634Disallow: /delivery_tracking
635Disallow: /jobs/skill-diagnostic/private/*
636Disallow: /keyboard_qwerty.html
637Disallow: /logotypes
638Disallow: /local/
639Disallow: /lab/neurodetector
640Disallow: /lab/habr-detector
641Disallow: /more_samples
642Disallow: /msearch
643Disallow: /map-constructor/loader*
644Disallow: /maps/print/*
645Disallow: /harita/business/
646Disallow: /maps/business/
647Disallow: /maps-api/docs/js-api/reference-guide/instruction-gxs.html
648Disallow: /maps-api/docs/js-api/reference-guide/instruction-rs.html
649Allow: /maps/*?lang=ru$
650Allow: /maps/*?lang=uk$
651Allow: /maps/org/
652Disallow: /nmaps/*?
653Disallow: /mapeditor/*?
654Disallow: /metro/*?from
655Disallow: /masters
656Disallow: /services
657Disallow: /neuralsearch/api
658Disallow: /n?
659Disallow: /n$
660Disallow: /n/
661Disallow: /norobot
662Disallow: /opensearch.xml
663Disallow: /padsearch
664Disallow: /person
665Disallow: /podpiska/login.pl
666Disallow: /pogoda/amp/*
667Disallow: /pogoda/search
668Disallow: /pogoda/404
669Disallow: /pogoda/0
670Disallow: /polling
671Disallow: /poll/
672Disallow: /portal/set/
673Disallow: /portal/tune/
674Disallow: /promo/*goodbye*
675Disallow: /promo/diskelement
676Disallow: /promo/launcher/mgoodbye/*
677Disallow: /promo/*welcome*
678Disallow: /promo/yobject/changelog*
679Disallow: /project/eda/partnership_services/$
680Disallow: /q/profile/*/answers
681Disallow: /q/profile/*/questions
682Disallow: /q/profile/*/verifies
683Disallow: /q/profile/*/articles
684Disallow: /q/profile/*/subscribers
685Disallow: /q/profile/*/org_answers
686Disallow: /q/user/*/answers
687Disallow: /q/user/*/questions
688Disallow: /q/user/*/verifies
689Disallow: /q/user/*/articles
690Disallow: /q/user/*/subscribers
691Disallow: /q/user/*/org_answers
692Disallow: /soft/bm/goodbye
693Disallow: /soft/chrome/ext-install/*
694Disallow: /soft/chrome/searchline-install/*
695Disallow: /soft/*goodbye*
696Disallow: /soft/punto/mac/uninstall/*
697Disallow: /soft/punto/win/uninstall/*
698Disallow: /soft/*welcome*
699Disallow: /soft/win/?*
700Disallow: /quotes
701Disallow: /realty
702Disallow: /redir
703Disallow: /region_map
704Disallow: /regions_list.xml
705Disallow: /regions.html?
706Disallow: /s/
707Disallow: /save
708Disallow: /safety/?*
709Disallow: /search
710Allow: /search/entity/touch/
711Disallow: /setup
712Disallow: /showcaptcha
713Disallow: /sitesearch
714Disallow: /sl/*.html
715Disallow: /soft/extensions/goodbye
716Disallow: /sportagent
717Disallow: /storeclick
718Disallow: /storerequest
719Disallow: /subscribe/confirm.pl
720Disallow: /subscribe/view.pl
721Allow: /support/
722Disallow: /support/direct-images
723Disallow: /support/direct-tooltips
724Disallow: /support/distr
725Disallow: /support/dsp
726Disallow: /support/fe4be44a295cc679e19bf0b8f133083d
727Disallow: /support/maps-beta
728Disallow: /support/market-images
729Disallow: /support/security
730Disallow: /support/webmaster-images
731Disallow: /support/*zout_
732Disallow: /support/search-results/
733Disallow: /support/praktikum/flow.html
734Disallow: /support/praktikum-english/
735Disallow: /telsearch
736Disallow: /themes
737Disallow: /toggle-experiment
738Disallow: /touchsearch
739Disallow: /tune*retpath=
740Disallow: /8bit-fest/parents
741Allow: /tutor
742Disallow: /tutor/admin
743Disallow: /turbo
744Allow: /ugcpub/
745Disallow: /ugcpub/cabinet
746Disallow: /v$
747Disallow: /viewconfig$
748Disallow: /images/v$
749Disallow: /images/viewconfig$
750Disallow: /versions
751Disallow: /video/*
752Allow: /video/$
753Allow: /video/?
754Allow: /video/sitemap
755Allow: /video/touch/$
756Allow: /video/touch/?
757Allow: /video/preview
758Allow: /video/touch/preview
759Allow: /video/search?text=video$
760Allow: /video/touch/search?text=video$
761Allow: /video/search?text=%D0%B2%D0%B8%D0%B4%D0%B5%D0%BE$
762Allow: /video/touch/search?text=%D0%B2%D0%B8%D0%B4%D0%B5%D0%BE$
763Allow: /video/video_sitemap_*.xml
764Allow: /video/movies_sitemap_*.xml
765Disallow: /xmlsearch
766Disallow: /yandsearch
767Disallow: /yca/cy
768Disallow: /soft/distribution
769Disallow: /soft/?*
770Disallow: /promo/launcher/?*
771Disallow: /opera/?*
772Disallow: /firefox/?*
773Disallow: /soft/bm/?*
774Disallow: /soft/browsers/?*
775Disallow: /soft/punto/?*
776Disallow: /ie/?*
777Disallow: /soft/*goodbye*
778Disallow: /adult
779Disallow: /addappterless
780Disallow: /archive/api/image.jpg*
781Allow: /archive$
782Allow: /archive/project/sovsport$
783Disallow: /all?
784Disallow: /familysearch
785Disallow: /schoolsearch
786Disallow: /yandpage
787Disallow: *maps/covid19*
788Disallow: /promo/market/mobile/app*?from=
789Disallow: /support2/*zout_
790Disallow: /activity/
791Disallow: /sport
792Disallow: /support2/sport*
793
794Disallow: /medicine
795Disallow: /finance
796
797Disallow: /gundem
798
799User-agent: Googlebot
800Disallow: /?
801Disallow: /403.html
802Disallow: /404.html
803Disallow: /500.html
804Disallow: /adddata
805Disallow: /adresa-segmentator
806Disallow: /advanced_engl.html
807Disallow: /advertising
808Disallow: /ads/
809Disallow: /adfox/
810Disallow: /an/
811Disallow: /alice/term/
812Disallow: /alice/*/term/
813Disallow: /alice/old-browser
814Disallow: /alice/store/orders/
815Disallow: /alice*?
816Disallow: /alice/*&
817Disallow: /alice/chat/
818Disallow: /alice?share=
819Disallow: /all-supported-params
820Disallow: /articles
821Disallow: /archive/search
822Disallow: /aura/
823Allow: /aura/promo/
824Disallow: /blog/*?text=
825Disallow: /blog/*?tag=
826Disallow: /blog/*/*/*
827Disallow: /blog/punto
828Disallow: /business/widget
829Disallow: /MAPS/
830Disallow: /MaPS/
831Disallow: /MapS/
832Disallow: /Maps/
833Disallow: /mApS/
834Disallow: /maps-api/docs/js-api/reference-guide/instruction-gxs.html
835Disallow: /maps-api/docs/js-api/reference-guide/instruction-rs.html
836Disallow: /catalog/?text=
837Disallow: /cgi-bin/
838Disallow: /cgi/
839Disallow: /clck
840Disallow: /collections/
841Disallow: /company/*.rss
842Disallow: /company/search
843Disallow: /comments/*
844Disallow: /courier
845Disallow: /conflagexp
846Disallow: /cy
847Disallow: /cycounter
848Disallow: /dzen
849Disallow: /experiments.xml
850Disallow: /formfeedback
851Disallow: /fresh
852Disallow: /goto_issue/
853Disallow: /goto_rubric/
854Disallow: /gundem
855Disallow: /i/
856Disallow: /images-data
857Disallow: /images.html
858Disallow: /images/
859Disallow: /images-apphost/
860Allow: /images$
861Allow: /images/$
862Allow: /images/?
863Allow: /images/smart/$
864Allow: /images/touch$
865Allow: /images/touch/$
866Allow: /images/touch/?
867Allow: /images/pad/search?text=*&source=morda*
868Allow: /images/pad/search?rpt=imageview
869Allow: /images/search?
870Allow: /images/touch/search?
871
872Allow: /images/sitemap
873Disallow: /index_m
874Disallow: /iznanka/
875Disallow: /int_search_summary
876Disallow: /delivery_tracking
877Disallow: /jobs/skill-diagnostic/private/*
878Disallow: /keyboard_qwerty.html
879Disallow: /logotypes
880Disallow: /local/
881Disallow: /lab/neurodetector
882Disallow: /lab/habr-detector
883Disallow: /more_samples
884Disallow: /msearch
885Disallow: /map-constructor/loader*
886Disallow: /maps/print/*
887Disallow: /harita/business/
888Disallow: /maps/business/
889Allow: /maps/*?lang=ru$
890Allow: /maps/*?lang=uk$
891Allow: /maps/*?lang=kk$
892Allow: /maps/*?lang=uz$
893Disallow: /nmaps/*?
894Disallow: /mapeditor/*?
895Disallow: /metro/*?from
896Disallow: /masters
897Disallow: /services/executor/
898Disallow: /neuralsearch/api
899Disallow: /n?
900Disallow: /n$
901Disallow: /n/
902Disallow: /norobot
903Disallow: /opensearch.xml
904Disallow: /padsearch
905Allow: /products/sitemaps/new/*
906Disallow: /person
907Disallow: /podpiska/login.pl
908Disallow: /pogoda/404
909Disallow: /polling
910Disallow: /poll/
911Disallow: /portal/set/
912Disallow: /portal/tune/
913Disallow: /prefetch
914Disallow: /products
915Disallow: /promo/*goodbye*
916Disallow: /promo/diskelement
917Disallow: /promo/launcher/mgoodbye/*
918Disallow: /promo/*welcome*
919Disallow: /promo/yobject/changelog*
920Disallow: /project/eda/partnership_services/$
921Disallow: /q/profile/*/answers
922Disallow: /q/profile/*/questions
923Disallow: /q/profile/*/verifies
924Disallow: /q/profile/*/articles
925Disallow: /q/profile/*/subscribers
926Disallow: /q/profile/*/org_answers
927Disallow: /q/user/*/answers
928Disallow: /q/user/*/questions
929Disallow: /q/user/*/verifies
930Disallow: /q/user/*/articles
931Disallow: /q/user/*/subscribers
932Disallow: /q/user/*/org_answers
933Disallow: /soft/bm/goodbye
934Disallow: /soft/chrome/ext-install/*
935Disallow: /soft/chrome/searchline-install/*
936Disallow: /soft/*goodbye*
937Disallow: /soft/punto/mac/uninstall/*
938Disallow: /soft/punto/win/uninstall/*
939Disallow: /soft/*welcome*
940Disallow: /soft/win/?*
941Disallow: /quotes
942Disallow: /realty*?*pinned_offer_id=
943Disallow: /realty*?*pinned_nb_id=
944Disallow: /realty/search
945Disallow: /realty*?*text=
946Disallow: /realty/result
947Disallow: /realty/map_pins
948Disallow: /realty/map_dust
949Disallow: /realty/callme
950Disallow: /redir
951Disallow: /region_map
952Disallow: /regions_list.xml
953Disallow: /regions.html?
954Disallow: /s/
955Disallow: /save
956Disallow: /safety/?
957Disallow: /safety?
958Disallow: /search
959Allow: /search/entity/touch/
960Allow: /search?products_mode=1
961Allow: /search/?products_mode=1
962Allow: /search?*&products_mode=1
963Allow: /search/?*&products_mode=1
964Allow: /search/touch?products_mode=1
965Allow: /search/touch/?products_mode=1
966Allow: /search/touch?*&products_mode=1
967Allow: /search/touch/?*&products_mode=1
968Allow: /search/products
969Allow: /products/$
970Allow: /products$
971Disallow: /setup
972Disallow: /showcaptcha
973Disallow: /sitesearch
974Disallow: /sl/*.html
975Disallow: /soft/extensions/goodbye
976Disallow: /sportagent
977Disallow: /storeclick
978Disallow: /storerequest
979Disallow: /subscribe/confirm.pl
980Disallow: /subscribe/view.pl
981Allow: /support/
982Disallow: /support/direct-images
983Disallow: /support/direct-tooltips
984Disallow: /support/distr
985Disallow: /support/dsp
986Disallow: /support/fe4be44a295cc679e19bf0b8f133083d
987Disallow: /support/maps-beta
988Disallow: /support/market-images
989Disallow: /support/security
990Disallow: /support/webmaster-images
991Disallow: /support/*zout_
992Disallow: /support/search-results/
993Disallow: /support/praktikum/flow.html
994Disallow: /support/praktikum-english/
995Disallow: /telsearch
996Disallow: /themes
997Disallow: /toggle-experiment
998Disallow: /touchsearch
999Disallow: /tune*retpath=
1000Disallow: /turbo
1001Allow: /ugcpub/
1002Disallow: /ugcpub/cabinet
1003Disallow: /v$
1004Disallow: /viewconfig$
1005Disallow: /images/v$
1006Disallow: /images/viewconfig$
1007Allow: /tutor
1008Disallow: /tutor/admin
1009Disallow: /tutor/search/problems
1010Disallow: /versions
1011Disallow: /video/
1012Allow: /video/$
1013Allow: /video/?
1014Allow: /video/sitemap
1015Allow: /video/movies/entity
1016Allow: /video/touch/movies/entity
1017Allow: /video/touch/$
1018Allow: /video/touch/?
1019Allow: /video/preview
1020Allow: /video/touch/preview
1021Allow: /video/search?text=video$
1022Allow: /video/touch/search?text=video$
1023Allow: /video/search?text=%D0%B2%D0%B8%D0%B4%D0%B5%D0%BE$
1024Allow: /video/touch/search?text=%D0%B2%D0%B8%D0%B4%D0%B5%D0%BE$
1025Allow: /video/movies/catalog
1026Allow: /video/touch/movies/catalog
1027Allow: /video/video_sitemap_*.xml
1028Allow: /video/movies_sitemap_*.xml
1029Disallow: /xmlsearch
1030Disallow: /yandsearch
1031Disallow: /yca/cy
1032Disallow: /soft/distribution
1033Disallow: /soft/?*
1034Disallow: /promo/launcher/?*
1035Disallow: /opera/?*
1036Disallow: /firefox/?*
1037Disallow: /soft/bm/?*
1038Disallow: /soft/browsers/?*
1039Disallow: /soft/punto/?*
1040Disallow: /ie/?*
1041Disallow: /soft/*goodbye*
1042Disallow: /adult
1043Disallow: /addappterless
1044Disallow: /archive/api/image.jpg*
1045Allow: /archive$
1046Allow: /archive/project/sovsport$
1047Disallow: /all?
1048Disallow: /games/*?*reqId*
1049Disallow: /games/*?*pageId*
1050Disallow: /games/*?experimental=
1051Disallow: /games/*?*app-id=
1052Disallow: /games/*?*game-id=
1053Disallow: /games/*?*div-rtx-reqid=
1054Disallow: /games/*?*header=
1055Disallow: /games/*?*from=
1056Disallow: /games/*?*clid=
1057Disallow: /games/*?*deviceid=
1058Disallow: /games/*?*flags=
1059Disallow: /games/*?*inapp_id=
1060Disallow: /games/*?*k50id=
1061Disallow: /games/*?*lang=
1062Disallow: /games/*?*payload=
1063Disallow: /games/*?*pfid=
1064Disallow: /games/*?*promo_id=
1065Disallow: /games/*?*promo_intent=
1066Disallow: /games/*?*referrer=
1067Disallow: /games/*?*utm_
1068Disallow: /games/*?*ypr=
1069Disallow: /familysearch
1070Disallow: /schoolsearch
1071Disallow: /yandpage
1072Disallow: *maps/covid19*
1073Disallow: /promo/market/mobile/app*?from=
1074Disallow: /support2/*zout_
1075Disallow: /activity/
1076Disallow: /sport
1077Disallow: /support2/sport*
1078
1079Allow: /medicine
1080Disallow: /medicine/search
1081Disallow: /medicine?text=
1082Disallow: /finance*?
1083Disallow: /finance/assistant
1084
1085User-agent: OAI-SearchBot
1086Disallow: /?
1087Disallow: /403.html
1088Disallow: /404.html
1089Disallow: /500.html
1090Disallow: /adddata
1091Disallow: /adresa-segmentator
1092Disallow: /advanced_engl.html
1093Disallow: /advertising
1094Disallow: /alice/term/
1095Disallow: /alice/*/term/
1096Disallow: /alice/old-browser
1097Disallow: /alice/store/orders/
1098Disallow: /alice*?
1099Disallow: /alice/*&
1100Disallow: /alice/chat/
1101Disallow: /alice?share=
1102Disallow: /all-supported-params
1103Disallow: /articles
1104Disallow: /aura/
1105Allow: /aura/promo/
1106Disallow: /blog/*?text=
1107Disallow: /blog/*?tag=
1108Disallow: /blog/*/*/*
1109Disallow: /blog/punto
1110Disallow: /MAPS/
1111Disallow: /MaPS/
1112Disallow: /MapS/
1113Disallow: /Maps/
1114Disallow: /mApS/
1115Disallow: /harita/business/
1116Disallow: /maps/business/
1117Disallow: /maps-api/docs/js-api/reference-guide/instruction-gxs.html
1118Disallow: /maps-api/docs/js-api/reference-guide/instruction-rs.html
1119Disallow: /catalog/?text=
1120Disallow: /chat
1121Disallow: /cgi-bin/
1122Disallow: /cgi/
1123Disallow: /clck
1124Disallow: /collections/
1125Disallow: /company/*.rss
1126Disallow: /company/search
1127Disallow: /comments/*
1128Disallow: /courier
1129Disallow: /conflagexp
1130Disallow: /cy
1131Disallow: /cycounter
1132Disallow: /dzen
1133Disallow: /experiments.xml
1134Disallow: /formfeedback
1135Disallow: /fresh
1136Disallow: /goto_issue/
1137Disallow: /goto_rubric/
1138Disallow: /gundem
1139Disallow: /i/
1140Disallow: /images-data
1141Disallow: /images.html
1142Disallow: /images/*
1143Disallow: /images-apphost/*
1144Allow: /images/$
1145Allow: /images/smart/$
1146Allow: /images/touch/$
1147Allow: /images/touch/?
1148Allow: /images/search?text=*&source=morda*
1149Allow: /images/search?rpt=imageview
1150Allow: /images/touch/search?text=*&source=morda*
1151Allow: /images/touch/search?rpt=imageview
1152Allow: /images/pad/search?text=*&source=morda*
1153Allow: /images/pad/search?rpt=imageview
1154Disallow: /index_m
1155Disallow: /iznanka/
1156Disallow: /int_search_summary
1157Disallow: /delivery_tracking
1158Disallow: /jobs/skill-diagnostic/private/*
1159Disallow: /keyboard_qwerty.html
1160Disallow: /logotypes
1161Disallow: /business/widget
1162Disallow: /local/
1163Disallow: /lab/neurodetector
1164Disallow: /lab/habr-detector
1165Disallow: /more_samples
1166Disallow: /msearch
1167Disallow: /map-constructor/loader*
1168Disallow: /maps/print/*
1169Allow: /maps/*?lang=ru$
1170Allow: /maps/*?lang=uk$
1171Allow: /maps/*?lang=kk$
1172Allow: /maps/*?lang=uz$
1173Disallow: /nmaps/*?
1174Disallow: /mapeditor/*?
1175Disallow: /metro/*?from
1176Disallow: /masters
1177Disallow: /services/executor/
1178Disallow: /n?
1179Disallow: /n$
1180Disallow: /n/
1181Disallow: /neuralsearch/api
1182Disallow: /norobot
1183Disallow: /opensearch.xml
1184Disallow: /padsearch
1185Disallow: /person
1186Disallow: /podpiska/login.pl
1187Disallow: /pogoda/search
1188Disallow: /pogoda/404
1189Disallow: /pogoda/0
1190Disallow: /polling
1191Disallow: /poll/
1192Disallow: /portal/set/
1193Disallow: /portal/tune/
1194Disallow: /prefetch
1195Disallow: /promo/*goodbye*
1196Disallow: /promo/diskelement
1197Disallow: /promo/launcher/mgoodbye/*
1198Disallow: /promo/*welcome*
1199Disallow: /promo/yobject/changelog*
1200Disallow: /project/eda/partnership_services/$
1201Disallow: /q/profile/*/answers
1202Disallow: /q/profile/*/questions
1203Disallow: /q/profile/*/verifies
1204Disallow: /q/profile/*/articles
1205Disallow: /q/profile/*/subscribers
1206Disallow: /q/profile/*/org_answers
1207Disallow: /q/user/*/answers
1208Disallow: /q/user/*/questions
1209Disallow: /q/user/*/verifies
1210Disallow: /q/user/*/articles
1211Disallow: /q/user/*/subscribers
1212Disallow: /q/user/*/org_answers
1213Disallow: /soft/bm/goodbye
1214Disallow: /soft/chrome/ext-install/*
1215Disallow: /soft/chrome/searchline-install/*
1216Disallow: /soft/*goodbye*
1217Disallow: /soft/punto/mac/uninstall/*
1218Disallow: /soft/punto/win/uninstall/*
1219Disallow: /soft/*welcome*
1220Disallow: /soft/win/?*
1221Disallow: /quotes
1222Disallow: /realty*?*pinned_offer_id=
1223Disallow: /realty*?*pinned_nb_id=
1224Disallow: /realty/search
1225Disallow: /realty*?*text=
1226Disallow: /realty/result
1227Disallow: /realty/map_pins
1228Disallow: /realty/map_dust
1229Disallow: /realty/callme
1230Disallow: /redir
1231Disallow: /region_map
1232Disallow: /regions_list.xml
1233Disallow: /regions.html?
1234Disallow: /s/
1235Disallow: /save
1236Disallow: /safety/?
1237Disallow: /safety?
1238Disallow: /search
1239Allow: /search/entity/touch/
1240Disallow: /setup
1241Disallow: /showcaptcha
1242Disallow: /sitesearch
1243Disallow: /sl/*.html
1244Disallow: /soft/extensions/goodbye
1245Disallow: /sportagent
1246Disallow: /storeclick
1247Disallow: /storerequest
1248Disallow: /subscribe/confirm.pl
1249Disallow: /subscribe/view.pl
1250Allow: /support/
1251Disallow: /support/direct-images
1252Disallow: /support/direct-tooltips
1253Disallow: /support/distr
1254Disallow: /support/dsp
1255Disallow: /support/fe4be44a295cc679e19bf0b8f133083d
1256Disallow: /support/maps-beta
1257Disallow: /support/market-images
1258Disallow: /support/security
1259Disallow: /support/webmaster-images
1260Disallow: /support/*zout_
1261Disallow: /support/search-results/
1262Disallow: /support/praktikum/flow.html
1263Disallow: /support/praktikum-english/
1264Disallow: /telsearch
1265Disallow: /themes
1266Disallow: /toggle-experiment
1267Disallow: /touchsearch
1268Disallow: /tune*retpath=
1269Disallow: /turbo
1270Allow: /ugcpub/
1271Disallow: /ugcpub/cabinet
1272Disallow: /v$
1273Disallow: /viewconfig$
1274Disallow: /images/v$
1275Disallow: /images/viewconfig$
1276Allow: /tutor
1277Disallow: /tutor/admin
1278Disallow: /tutor/search/problems
1279Disallow: /versions
1280Disallow: /video/*
1281Allow: /video/$
1282Allow: /video/?
1283Allow: /video/sitemap
1284Allow: /video/movies/entity
1285Allow: /video/touch/movies/entity
1286Allow: /video/touch/$
1287Allow: /video/touch/?
1288Allow: /video/preview
1289Allow: /video/touch/preview
1290Allow: /video/search?text=video$
1291Allow: /video/touch/search?text=video$
1292Allow: /video/search?text=%D0%B2%D0%B8%D0%B4%D0%B5%D0%BE$
1293Allow: /video/touch/search?text=%D0%B2%D0%B8%D0%B4%D0%B5%D0%BE$
1294Allow: /video/video_sitemap_*.xml
1295Allow: /video/movies_sitemap_*.xml
1296Disallow: /xmlsearch
1297Disallow: /yandsearch
1298Disallow: /yca/cy
1299Disallow: /soft/distribution
1300Disallow: /soft/?*
1301Disallow: /promo/launcher/?*
1302Disallow: /opera/?*
1303Disallow: /firefox/?*
1304Disallow: /soft/bm/?*
1305Disallow: /soft/browsers/?*
1306Disallow: /soft/punto/?*
1307Disallow: /ie/?*
1308Disallow: /soft/*goodbye*
1309Disallow: /adult
1310Disallow: /addappterless
1311Disallow: /archive/api/image.jpg*
1312Allow: /archive$
1313Allow: /archive/project/sovsport$
1314Disallow: /all?
1315Disallow: /games/*?*reqId*
1316Disallow: /games/*?*pageId*
1317Disallow: /games/*?experimental=
1318Disallow: /games/*?*app-id=
1319Disallow: /games/*?*game-id=
1320Disallow: /games/*?*div-rtx-reqid=
1321Disallow: /games/*?*header=
1322Disallow: /games/*?*from=
1323Disallow: /games/*?*clid=
1324Disallow: /games/*?*deviceid=
1325Disallow: /games/*?*flags=
1326Disallow: /games/*?*inapp_id=
1327Disallow: /games/*?*k50id=
1328Disallow: /games/*?*lang=
1329Disallow: /games/*?*payload=
1330Disallow: /games/*?*pfid=
1331Disallow: /games/*?*promo_id=
1332Disallow: /games/*?*promo_intent=
1333Disallow: /games/*?*referrer=
1334Disallow: /games/*?*utm_
1335Disallow: /games/*?*ypr=
1336Disallow: /familysearch
1337Disallow: /schoolsearch
1338Disallow: /yandpage
1339Disallow: *maps/covid19*
1340Disallow: /promo/market/mobile/app*?from=
1341Disallow: /support2/*zout_
1342Disallow: /activity/
1343Disallow: /sport
1344Disallow: /support2/sport
1345
1346Allow: /medicine
1347Disallow: /medicine/search
1348Disallow: /medicine?text=
1349Disallow: /finance
1350Allow: /finance/reviews
1351Allow: /finance/banks/*/reviews
1352Disallow: /finance/reviews*?*
1353Disallow: /finance/banks/*/reviews*?
1354
1355Sitemap: https://yandex.ru/pogoda/sitemap-index.xml
1356Sitemap: https://yandex.ru/support/sitemap.xml
1357Sitemap: https://yandex.ru/blog/sitemap.xml
1358Sitemap: https://frontend.s3.yandex.net/health/sitemap.xml
1359Sitemap: https://yandex.ru/uslugi/sitemap/sitemap.xml.gz
1360Sitemap: https://yandex.ru/turbo/public/sitemap.xml
1361Sitemap: https://yandex.ru/tutor/sitemap/?sitemap=sitemap.xml
1362Sitemap: https://yandex.ru/games/sitemaps/sitemap.index.xml
1363Sitemap: https://yandex.ru/q/sitemap/sitemap-index.xml
1364Sitemap: https://yandex.ru/images/sitemap.xml
1365Sitemap: https://yandex.ru/medicine/sitemaps/sitemap.xml
1366Sitemap: https://yandex.ru/yandexapp/ru/callerid/sitemap.xml
1367Sitemap: https://yandex.ru/video/sitemap_index.xml
1368Sitemap: https://yandex.ru/realty/sitemaps/human_friendly/sitemap_index_hfp-00001.xml
1369Sitemap: https://yandex.ru/images/sitemap_index.xml
1370Sitemap: https://yandex.ru/services/sitemaps/sitemap.xml
1371Sitemap: https://yandex.ru/archive/sitemap.xml
1372
1373Clean-Param: ncrnd&redircnt&clid&_&win /
1374Clean-Param: utm_source&utm_medium&utm_campaign&utm_term&utm_content&utm_nooverride&utm_expid&gclid&_openstat&yclid&gsaid&_gs_rmark&_gs_ref&_gs_cttl&iframe /health/
1375Clean-Param: print=1 /tutor/
1376Clean-Param: w&w_question_id /q/question/*
1377Clean-Param: &appsearch_header=1&comments=1 /news/story/
1378Clean-Param: app-id&game-id&div-rtx-reqid&lang&platform&header&from&backQueryParams /games/
1379Clean-Param: ll&z&sll /maps/
1380Clean-param: oll&rtext&pt&source&via&from&origin&um&utm_medium&utm_source&portal&panorama%5Bspan%5D&panorama%5Bpoint%5D&panorama%5Bfull%5D&panorama%5Bdirection%5D&panorama%5Bair%5D&masstransit%5BstopId%5D&ol&poi%5Bpoint%5D&whatshere%5Bpoint%5D&whatshere%5Bzoom%5D&ouri&ruri&l&mode&tab&rtt&rtm&display-text&text&indoorLevel&trfm&trfst&no-distribution&distance&slices&scale&descy&descx&mapY&mapX&mapID&sctx&lay&where&results&map&id&spn&sspn&rtn&ost&profile-mode /maps/
1381Clean-Param: appsearch_header /pogoda
1382Clean-param: from&publication_id&email_form&id&page&test&year&month&lang&onlyWithCases&gcmes&cmnt_login&_aid¤tURL&res&cmnt_from&&comments&certId&mindbox-message-key&status&menu&block&version&ref&etext&ctime&nw&commentId&yqrid&erid&specializations&specializations[]&cities&workFormats&product&filters&autm_medium&industries&search_open&tasks&search_text®ion®ion_name&lastname /adv/
1383Clean-param: fl_checkpoint&clckid&begin&yprqee&products&yadclid&yadordid&direct&case_products&wvstest&modal&suggest_reqid&only-content&tb&source&p&m-message-key-id&journal&date&months[]&answer_email&url&intermedia&industry&service&country&K1[K2]&lr&budgetOrder&certificate&utm_source&utm_campaign&utm_medium&utm_term&utm_content /adv/
1384Clean-param: z&ll&mapTypeRoute&slug&uuid&app&is_user_location&app_with_layers&app_soyuz&from&dateRoute&clid&via&city&&topic&lat&lon&lang&le_Lightning&from&utm_source&utm_campaign&utm_medium&utm_content&utm_term /pogoda/
1385Clean-param: z&ll&mapTypeRoute&slug&uuid&app&is_user_location&app_with_layers&app_soyuz&from&dateRoute&clid&via&city&&topic&lat&lon&lang&le_Lightning&from&utm_source&utm_campaign&utm_medium&utm_content&utm_term /hava/
1386Clean-param: z&ll&mapTypeRoute&slug&uuid&app&is_user_location&app_with_layers&app_soyuz&from&dateRoute&clid&via&city&&topic&lat&lon&lang&le_Lightning&from&utm_source&utm_campaign&utm_medium&utm_content&utm_term /weather/
1387Clean-param: nw&from_block&mode&mar&photoType®id /pogoda/
1388Clean-param: nw&from_block&mode&mar&photoType®id /hava/
1389Clean-param: nw&from_block&mode&mar&photoType®id /weather/
1390Clean-param: from_pumpkin&le_WindParticles&nowcast&yw_preset&gen_time&for_date&morda_geolocation&retpath&acc_maps&le_TemperatureBalloons&request&le_Borders&elmt&may&source&ids&june&july&referrer&PAGEN_1&from_render_fallback&preset&to&august&appsearch_ys®ion&tm&banner-test-tags /pogoda/
1391Clean-param: stat-id&format-type&actual-format&april&test-tag&adgroup&campaign_id&c&nowcast_header&detailsType&utm_from&bar_exp&march&november&bounds&game&text&city_id&february&september&january&no_turbo&october&ref&december&weather_url&build&lp_source&tab&geoid&cameras&day&thndr_onbrd /pogoda/
1392Clean-param: from_pumpkin&le_WindParticles&nowcast&yw_preset&gen_time&for_date&morda_geolocation&retpath&acc_maps&le_TemperatureBalloons&request&le_Borders&elmt&may&source&ids&june&july&referrer&PAGEN_1&from_render_fallback&preset&to&august&appsearch_ys®ion&tm&banner-test-tags&stat-id /hava/
1393Clean-param: format-type&actual-format&april&test-tag&adgroup&campaign_id&c&nowcast_header&detailsType&utm_from&bar_exp&march&november&bounds&game&text&city_id&february&september&january&no_turbo&october&ref&december&weather_url&build&lp_source&tab&geoid&cameras&day&thndr_onbrd /hava/
1394Clean-param: from_pumpkin&le_WindParticles&nowcast&yw_preset&gen_time&for_date&morda_geolocation&retpath&acc_maps&le_TemperatureBalloons&request&le_Borders&elmt&may&source&ids&june&july&referrer&PAGEN_1&from_render_fallback&preset&to&august&appsearch_ys®ion&tm&banner-test-tags&stat-id /weather/
1395Clean-param: format-type&actual-format&april&test-tag&adgroup&campaign_id&c&nowcast_header&detailsType&utm_from&bar_exp&march&november&bounds&game&text&city_id&february&september&january&no_turbo&october&ref&december&weather_url&build&lp_source&tab&geoid&cameras&day&thndr_onbrd /weather/
1396Clean-param: utm_source&utm_medium&utm_term&utm_content&utm_campaign&yclid&referrer&ref&from&adj_campaign&win&lp_source&openstat /alice/
1397
What do the bots actually get?
This page reads robots.txt, which states what yandex.ru asks of crawlers. A firewall or CDN can still refuse a bot that robots.txt allows. The live check requests the page as each bot and shows the status it gets.
Run a live check on yandex.ru Test a path in the robots.txt tester
History
- 19 October 2026: first checked.
Questions
Does yandex.ru block GPTBot?
No. yandex.ru’s robots.txt lets GPTBot crawl the site. GPTBot is OpenAI’s crawler for training data; blocking it doesn’t affect ChatGPT search, which uses OAI-SearchBot. Checked 9 November 2026.
Does yandex.ru block ClaudeBot?
No. yandex.ru’s robots.txt lets ClaudeBot crawl the site. ClaudeBot is Anthropic’s crawler for training data. Checked 9 November 2026.
Does yandex.ru block Google-Extended?
No. yandex.ru’s robots.txt lets Google-Extended crawl the site. Google-Extended is the token that controls whether Google may use pages for Gemini training and grounding; it doesn’t affect Google Search. Checked 9 November 2026.
Does yandex.ru block PerplexityBot?
No. yandex.ru’s robots.txt lets PerplexityBot crawl the site. PerplexityBot is the crawler that indexes pages for Perplexity’s answers. Checked 9 November 2026.
Can ChatGPT search find yandex.ru?
Partly. yandex.ru’s robots.txt keeps OAI-SearchBot out of some paths, such as /?, and lets it crawl the rest. OAI-SearchBot is the crawler behind ChatGPT search; blocking it keeps the site out of ChatGPT’s search answers. Checked 9 November 2026.