Who blocks AI · #913 in the Majestic Million
robots.txt · checked 9 Nov 2026
Does amap.com block AI crawlers?
Yes. amap.com’s robots.txt blocks 9 of the 19 AI crawlers we track, including ClaudeBot, Applebot-Extended, Claude-SearchBot and 6 more. It also blocks DuckDuckBot, PetalBot and YandexBot among search engines.
GPTBotPartly blockedOAI-SearchBotPartly blockedClaudeBotBlockedPerplexityBotPartly blockedGoogle-ExtendedPartly blockedCCBotPartly blocked- robots.txt
- amap.com/robots.txt · 939 lines
- llms.txt
- found
- Checked
- 9 November 2026, as canaicrawl. We check again every week.
Every bot, and the line that decides
Search engines
| Bot | Operator | robots.txt | Deciding line |
|---|---|---|---|
Googlebot | Partly blocked | line 45 · Disallow: /service/fav/ line 46 · Disallow: /service/checklogin and 11 more | |
Bingbot | Microsoft | Partly blocked | line 79 · Disallow: /service/fav/ line 80 · Disallow: /service/checklogin and 9 more |
DuckDuckBot | DuckDuckGo | Blocked | line 286 · Disallow: / under User-agent: * |
Applebot | Apple | Partly blocked | line 432 · Disallow: /service/smsGet line 433 · Disallow: /service/smsFlush and 4 more |
PetalBot | Huawei | Blocked | line 286 · Disallow: / under User-agent: * |
YandexBot | Yandex | Blocked | line 286 · Disallow: / under User-agent: * |
Baiduspider | Baidu | Partly blocked | line 12 · Disallow: /service/fav/ line 13 · Disallow: /service/checklogin and 11 more |
AI search
| Bot | Operator | robots.txt | Deciding line |
|---|---|---|---|
OAI-SearchBot | OpenAI | Partly blocked | line 680 · Disallow: /service/smsGet line 681 · Disallow: /service/smsFlush and 4 more |
PerplexityBot | Perplexity | Partly blocked | line 390 · Disallow: /service/smsGet line 391 · Disallow: /service/smsFlush and 4 more |
Claude-SearchBot | Anthropic | Blocked | line 286 · Disallow: / under User-agent: * |
DuckAssistBot | DuckDuckGo | Blocked | line 286 · Disallow: / under User-agent: * |
Amazonbot | Amazon | Partly blocked | line 827 · Disallow: /service/smsGet line 828 · Disallow: /service/smsFlush and 4 more |
YouBot | You.com | Partly blocked | line 848 · Disallow: /service/smsGet line 849 · Disallow: /service/smsFlush and 4 more |
AI training
| Bot | Operator | robots.txt | Deciding line |
|---|---|---|---|
GPTBot | OpenAI | Partly blocked | line 307 · Disallow: /service/smsGet line 308 · Disallow: /service/smsFlush and 4 more |
ClaudeBot | Anthropic | Blocked | line 286 · Disallow: / under User-agent: * |
Google-Extended | Partly blocked | line 411 · Disallow: /service/smsGet line 412 · Disallow: /service/smsFlush and 4 more | |
CCBot | Common Crawl | Partly blocked | line 911 · Disallow: /service/smsGet line 912 · Disallow: /service/smsFlush and 4 more |
Applebot-Extended | Apple | Blocked | line 286 · Disallow: / under User-agent: * |
GoogleOther | Blocked | line 286 · Disallow: / under User-agent: * | |
Meta-ExternalAgent | Meta | Partly blocked | line 890 · Disallow: /service/smsGet line 891 · Disallow: /service/smsFlush and 4 more |
Bytespider | ByteDance | Partly blocked | line 453 · Disallow: /service/smsGet line 454 · Disallow: /service/smsFlush and 4 more |
User-triggered fetchers
| Bot | Operator | robots.txt | Deciding line |
|---|---|---|---|
ChatGPT-User | OpenAI | Partly blocked | line 328 · Disallow: /service/smsGet line 329 · Disallow: /service/smsFlush and 4 more |
Claude-User | Anthropic | Blocked | line 286 · Disallow: / under User-agent: * |
Perplexity-User | Perplexity | Blocked | line 286 · Disallow: / under User-agent: * |
MistralAI-User | Mistral | Blocked | line 286 · Disallow: / under User-agent: * |
Meta-ExternalFetcher | Meta | Blocked | line 286 · Disallow: / under User-agent: * |
SEO tools
| Bot | Operator | robots.txt | Deciding line |
|---|---|---|---|
AhrefsBot | Ahrefs | Blocked | line 286 · Disallow: / under User-agent: * |
SemrushBot | Semrush | Blocked | line 286 · Disallow: / under User-agent: * |
MJ12bot | Majestic | Blocked | line 286 · Disallow: / under User-agent: * |
DotBot | Moz | Blocked | line 286 · Disallow: / under User-agent: * |
View amap.com/robots.txt · 939 lines
1# ============================================
2# 高德地图 PC 端爬虫访问规则
3# 更新时间: 2026-06-01
4# 策略: 全面放开公开路由，保护敏感接口
5# AI爬虫开放 /place/ /ranking/ /postcode/ 等内容页
6# ============================================
7
8# ===== 百度爬虫 =====
9User-agent: Baiduspider
10Allow: /
11# 保护敏感接口
12Disallow: /service/fav/
13Disallow: /service/checklogin
14Disallow: /service/logout
15Disallow: /service/setcookie
16Disallow: /service/pushMessage
17Disallow: /service/pushRoadbook
18Disallow: /service/qrcodeGet
19Disallow: /service/qrcodeConfirm
20Disallow: /service/smsGet
21Disallow: /service/smsFlush
22Disallow: /service/smsSend
23Disallow: /rb/
24Disallow: /bin/
25# 爬取延迟（秒）
26Crawl-delay: 1
27
28# ===== 百度图片爬虫 =====
29User-agent: Baiduspider-image
30Allow: /
31Disallow: /service/fav/
32Disallow: /service/checklogin
33Disallow: /service/logout
34Disallow: /service/smsGet
35Disallow: /service/smsFlush
36Disallow: /service/smsSend
37Disallow: /rb/
38Disallow: /bin/
39Crawl-delay: 2
40
41# ===== Google 爬虫 =====
42User-agent: Googlebot
43Allow: /
44# 保护敏感接口
45Disallow: /service/fav/
46Disallow: /service/checklogin
47Disallow: /service/logout
48Disallow: /service/setcookie
49Disallow: /service/pushMessage
50Disallow: /service/pushRoadbook
51Disallow: /service/qrcodeGet
52Disallow: /service/qrcodeConfirm
53Disallow: /service/smsGet
54Disallow: /service/smsFlush
55Disallow: /service/smsSend
56Disallow: /rb/
57Disallow: /bin/
58# 爬取延迟（秒）
59Crawl-delay: 1
60
61# ===== Bing 爬虫 =====
62User-agent: MSNBot
63Allow: /
64Disallow: /service/fav/
65Disallow: /service/checklogin
66Disallow: /service/logout
67Disallow: /service/setcookie
68Disallow: /service/pushMessage
69Disallow: /service/pushRoadbook
70Disallow: /service/smsGet
71Disallow: /service/smsFlush
72Disallow: /service/smsSend
73Disallow: /rb/
74Disallow: /bin/
75Crawl-delay: 2
76
77User-agent: bingbot
78Allow: /
79Disallow: /service/fav/
80Disallow: /service/checklogin
81Disallow: /service/logout
82Disallow: /service/setcookie
83Disallow: /service/pushMessage
84Disallow: /service/pushRoadbook
85Disallow: /service/smsGet
86Disallow: /service/smsFlush
87Disallow: /service/smsSend
88Disallow: /rb/
89Disallow: /bin/
90Crawl-delay: 2
91
92# ===== 搜狗爬虫 =====
93User-agent: Sogou web spider
94Allow: /
95Disallow: /service/fav/
96Disallow: /service/checklogin
97Disallow: /service/logout
98Disallow: /service/setcookie
99Disallow: /service/pushMessage
100Disallow: /service/pushRoadbook
101Disallow: /service/smsGet
102Disallow: /service/smsFlush
103Disallow: /service/smsSend
104Disallow: /rb/
105Disallow: /bin/
106Crawl-delay: 3
107
108User-agent: Sogou inst spider
109Allow: /
110Disallow: /service/fav/
111Disallow: /service/checklogin
112Disallow: /service/logout
113Disallow: /service/smsGet
114Disallow: /service/smsFlush
115Disallow: /service/smsSend
116Disallow: /rb/
117Disallow: /bin/
118Crawl-delay: 3
119
120User-agent: Sogou spider2
121Allow: /
122Disallow: /service/fav/
123Disallow: /service/checklogin
124Disallow: /service/logout
125Disallow: /service/smsGet
126Disallow: /service/smsFlush
127Disallow: /service/smsSend
128Disallow: /rb/
129Disallow: /bin/
130Crawl-delay: 3
131
132User-agent: Sogou blog
133Allow: /
134Disallow: /service/fav/
135Disallow: /service/checklogin
136Disallow: /service/logout
137Disallow: /service/smsGet
138Disallow: /service/smsFlush
139Disallow: /service/smsSend
140Disallow: /rb/
141Disallow: /bin/
142Crawl-delay: 3
143
144User-agent: Sogou News Spider
145Allow: /
146Disallow: /service/fav/
147Disallow: /service/checklogin
148Disallow: /service/logout
149Disallow: /service/smsGet
150Disallow: /service/smsFlush
151Disallow: /service/smsSend
152Disallow: /rb/
153Disallow: /bin/
154Crawl-delay: 3
155
156User-agent: Sogou Orion spider
157Allow: /
158Disallow: /service/fav/
159Disallow: /service/checklogin
160Disallow: /service/logout
161Disallow: /service/smsGet
162Disallow: /service/smsFlush
163Disallow: /service/smsSend
164Disallow: /rb/
165Disallow: /bin/
166Crawl-delay: 3
167
168# ===== 360 搜索爬虫 =====
169User-agent: 360Spider
170Allow: /
171Disallow: /service/fav/
172Disallow: /service/checklogin
173Disallow: /service/logout
174Disallow: /service/setcookie
175Disallow: /service/pushMessage
176Disallow: /service/pushRoadbook
177Disallow: /service/smsGet
178Disallow: /service/smsFlush
179Disallow: /service/smsSend
180Disallow: /rb/
181Disallow: /bin/
182Crawl-delay: 3
183
184# ===== 神马搜索爬虫 =====
185User-agent: YisouSpider
186Allow: /
187Disallow: /service/fav/
188Disallow: /service/checklogin
189Disallow: /service/logout
190Disallow: /service/smsGet
191Disallow: /service/smsFlush
192Disallow: /service/smsSend
193Disallow: /rb/
194Disallow: /bin/
195Crawl-delay: 3
196
197# ===== 有道爬虫 =====
198User-agent: YoudaoBot
199Allow: /
200Disallow: /service/fav/
201Disallow: /service/checklogin
202Disallow: /service/logout
203Disallow: /service/smsGet
204Disallow: /service/smsFlush
205Disallow: /service/smsSend
206Disallow: /rb/
207Disallow: /bin/
208Crawl-delay: 3
209
210# ===== 中搜爬虫 =====
211User-agent: ChinasoSpider
212Allow: /
213Disallow: /service/fav/
214Disallow: /service/checklogin
215Disallow: /service/logout
216Disallow: /service/smsGet
217Disallow: /service/smsFlush
218Disallow: /service/smsSend
219Disallow: /rb/
220Disallow: /bin/
221Crawl-delay: 3
222
223# ===== 搜搜爬虫 =====
224User-agent: Sosospider
225Allow: /
226Disallow: /service/fav/
227Disallow: /service/checklogin
228Disallow: /service/logout
229Disallow: /service/smsGet
230Disallow: /service/smsFlush
231Disallow: /service/smsSend
232Disallow: /rb/
233Disallow: /bin/
234Crawl-delay: 3
235
236# ===== 宜搜爬虫 =====
237User-agent: EasouSpider
238Allow: /
239Disallow: /service/fav/
240Disallow: /service/checklogin
241Disallow: /service/logout
242Disallow: /service/smsGet
243Disallow: /service/smsFlush
244Disallow: /service/smsSend
245Disallow: /rb/
246Disallow: /bin/
247Crawl-delay: 3
248
249# ===== 即刻搜索爬虫 =====
250User-agent: JikeSpider
251Allow: /
252Disallow: /service/fav/
253Disallow: /service/checklogin
254Disallow: /service/logout
255Disallow: /service/smsGet
256Disallow: /service/smsFlush
257Disallow: /service/smsSend
258Disallow: /rb/
259Disallow: /bin/
260Crawl-delay: 3
261
262# ===== 其他未知爬虫（含未单独列出的AI爬虫）=====
263# 覆盖：QwenBot/TongyiBot、DeepSeekBot、Kimi/MoonshotBot、
264# ChatGLM-Spider、Hunyuan/TencentBot、MiniMaxBot 等
265User-agent: *
266# 允许访问核心内容页面（SEO + GEO）
267Allow: /detail/
268Allow: /search/
269Allow: /dir/
270Allow: /place/
271Allow: /ranking/
272Allow: /postcode/
273Allow: /ssr/doc
274Allow: /service/poiInfo
275Allow: /service/regeo
276Allow: /service/weather
277Allow: /service/poiTips
278# 禁止其他所有路径（包括短信验证码接口）
279Disallow: /service/smsGet
280Disallow: /service/smsFlush
281Disallow: /service/smsSend
282Disallow: /service/
283Disallow: /rb/
284Disallow: /roadbook/
285Disallow: /bin/
286Disallow: /
287# 更长的爬取延迟
288Crawl-delay: 5
289
290# ============================================
291# AI 爬虫（GEO优化：开放核心内容页面）
292# ============================================
293
294# ===== OpenAI GPTBot =====
295User-agent: GPTBot
296Allow: /dir/
297Allow: /place/
298Allow: /detail/
299Allow: /search/
300Allow: /ranking/
301Allow: /postcode/
302Allow: /ssr/doc
303Allow: /service/poiInfo
304Allow: /service/regeo
305Allow: /service/weather
306Allow: /service/poiTips
307Disallow: /service/smsGet
308Disallow: /service/smsFlush
309Disallow: /service/smsSend
310Disallow: /service/
311Disallow: /rb/
312Disallow: /bin/
313Crawl-delay: 2
314
315# ===== OpenAI ChatGPT User Agent =====
316User-agent: ChatGPT-User
317Allow: /dir/
318Allow: /place/
319Allow: /detail/
320Allow: /search/
321Allow: /ranking/
322Allow: /postcode/
323Allow: /ssr/doc
324Allow: /service/poiInfo
325Allow: /service/regeo
326Allow: /service/weather
327Allow: /service/poiTips
328Disallow: /service/smsGet
329Disallow: /service/smsFlush
330Disallow: /service/smsSend
331Disallow: /service/
332Disallow: /rb/
333Disallow: /bin/
334Crawl-delay: 2
335
336# ===== Anthropic Claude =====
337User-agent: Claude-Web
338Allow: /dir/
339Allow: /place/
340Allow: /detail/
341Allow: /search/
342Allow: /ranking/
343Allow: /postcode/
344Allow: /ssr/doc
345Allow: /service/poiInfo
346Allow: /service/regeo
347Allow: /service/weather
348Allow: /service/poiTips
349Disallow: /service/smsGet
350Disallow: /service/smsFlush
351Disallow: /service/smsSend
352Disallow: /service/
353Disallow: /rb/
354Disallow: /bin/
355Crawl-delay: 2
356
357User-agent: Anthropic-AI
358Allow: /dir/
359Allow: /place/
360Allow: /detail/
361Allow: /search/
362Allow: /ranking/
363Allow: /postcode/
364Allow: /ssr/doc
365Allow: /service/poiInfo
366Allow: /service/regeo
367Allow: /service/weather
368Allow: /service/poiTips
369Disallow: /service/smsGet
370Disallow: /service/smsFlush
371Disallow: /service/smsSend
372Disallow: /service/
373Disallow: /rb/
374Disallow: /bin/
375Crawl-delay: 2
376
377# ===== Perplexity =====
378User-agent: PerplexityBot
379Allow: /dir/
380Allow: /place/
381Allow: /detail/
382Allow: /search/
383Allow: /ranking/
384Allow: /postcode/
385Allow: /ssr/doc
386Allow: /service/poiInfo
387Allow: /service/regeo
388Allow: /service/weather
389Allow: /service/poiTips
390Disallow: /service/smsGet
391Disallow: /service/smsFlush
392Disallow: /service/smsSend
393Disallow: /service/
394Disallow: /rb/
395Disallow: /bin/
396Crawl-delay: 2
397
398# ===== Google Gemini (Google-Extended) =====
399User-agent: Google-Extended
400Allow: /dir/
401Allow: /place/
402Allow: /detail/
403Allow: /search/
404Allow: /ranking/
405Allow: /postcode/
406Allow: /ssr/doc
407Allow: /service/poiInfo
408Allow: /service/regeo
409Allow: /service/weather
410Allow: /service/poiTips
411Disallow: /service/smsGet
412Disallow: /service/smsFlush
413Disallow: /service/smsSend
414Disallow: /service/
415Disallow: /rb/
416Disallow: /bin/
417Crawl-delay: 2
418
419# ===== Apple Siri/Spotlight =====
420User-agent: Applebot
421Allow: /dir/
422Allow: /place/
423Allow: /detail/
424Allow: /search/
425Allow: /ranking/
426Allow: /postcode/
427Allow: /ssr/doc
428Allow: /service/poiInfo
429Allow: /service/regeo
430Allow: /service/weather
431Allow: /service/poiTips
432Disallow: /service/smsGet
433Disallow: /service/smsFlush
434Disallow: /service/smsSend
435Disallow: /service/
436Disallow: /rb/
437Disallow: /bin/
438Crawl-delay: 2
439
440# ===== 字节跳动 AI (豆包等) =====
441User-agent: Bytespider
442Allow: /dir/
443Allow: /place/
444Allow: /detail/
445Allow: /search/
446Allow: /ranking/
447Allow: /postcode/
448Allow: /ssr/doc
449Allow: /service/poiInfo
450Allow: /service/regeo
451Allow: /service/weather
452Allow: /service/poiTips
453Disallow: /service/smsGet
454Disallow: /service/smsFlush
455Disallow: /service/smsSend
456Disallow: /service/
457Disallow: /rb/
458Disallow: /bin/
459Crawl-delay: 2
460
461# ===== 阿里通义千问 (Qwen) =====
462User-agent: QwenBot
463Allow: /dir/
464Allow: /place/
465Allow: /detail/
466Allow: /search/
467Allow: /ranking/
468Allow: /postcode/
469Allow: /ssr/doc
470Allow: /service/poiInfo
471Allow: /service/regeo
472Allow: /service/weather
473Allow: /service/poiTips
474Disallow: /service/smsGet
475Disallow: /service/smsFlush
476Disallow: /service/smsSend
477Disallow: /service/
478Disallow: /rb/
479Disallow: /bin/
480Crawl-delay: 2
481
482User-agent: TongyiBot
483Allow: /dir/
484Allow: /place/
485Allow: /detail/
486Allow: /search/
487Allow: /ranking/
488Allow: /postcode/
489Allow: /ssr/doc
490Allow: /service/poiInfo
491Allow: /service/regeo
492Allow: /service/weather
493Allow: /service/poiTips
494Disallow: /service/smsGet
495Disallow: /service/smsFlush
496Disallow: /service/smsSend
497Disallow: /service/
498Disallow: /rb/
499Disallow: /bin/
500Crawl-delay: 2
501
502# ===== DeepSeek =====
503User-agent: DeepSeekBot
504Allow: /dir/
505Allow: /place/
506Allow: /detail/
507Allow: /search/
508Allow: /ranking/
509Allow: /postcode/
510Allow: /ssr/doc
511Allow: /service/poiInfo
512Allow: /service/regeo
513Allow: /service/weather
514Allow: /service/poiTips
515Disallow: /service/smsGet
516Disallow: /service/smsFlush
517Disallow: /service/smsSend
518Disallow: /service/
519Disallow: /rb/
520Disallow: /bin/
521Crawl-delay: 2
522
523User-agent: DeepSeek-User
524Allow: /dir/
525Allow: /place/
526Allow: /detail/
527Allow: /search/
528Allow: /ranking/
529Allow: /postcode/
530Allow: /ssr/doc
531Allow: /service/poiInfo
532Allow: /service/regeo
533Allow: /service/weather
534Allow: /service/poiTips
535Disallow: /service/smsGet
536Disallow: /service/smsFlush
537Disallow: /service/smsSend
538Disallow: /service/
539Disallow: /rb/
540Disallow: /bin/
541Crawl-delay: 2
542
543# ===== 月之暗面 Kimi =====
544User-agent: Kimi
545Allow: /dir/
546Allow: /place/
547Allow: /detail/
548Allow: /search/
549Allow: /ranking/
550Allow: /postcode/
551Allow: /ssr/doc
552Allow: /service/poiInfo
553Allow: /service/regeo
554Allow: /service/weather
555Allow: /service/poiTips
556Disallow: /service/smsGet
557Disallow: /service/smsFlush
558Disallow: /service/smsSend
559Disallow: /service/
560Disallow: /rb/
561Disallow: /bin/
562Crawl-delay: 2
563
564User-agent: MoonshotBot
565Allow: /dir/
566Allow: /place/
567Allow: /detail/
568Allow: /search/
569Allow: /ranking/
570Allow: /postcode/
571Allow: /ssr/doc
572Allow: /service/poiInfo
573Allow: /service/regeo
574Allow: /service/weather
575Allow: /service/poiTips
576Disallow: /service/smsGet
577Disallow: /service/smsFlush
578Disallow: /service/smsSend
579Disallow: /service/
580Disallow: /rb/
581Disallow: /bin/
582Crawl-delay: 2
583
584# ===== 智谱 ChatGLM =====
585User-agent: ChatGLM-Spider
586Allow: /dir/
587Allow: /place/
588Allow: /detail/
589Allow: /search/
590Allow: /ranking/
591Allow: /postcode/
592Allow: /ssr/doc
593Allow: /service/poiInfo
594Allow: /service/regeo
595Allow: /service/weather
596Allow: /service/poiTips
597Disallow: /service/smsGet
598Disallow: /service/smsFlush
599Disallow: /service/smsSend
600Disallow: /service/
601Disallow: /rb/
602Disallow: /bin/
603Crawl-delay: 2
604
605# ===== 腾讯混元 =====
606User-agent: Hunyuan
607Allow: /dir/
608Allow: /place/
609Allow: /detail/
610Allow: /search/
611Allow: /ranking/
612Allow: /postcode/
613Allow: /ssr/doc
614Allow: /service/poiInfo
615Allow: /service/regeo
616Allow: /service/weather
617Allow: /service/poiTips
618Disallow: /service/smsGet
619Disallow: /service/smsFlush
620Disallow: /service/smsSend
621Disallow: /service/
622Disallow: /rb/
623Disallow: /bin/
624Crawl-delay: 2
625
626User-agent: TencentBot
627Allow: /dir/
628Allow: /place/
629Allow: /detail/
630Allow: /search/
631Allow: /ranking/
632Allow: /postcode/
633Allow: /ssr/doc
634Allow: /service/poiInfo
635Allow: /service/regeo
636Allow: /service/weather
637Allow: /service/poiTips
638Disallow: /service/smsGet
639Disallow: /service/smsFlush
640Disallow: /service/smsSend
641Disallow: /service/
642Disallow: /rb/
643Disallow: /bin/
644Crawl-delay: 2
645
646# ===== MiniMax =====
647User-agent: MiniMaxBot
648Allow: /dir/
649Allow: /place/
650Allow: /detail/
651Allow: /search/
652Allow: /ranking/
653Allow: /postcode/
654Allow: /ssr/doc
655Allow: /service/poiInfo
656Allow: /service/regeo
657Allow: /service/weather
658Allow: /service/poiTips
659Disallow: /service/smsGet
660Disallow: /service/smsFlush
661Disallow: /service/smsSend
662Disallow: /service/
663Disallow: /rb/
664Disallow: /bin/
665Crawl-delay: 2
666
667# ===== OpenAI SearchBot =====
668User-agent: OAI-SearchBot
669Allow: /dir/
670Allow: /place/
671Allow: /detail/
672Allow: /search/
673Allow: /ranking/
674Allow: /postcode/
675Allow: /ssr/doc
676Allow: /service/poiInfo
677Allow: /service/regeo
678Allow: /service/weather
679Allow: /service/poiTips
680Disallow: /service/smsGet
681Disallow: /service/smsFlush
682Disallow: /service/smsSend
683Disallow: /service/
684Disallow: /rb/
685Disallow: /bin/
686Crawl-delay: 2
687
688# ===== 字节跳动 豆包 =====
689User-agent: Doubao
690Allow: /dir/
691Allow: /place/
692Allow: /detail/
693Allow: /search/
694Allow: /ranking/
695Allow: /postcode/
696Allow: /ssr/doc
697Allow: /service/poiInfo
698Allow: /service/regeo
699Allow: /service/weather
700Allow: /service/poiTips
701Disallow: /service/smsGet
702Disallow: /service/smsFlush
703Disallow: /service/smsSend
704Disallow: /service/
705Disallow: /rb/
706Disallow: /bin/
707Crawl-delay: 2
708
709# ===== 阿里云 =====
710User-agent: AliyunBot
711Allow: /dir/
712Allow: /place/
713Allow: /detail/
714Allow: /search/
715Allow: /ranking/
716Allow: /postcode/
717Allow: /ssr/doc
718Allow: /service/poiInfo
719Allow: /service/regeo
720Allow: /service/weather
721Allow: /service/poiTips
722Disallow: /service/smsGet
723Disallow: /service/smsFlush
724Disallow: /service/smsSend
725Disallow: /service/
726Disallow: /rb/
727Disallow: /bin/
728Crawl-delay: 2
729
730# ===== 华为盘古 =====
731User-agent: PanguBot
732Allow: /dir/
733Allow: /place/
734Allow: /detail/
735Allow: /search/
736Allow: /ranking/
737Allow: /postcode/
738Allow: /ssr/doc
739Allow: /service/poiInfo
740Allow: /service/regeo
741Allow: /service/weather
742Allow: /service/poiTips
743Disallow: /service/smsGet
744Disallow: /service/smsFlush
745Disallow: /service/smsSend
746Disallow: /service/
747Disallow: /rb/
748Disallow: /bin/
749Crawl-delay: 2
750
751# ===== 科大讯飞星火 =====
752User-agent: iFlytekBot
753Allow: /dir/
754Allow: /place/
755Allow: /detail/
756Allow: /search/
757Allow: /ranking/
758Allow: /postcode/
759Allow: /ssr/doc
760Allow: /service/poiInfo
761Allow: /service/regeo
762Allow: /service/weather
763Allow: /service/poiTips
764Disallow: /service/smsGet
765Disallow: /service/smsFlush
766Disallow: /service/smsSend
767Disallow: /service/
768Disallow: /rb/
769Disallow: /bin/
770Crawl-delay: 2
771
772# ===== 零一万物 =====
773User-agent: YiBot
774Allow: /dir/
775Allow: /place/
776Allow: /detail/
777Allow: /search/
778Allow: /ranking/
779Allow: /postcode/
780Allow: /ssr/doc
781Allow: /service/poiInfo
782Allow: /service/regeo
783Allow: /service/weather
784Allow: /service/poiTips
785Disallow: /service/smsGet
786Disallow: /service/smsFlush
787Disallow: /service/smsSend
788Disallow: /service/
789Disallow: /rb/
790Disallow: /bin/
791Crawl-delay: 2
792
793# ===== 商汤日日新 =====
794User-agent: SenseBot
795Allow: /dir/
796Allow: /place/
797Allow: /detail/
798Allow: /search/
799Allow: /ranking/
800Allow: /postcode/
801Allow: /ssr/doc
802Allow: /service/poiInfo
803Allow: /service/regeo
804Allow: /service/weather
805Allow: /service/poiTips
806Disallow: /service/smsGet
807Disallow: /service/smsFlush
808Disallow: /service/smsSend
809Disallow: /service/
810Disallow: /rb/
811Disallow: /bin/
812Crawl-delay: 2
813
814# ===== Amazon (Alexa/AI) =====
815User-agent: Amazonbot
816Allow: /dir/
817Allow: /place/
818Allow: /detail/
819Allow: /search/
820Allow: /ranking/
821Allow: /postcode/
822Allow: /ssr/doc
823Allow: /service/poiInfo
824Allow: /service/regeo
825Allow: /service/weather
826Allow: /service/poiTips
827Disallow: /service/smsGet
828Disallow: /service/smsFlush
829Disallow: /service/smsSend
830Disallow: /service/
831Disallow: /rb/
832Disallow: /bin/
833Crawl-delay: 2
834
835# ===== You.com =====
836User-agent: YouBot
837Allow: /dir/
838Allow: /place/
839Allow: /detail/
840Allow: /search/
841Allow: /ranking/
842Allow: /postcode/
843Allow: /ssr/doc
844Allow: /service/poiInfo
845Allow: /service/regeo
846Allow: /service/weather
847Allow: /service/poiTips
848Disallow: /service/smsGet
849Disallow: /service/smsFlush
850Disallow: /service/smsSend
851Disallow: /service/
852Disallow: /rb/
853Disallow: /bin/
854Crawl-delay: 2
855
856# ===== Cohere =====
857User-agent: Cohere-AI
858Allow: /dir/
859Allow: /place/
860Allow: /detail/
861Allow: /search/
862Allow: /ranking/
863Allow: /postcode/
864Allow: /ssr/doc
865Allow: /service/poiInfo
866Allow: /service/regeo
867Allow: /service/weather
868Allow: /service/poiTips
869Disallow: /service/smsGet
870Disallow: /service/smsFlush
871Disallow: /service/smsSend
872Disallow: /service/
873Disallow: /rb/
874Disallow: /bin/
875Crawl-delay: 2
876
877# ===== Meta AI =====
878User-agent: Meta-ExternalAgent
879Allow: /dir/
880Allow: /place/
881Allow: /detail/
882Allow: /search/
883Allow: /ranking/
884Allow: /postcode/
885Allow: /ssr/doc
886Allow: /service/poiInfo
887Allow: /service/regeo
888Allow: /service/weather
889Allow: /service/poiTips
890Disallow: /service/smsGet
891Disallow: /service/smsFlush
892Disallow: /service/smsSend
893Disallow: /service/
894Disallow: /rb/
895Disallow: /bin/
896Crawl-delay: 2
897
898# ===== Common Crawl (AI训练数据集) =====
899User-agent: CCBot
900Allow: /dir/
901Allow: /place/
902Allow: /detail/
903Allow: /search/
904Allow: /ranking/
905Allow: /postcode/
906Allow: /ssr/doc
907Allow: /service/poiInfo
908Allow: /service/regeo
909Allow: /service/weather
910Allow: /service/poiTips
911Disallow: /service/smsGet
912Disallow: /service/smsFlush
913Disallow: /service/smsSend
914Disallow: /service/
915Disallow: /rb/
916Disallow: /bin/
917Crawl-delay: 2
918
919# ============================================
920# Sitemap 配置 (同源唯一规范声明)
921# ============================================
922Sitemap: https://www.amap.com/sitemap.xml
923Sitemap: https://www.amap.com/ssr/sitemap-pc-ssr.xml
924
925# ============================================
926# 说明：
927# 1. 主流搜索引擎（百度、Google、Bing等）可以访问所有公开路由
928# 2. 敏感接口（收藏、登录、推送、短信验证码等）对所有爬虫禁止访问
929# 3. 路书管理接口（/rb/）需要认证，禁止爬虫访问
930# 4. 不同爬虫设置了不同的 Crawl-delay：
931# - Google/Bing/百度: 1-2秒（优先级最高）
932# - AI爬虫: 2秒（GPTBot/Claude/千问/DeepSeek/Kimi/智谱/混元/豆包/盘古/讯飞/零一/商汤等）
933# - 其他主流: 3秒（中等优先级）
934# - 未知爬虫: 5秒（低优先级，且限制访问范围）
935# 5. 建议配合服务器端限流机制使用
936# 6. 短信验证码接口已全面禁止爬虫访问
937# 7. AI爬虫开放 /place/ /ranking/ /postcode/ 等内容页（GEO优化）
938# ============================================
939
What do the bots actually get?
This page reads robots.txt, which states what amap.com asks of crawlers. A firewall or CDN can still refuse a bot that robots.txt allows. The live check requests the page as each bot and shows the status it gets.
Run a live check on amap.com Test a path in the robots.txt tester
History
- 19 October 2026: first checked.
- 9 November 2026: robots.txt readable again.
Questions
Does amap.com block GPTBot?
Partly. amap.com’s robots.txt keeps GPTBot out of some paths, such as /service/smsGet, and lets it crawl the rest. GPTBot is OpenAI’s crawler for training data; blocking it doesn’t affect ChatGPT search, which uses OAI-SearchBot. Checked 9 November 2026.
Does amap.com block ClaudeBot?
Yes. amap.com’s robots.txt disallows ClaudeBot from the whole site (line 286: Disallow: /). ClaudeBot is Anthropic’s crawler for training data. Checked 9 November 2026.
Does amap.com block Google-Extended?
Partly. amap.com’s robots.txt keeps Google-Extended out of some paths, such as /service/smsGet, and lets it crawl the rest. Google-Extended is the token that controls whether Google may use pages for Gemini training and grounding; it doesn’t affect Google Search. Checked 9 November 2026.
Does amap.com block PerplexityBot?
Partly. amap.com’s robots.txt keeps PerplexityBot out of some paths, such as /service/smsGet, and lets it crawl the rest. PerplexityBot is the crawler that indexes pages for Perplexity’s answers. Checked 9 November 2026.
Can ChatGPT search find amap.com?
Partly. amap.com’s robots.txt keeps OAI-SearchBot out of some paths, such as /service/smsGet, and lets it crawl the rest. OAI-SearchBot is the crawler behind ChatGPT search; blocking it keeps the site out of ChatGPT’s search answers. Checked 9 November 2026.