Who blocks AI · #189 in the Majestic Million
robots.txt · checked 9 Nov 2026
Does ebay.com block AI crawlers?
Yes. ebay.com’s robots.txt blocks 8 of the 19 AI crawlers we track, including GPTBot, ClaudeBot, PerplexityBot and 5 more. Search engines such as Googlebot and Bingbot may crawl it.
GPTBotBlockedOAI-SearchBotPartly blockedClaudeBotBlockedPerplexityBotBlockedGoogle-ExtendedAllowedCCBotBlocked- robots.txt
- www.ebay.com/robots.txt · 1,037 lines
- llms.txt
- none
- Checked
- 9 November 2026, as canaicrawl. We check again every week.
Every bot, and the line that decides
Search engines
| Bot | Operator | robots.txt | Deciding line |
|---|---|---|---|
Googlebot | Partly blocked | line 266 · Disallow: /*_kw line 267 · Disallow: /*?maspect and 214 more | |
Bingbot | Microsoft | Partly blocked | line 502 · Disallow: /*_kw line 503 · Disallow: /b/*_mwBanner=1*rt=nc and 198 more |
DuckDuckBot | DuckDuckGo | Allowed | no rule matches the home page |
Applebot | Apple | Partly blocked | line 266 · Disallow: /*_kw line 267 · Disallow: /*?maspect and 214 more |
PetalBot | Huawei | Allowed | no rule matches the home page |
YandexBot | Yandex | Allowed | no rule matches the home page |
Baiduspider | Baidu | Allowed | no rule matches the home page |
AI search
| Bot | Operator | robots.txt | Deciding line |
|---|---|---|---|
OAI-SearchBot | OpenAI | Partly blocked | line 787 · Disallow: /*_kw line 788 · Disallow: /*?maspect and 208 more |
PerplexityBot | Perplexity | Blocked | line 770 · Disallow: / under User-agent: PerplexityBot |
Claude-SearchBot | Anthropic | Partly blocked | line 787 · Disallow: /*_kw line 788 · Disallow: /*?maspect and 208 more |
DuckAssistBot | DuckDuckGo | Allowed | no rule matches the home page |
Amazonbot | Amazon | Blocked | line 770 · Disallow: / under User-agent: AmazonBot |
YouBot | You.com | Allowed | no rule matches the home page |
AI training
| Bot | Operator | robots.txt | Deciding line |
|---|---|---|---|
GPTBot | OpenAI | Blocked | line 770 · Disallow: / under User-agent: GPTBot |
ClaudeBot | Anthropic | Blocked | line 770 · Disallow: / under User-agent: ClaudeBot |
Google-Extended | Allowed | no rule matches the home page | |
CCBot | Common Crawl | Blocked | line 770 · Disallow: / under User-agent: CCBot |
Applebot-Extended | Apple | Blocked | line 770 · Disallow: / under User-agent: Applebot-Extended |
GoogleOther | Allowed | no rule matches the home page | |
Meta-ExternalAgent | Meta | Blocked | line 770 · Disallow: / under User-agent: meta-externalagent |
Bytespider | ByteDance | Blocked | line 770 · Disallow: / under User-agent: Bytespider |
User-triggered fetchers
| Bot | Operator | robots.txt | Deciding line |
|---|---|---|---|
ChatGPT-User | OpenAI | Partly blocked | line 787 · Disallow: /*_kw line 788 · Disallow: /*?maspect and 208 more |
Claude-User | Anthropic | Partly blocked | line 787 · Disallow: /*_kw line 788 · Disallow: /*?maspect and 208 more |
Perplexity-User | Perplexity | Allowed | no rule matches the home page |
MistralAI-User | Mistral | Allowed | no rule matches the home page |
Meta-ExternalFetcher | Meta | Allowed | no rule matches the home page |
SEO tools
| Bot | Operator | robots.txt | Deciding line |
|---|---|---|---|
AhrefsBot | Ahrefs | Allowed | no rule matches the home page |
SemrushBot | Semrush | Allowed | no rule matches the home page |
MJ12bot | Majestic | Allowed | no rule matches the home page |
DotBot | Moz | Allowed | no rule matches the home page |
View www.ebay.com/robots.txt · 1,037 lines
1## BEGIN FILE ###
2#
3# allow-all
4# DR
5#
6# The use of robots or other automated means to access the eBay site
7# without the express permission of eBay is strictly prohibited.
8# Notwithstanding the foregoing, eBay may permit automated access to
9# access certain eBay pages but solely for the limited purpose of
10# including content in publicly available search engines. Any other
11# use of robots or failure to obey the robots exclusion standards set
12# forth at <https://www.robotstxt.org/orig.html> is strictly
13# prohibited.
14#
15# Robots & Agent Policy
16#
17# Checkouts are strictly for human users.
18# * Automated scraping, buy-for-me agents, LLM-driven bots, or any
19# end-to-end flow that attempts to place orders without human review
20# is strictly prohibited.
21# * Unauthorized use of automated agents in checkout may result in
22# legal action under our User Agreement: https://www.ebay.com/help/policies/member-behaviour-policies/user-agreement?id=4259
23# * Approved enterprise integrations must use our official API and
24# comply with our API License Agreement: https://developer.ebay.com/join/api-license-agreement
25#
26# v30.2_COM_August_2026
27### DIRECTIVES ###
28
29User-agent: *
30Disallow: /*_kw
31Disallow: /*?maspect
32Disallow: /*modules=SEARCH_REFINEMENTS_MODEL_V2
33Disallow: /*redirect=mobile
34Disallow: /*redirect%3Dmobile
35Disallow: /*rt%3Dnc
36Disallow: /*rt=nc
37Disallow: /*src=urllib
38Disallow: /?SSOWebDispatcher&tg=web&ru=
39Disallow: /act/
40Disallow: /adchoice
41Disallow: /buyer-preferences
42Disallow: /motors/diy/blog/*
43Disallow: /motors/fnd/*
44Allow: /ads.txt
45Disallow: /ads
46Disallow: /adsrepository
47Disallow: /afs/
48Disallow: /atc/
49Disallow: /adell-mutfak
50Disallow: /ahu-kadin
51Disallow: /antika-sanat
52Disallow: /arama
53Disallow: */b2ajax/all-filter
54Disallow: /bebek-anne
55Disallow: /bilgisayar-tablet
56Disallow: /cep-telefonu-ve-aksesuar
57Disallow: /delicacy
58Disallow: /ev-bahce
59Disallow: /giyim-aksesuar
60Disallow: /muzik-plak-enstruman
61Disallow: /otomobil-motor-aksesuar
62Allow: /b/adidas-Yeezy-Sneakers-for-Men/15709/bn_86578781?*_trkparms=*pageci:*|parentrq:*iid:0
63Allow: /b/Collectible-Sneakers/bn_7000259435?*_trkparms=*pageci:*|parentrq:*iid:0
64Allow: /b/Jordan-Sneakers-for-Men/15709/bn_96541848?*_trkparms=*pageci:*|parentrq:*iid:0
65Allow: /b/New-Balance-Sneakers-for-Men/15709/bn_58747?*_trkparms=*pageci:*|parentrq:*iid:0
66Allow: /b/Sneakers-for-Men/15709/bn_57918?*_trkparms=*pageci:*|parentrq:*iid:0
67Allow: /b/*?*_mwBanner
68Allow: /b/*?iid=*&var=
69Allow: /b/*?iid=*&chn=ps
70Allow: /b/*?iid=*&var=*&chn=ps
71Disallow: /b/*,
72Disallow: /b/*?iid=*&var=*&
73Disallow: /b/*?iid=*&*&chn=ps
74Disallow: /b/*?iid=*&var=*&*&chn=ps
75Disallow: /b/*?*_nkw
76Disallow: /b/*?*&
77Disallow: /pe/*
78Disallow: /b/*?*|
79Disallow: /b/*%EF
80Disallow: /b/*LH_
81Disallow: /b/*_dmd=
82Disallow: /b/*_dcat=
83Disallow: /b/*_pgn=
84Disallow: /b/*_sacat=
85Disallow: /b/*_saved
86Disallow: /b/*_sid=
87Disallow: /b/*_sop=
88Disallow: /b/*_stpos=
89Disallow: /b/*DO-NOT-BID
90Disallow: /b/*udhi=
91Disallow: /b/*udlo=
92Disallow: /b/Test-Category
93Disallow: /b/eBay-Use-Only
94Disallow: /b/eBay-Test-Only
95Disallow: /b/LP-Parent
96Disallow: /b/LL-Child
97Disallow: /b/eBay-User-Tools
98Disallow: /b/Test-Auctions
99Disallow: /b/Attributes
100Disallow: /bfl/
101Disallow: /bgmt/
102Disallow: /bin/
103Disallow: /blueberry/
104Disallow: /bo/
105Disallow: /brw/
106Disallow: /c/
107Disallow: /cancel/
108Disallow: /chocolatechip/
109Disallow: /clp/
110Disallow: /clt/store/
111Disallow: /cnt/
112Disallow: /contact/
113Disallow: /csc/
114Disallow: /cta/
115Disallow: /ctg/
116Disallow: /ctm/
117Disallow: /d/graphql
118Disallow: /dsc/
119Disallow: /e/*?
120Disallow: /easy-shop
121Disallow: /ebay/cronus/
122Disallow: /ebaylive/host
123Disallow: /ecaptcha/
124Disallow: /edc/
125Disallow: /experience/fic
126Disallow: /explore
127Disallow: /feed/
128Disallow: /fdbk/
129Disallow: /ficapp/
130Disallow: /fol/
131Disallow: /g/api/
132Disallow: /gh/cart
133Disallow: /gh/collectbehaviorinfo
134Disallow: /gh/collectsysteminfo
135Disallow: /gh/useracquisition
136Disallow: /gh/user_profile
137Disallow: /gsr/
138Disallow: /gss/
139Disallow: /gum/
140Disallow: /gwc/
141Disallow: /hcp/
142Disallow: /heute/
143Disallow: /ico/
144Disallow: /ifh
145Disallow: /ipp/
146Disallow: /itc/
147Disallow: /itemmodules/
148Disallow: /itemnotreceived/
149Disallow: /itempolicy
150Disallow: /itm/*,
151Disallow: /itm/*/%
152Disallow: /itm/*/[
153Disallow: /itm/*/browser.json
154Disallow: /itm/*action=BESTOFFER
155Disallow: /itm/*boolp=
156Disallow: /itm/*_nkw
157Disallow: /itm/*?fits
158Disallow: /itm/*&fits
159Disallow: /itm/*.jpg
160Disallow: /itm/*/%7B%7B
161Disallow: /itm/:/
162Disallow: /itm/*_pgn=
163Disallow: /itm/addToCart
164Disallow: /itm/fetchmodules
165Disallow: /itm/sellerInfoV2
166Disallow: /itm/soi
167Disallow: /itm/variationlogistics
168Disallow: /itm/watch/
169Disallow: /itmhero/
170Disallow: /lit/
171Disallow: /logout
172Disallow: /looking-glass-proxy/graphql
173Disallow: /lstng
174Disallow: /lst/ng/
175Disallow: /lux/
176Disallow: /lvx/
177Disallow: /mbf/
178Disallow: /merchanism/
179Disallow: /mes/
180Disallow: /mla/
181Disallow: /mlt/
182Disallow: /myb
183Disallow: /mye
184Disallow: /myebay
185Disallow: /mys
186Disallow: /nap/
187Disallow: /nectar
188Disallow: /npk/
189Disallow: /p/*thm=
190Disallow: /p/*surveyopen
191Disallow: /p/moduleprovider/
192Disallow: /p/surveyopen
193Disallow: /personalization/
194Disallow: /pgfeapp
195Disallow: /price-guide/
196Disallow: /prp/
197Disallow: /rcm/
198Disallow: /recfb?
199Disallow: /recs/
200Disallow: /res/
201Disallow: /rewards
202Disallow: /rtm*
203Disallow: /rvh/
204Disallow: /rye
205Allow: /sch/ebayadvsearch
206Allow: /sch/allcategories/
207Allow: /sch/*_ul
208Allow: /sch/*_fosrp
209Allow: /sch/*_trksid
210Allow: /sch/i.html?*&mkcid=2
211Disallow: /sch/i.html?_nkw=
212Disallow: /sch/i.html?*_nkw=*&
213Disallow: /sch/
214Disallow: /sch/*_sacat=
215Disallow: /sch/ajax
216Disallow: /sch/ebayadvsearch?_
217Disallow: /sh/onboarding
218Disallow: /sh/str/fvfsavings
219Disallow: /ship/
220Disallow: /shop/*&
221Allow: /signin/$
222Disallow: /signin/
223Disallow: /sio/
224Disallow: /siteminderagent/
225Disallow: /sl/*bn_*?
226Disallow: /sl/*SellLikeItem
227Disallow: /sl/*wnstart
228Disallow: /sl/node
229Disallow: /sl/ipe
230Disallow: /sme/
231Disallow: /smevi/
232Disallow: /sndmsg?
233Disallow: /soc/
234Disallow: /splashui/
235Disallow: /splashui_rc/
236Disallow: /srv/
237Disallow: /str/*_sacat
238Disallow: /str/*modules=STORE_CATEGORIES
239Disallow: /str/beacon/storefrontbeacon
240Disallow: /str/ssdemo
241Disallow: /str/svc
242Disallow: /talk/
243Disallow: /tickets/
244Disallow: /tkt
245Disallow: /today/
246Disallow: /trylater/
247Disallow: /ulk/i/
248Disallow: /ulk/sch/
249Disallow: /ulk/usr/
250Allow: /urw/*/product-reviews/
251Disallow: /urw/
252Disallow: /usr/*/all-follows
253Disallow: /usr/*/followers
254Disallow: /vas
255Disallow: /viitem
256Disallow: /vlabl
257Disallow: /vlt
258Disallow: /vod/
259Disallow: /vplbl/
260Disallow: /vsp/
261Disallow: /.well-known/resource-that-should-not-exist-whose-status-code-should-not-be-200
262Disallow: /wcs/
263Disallow: /ws/
264
265User-agent: Googlebot
266Disallow: /*_kw
267Disallow: /*?maspect
268Disallow: /*modules=SEARCH_REFINEMENTS_MODEL_V2
269Disallow: /*redirect=mobile
270Disallow: /*redirect%3Dmobile
271Disallow: /*rt%3Dnc
272Disallow: /*rt=nc
273Disallow: /*src=urllib
274Disallow: /?SSOWebDispatcher&tg=web&ru=
275Disallow: /act/
276Disallow: /adchoice
277Disallow: /buyer-preferences
278Disallow: /motors/diy/blog/*
279Disallow: /motors/fnd/*
280Allow: /ads.txt
281Disallow: /ads
282Disallow: /adsrepository
283Disallow: /afs/
284Disallow: /atc/
285Disallow: /adell-mutfak
286Disallow: /ahu-kadin
287Disallow: /antika-sanat
288Disallow: /arama
289Disallow: */b2ajax/all-filter
290Disallow: /bebek-anne
291Disallow: /bilgisayar-tablet
292Disallow: /cep-telefonu-ve-aksesuar
293Disallow: /delicacy
294Disallow: /ev-bahce
295Disallow: /giyim-aksesuar
296Disallow: /muzik-plak-enstruman
297Disallow: /otomobil-motor-aksesuar
298Allow: /b/adidas-Yeezy-Sneakers-for-Men/15709/bn_86578781?*_trkparms=*pageci:*|parentrq:*iid:0
299Allow: /b/Collectible-Sneakers/bn_7000259435?*_trkparms=*pageci:*|parentrq:*iid:0
300Allow: /b/Jordan-Sneakers-for-Men/15709/bn_96541848?*_trkparms=*pageci:*|parentrq:*iid:0
301Allow: /b/New-Balance-Sneakers-for-Men/15709/bn_58747?*_trkparms=*pageci:*|parentrq:*iid:0
302Allow: /b/Sneakers-for-Men/15709/bn_57918?*_trkparms=*pageci:*|parentrq:*iid:0
303Allow: /b/*?*_mwBanner
304Allow: /b/*?iid=*&var=
305Allow: /b/*?iid=*&chn=ps
306Allow: /b/*?iid=*&var=*&chn=ps
307Disallow: /b/*,
308Disallow: /b/*?iid=*&var=*&
309Disallow: /b/*?iid=*&*&chn=ps
310Disallow: /b/*?iid=*&var=*&*&chn=ps
311Disallow: /b/*?*_nkw
312Disallow: /b/*?*&
313Disallow: /pe/*
314Disallow: /b/*?*|
315Disallow: /b/*%EF
316Disallow: /b/*LH_
317Disallow: /b/*_dmd=
318Disallow: /b/*_dcat=
319Disallow: /b/*_pgn=
320Disallow: /b/*_sacat=
321Disallow: /b/*_saved
322Disallow: /b/*_sid=
323Disallow: /b/*_sop=
324Disallow: /b/*_stpos=
325Disallow: /b/*DO-NOT-BID
326Disallow: /b/*udhi=
327Disallow: /b/*udlo=
328Disallow: /b/Test-Category
329Disallow: /b/eBay-Use-Only
330Disallow: /b/eBay-Test-Only
331Disallow: /b/LP-Parent
332Disallow: /b/LL-Child
333Disallow: /b/eBay-User-Tools
334Disallow: /b/Test-Auctions
335Disallow: /b/Attributes
336Disallow: /bfl/
337Disallow: /bgmt/
338Disallow: /bin/
339Disallow: /blueberry/
340Disallow: /bo/
341Disallow: /brw/
342Disallow: /c/
343Disallow: /cancel/
344Disallow: /chocolatechip/
345Disallow: /clp/
346Disallow: /clt/store/
347Disallow: /cnt/
348Disallow: /contact/
349Disallow: /csc/
350Disallow: /cta/
351Disallow: /ctg/
352Disallow: /ctm/
353Disallow: /d/graphql
354Disallow: /dsc/
355Disallow: /e/*?
356Disallow: /easy-shop
357Disallow: /ebay/cronus/
358Disallow: /ebaylive/host
359Disallow: /ecaptcha/
360Disallow: /edc/
361Disallow: /experience/fic
362Disallow: /explore
363Disallow: /feed/
364Disallow: /fdbk/
365Disallow: /ficapp/
366Disallow: /fol/
367Disallow: /g/api/
368Disallow: /gh/cart
369Disallow: /gh/collectbehaviorinfo
370Disallow: /gh/collectsysteminfo
371Disallow: /gh/useracquisition
372Disallow: /gh/user_profile
373Disallow: /gsr/
374Disallow: /gss/
375Disallow: /gum/
376Disallow: /gwc/
377Disallow: /hcp/
378Disallow: /heute/
379Disallow: /ico/
380Disallow: /ifh
381Disallow: /ipp/
382Disallow: /itc/
383Disallow: /itemmodules/
384Disallow: /itemnotreceived/
385Disallow: /itempolicy
386Disallow: /itm/*,
387Disallow: /itm/*/%
388Disallow: /itm/*/[
389Disallow: /itm/*/browser.json
390Disallow: /itm/*action=BESTOFFER
391Disallow: /itm/*boolp=
392Disallow: /itm/*_nkw
393Disallow: /itm/*?fits
394Disallow: /itm/*&fits
395Disallow: /itm/*.jpg
396Disallow: /itm/*/%7B%7B
397Disallow: /itm/:/
398Disallow: /itm/*_pgn=
399Disallow: /itm/addToCart
400Disallow: /itm/fetchmodules
401Disallow: /itm/sellerInfoV2
402Disallow: /itm/soi
403Disallow: /itm/variationlogistics
404Disallow: /itm/watch/
405Disallow: /itmhero/
406Disallow: /lit/
407Disallow: /logout
408Disallow: /looking-glass-proxy/graphql
409Disallow: /lstng
410Disallow: /lst/ng/
411Disallow: /lux/
412Disallow: /lvx/
413Disallow: /mbf/
414Disallow: /merchanism/
415Disallow: /mes/
416Disallow: /mla/
417Disallow: /mlt/
418Disallow: /myb
419Disallow: /mye
420Disallow: /myebay
421Disallow: /mys
422Disallow: /nap/
423Disallow: /nectar
424Disallow: /npk/
425Disallow: /p/*thm=
426Disallow: /p/*surveyopen
427Disallow: /p/moduleprovider/
428Disallow: /p/surveyopen
429Disallow: /personalization/
430Disallow: /pgfeapp
431Disallow: /price-guide/
432Disallow: /prp/
433Disallow: /rcm/
434Disallow: /recfb?
435Disallow: /recs/
436Disallow: /res/
437Disallow: /rewards
438Disallow: /rtm*
439Disallow: /rvh/
440Disallow: /rye
441Allow: /sch/ebayadvsearch
442Allow: /sch/allcategories/
443Allow: /sch/*_ul
444Allow: /sch/*_fosrp
445Allow: /sch/*_trksid
446Allow: /sch/i.html?*&mkcid=2
447Disallow: /sch/i.html?_nkw=
448Disallow: /sch/i.html?*_nkw=*&
449Disallow: /sch/
450Disallow: /sch/*_sacat=
451Disallow: /sch/ajax
452Disallow: /sch/ebayadvsearch?_
453Disallow: /sh/onboarding
454Disallow: /sh/str/fvfsavings
455Disallow: /ship/
456Disallow: /shop/*&
457Allow: /signin/$
458Disallow: /signin/
459Disallow: /sio/
460Disallow: /siteminderagent/
461Disallow: /sl/*bn_*?
462Disallow: /sl/*SellLikeItem
463Disallow: /sl/*wnstart
464Disallow: /sl/node
465Disallow: /sl/ipe
466Disallow: /sme/
467Disallow: /smevi/
468Disallow: /sndmsg?
469Disallow: /soc/
470Disallow: /splashui/
471Disallow: /splashui_rc/
472Disallow: /srv/
473Disallow: /str/*_sacat
474Disallow: /str/*modules=STORE_CATEGORIES
475Disallow: /str/beacon/storefrontbeacon
476Disallow: /str/ssdemo
477Disallow: /str/svc
478Disallow: /talk/
479Disallow: /tickets/
480Disallow: /tkt
481Disallow: /today/
482Disallow: /trylater/
483Disallow: /ulk/i/
484Disallow: /ulk/sch/
485Disallow: /ulk/usr/
486Allow: /urw/*/product-reviews/
487Disallow: /urw/
488Disallow: /usr/*/all-follows
489Disallow: /usr/*/followers
490Disallow: /vas
491Disallow: /viitem
492Disallow: /vlabl
493Disallow: /vlt
494Disallow: /vod/
495Disallow: /vplbl/
496Disallow: /vsp/
497Disallow: /.well-known/resource-that-should-not-exist-whose-status-code-should-not-be-200
498Disallow: /wcs/
499Disallow: /ws/
500
501User-agent: bingbot
502Disallow: /*_kw
503Disallow: /b/*_mwBanner=1*rt=nc
504Disallow: /b/*rt=nc*_mwBanner=1
505Disallow: /motors/diy/beacon/
506Disallow: /*?maspect
507Disallow: /*modules=SEARCH_REFINEMENTS_MODEL_V2
508Disallow: /*redirect=mobile
509Disallow: /*redirect%3Dmobile
510Disallow: /*rt%3Dnc
511Disallow: /*rt=nc
512Disallow: /*src=urllib
513Disallow: /?SSOWebDispatcher&tg=web&ru=
514Disallow: /act/
515Disallow: /adchoice
516Allow: /ads.txt
517Disallow: /ads
518Disallow: /adsrepository
519Disallow: /afs/
520Disallow: /atc/
521Allow: /b/adidas-Yeezy-Sneakers-for-Men/15709/bn_86578781?*_trkparms=*pageci:*|parentrq:*iid:0
522Allow: /b/Collectible-Sneakers/bn_7000259435?*_trkparms=*pageci:*|parentrq:*iid:0
523Allow: /b/Jordan-Sneakers-for-Men/15709/bn_96541848?*_trkparms=*pageci:*|parentrq:*iid:0
524Allow: /b/New-Balance-Sneakers-for-Men/15709/bn_58747?*_trkparms=*pageci:*|parentrq:*iid:0
525Allow: /b/Sneakers-for-Men/15709/bn_57918?*_trkparms=*pageci:*|parentrq:*iid:0
526Allow: /b/*?*_mwBanner
527Allow: /b/*?iid=*&var=
528Allow: /b/*?iid=*&chn=ps
529Allow: /b/*?iid=*&var=*&chn=ps
530Disallow: /b/*,
531Disallow: /b/*?iid=*&var=*&
532Disallow: /b/*?iid=*&*&chn=ps
533Disallow: /b/*?iid=*&var=*&*&chn=ps
534Disallow: /b/*?*_nkw
535Disallow: /b/*?*&
536Disallow: /b/*?*|
537Disallow: /b/*%EF
538Disallow: /b/*LH_
539Disallow: /b/*_dmd=
540Disallow: /b/*_dcat=
541Disallow: /b/*_pgn=
542Disallow: /b/*_sacat=
543Disallow: /b/*_saved
544Disallow: /b/*_sid=
545Disallow: /b/*_sop=
546Disallow: /b/*_stpos=
547Disallow: /b/*DO-NOT-BID
548Disallow: /b/*udhi=
549Disallow: /b/*udlo=
550Disallow: /b/Test-Category
551Disallow: /b/eBay-Use-Only
552Disallow: /b/eBay-Test-Only
553Disallow: /b/LP-Parent
554Disallow: /b/LL-Child
555Disallow: /b/eBay-User-Tools
556Disallow: /b/Test-Auctions
557Disallow: /b/Attributes
558Disallow: /bfl/
559Disallow: /bgmt/
560Disallow: /bin/
561Disallow: /blueberry/
562Disallow: /bo/
563Disallow: /brw/
564Disallow: /c/
565Disallow: /cancel/
566Disallow: /chocolatechip/
567Disallow: /clp/
568Disallow: /clt/store/
569Disallow: /contact/
570Disallow: /cnt/
571Disallow: /csc/
572Disallow: /cta/
573Disallow: /ctg/
574Disallow: /ctm/
575Disallow: /d/graphql
576Disallow: /delicacy
577Disallow: /dsc/
578Disallow: /e/*?
579Disallow: /easy-shop
580Disallow: /ebay/cronus/
581Disallow: /ebaylive/host
582Disallow: /ecaptcha/
583Disallow: /edc/
584Disallow: /experience/fic
585Disallow: /explore
586Disallow: /feed/
587Disallow: /fdbk/
588Disallow: /ficapp/
589Disallow: /fol/
590Disallow: /g/api/
591Disallow: /gh/collectbehaviorinfo
592Disallow: /gh/collectsysteminfo
593Disallow: /gh/useracquisition
594Disallow: /gh/user_profile
595Disallow: /gsr/
596Disallow: /gss/
597Disallow: /gwc/
598Disallow: /hcp/
599Disallow: /heute/
600Disallow: /ico/
601Disallow: /ifh
602Disallow: /ipp/
603Disallow: /itc/
604Disallow: /itemmodules/
605Disallow: /itemnotreceived/
606Disallow: /itempolicy
607Disallow: /itm/*,
608Disallow: /itm/*/%
609Disallow: /itm/*/[
610Disallow: /itm/*/browser.json
611Disallow: /itm/*action=BESTOFFER
612Disallow: /itm/*boolp=
613Disallow: /itm/*_nkw
614Disallow: /itm/*?fits
615Disallow: /itm/*&fits
616Disallow: /itm/*.jpg
617Disallow: /itm/*/%7B%7B
618Disallow: /itm/:/
619Disallow: /itm/*_pgn=
620Disallow: /itm/addToCart
621Disallow: /itm/fetchmodules
622Disallow: /itm/sellerInfoV2
623Disallow: /itm/soi
624Disallow: /itm/variationlogistics
625Disallow: /itm/watch/
626Disallow: /itmhero/
627Disallow: /lit/
628Disallow: /looking-glass-proxy/graphql
629Disallow: /logout
630Disallow: /lstng
631Disallow: /lst/ng/
632Disallow: /lux/
633Disallow: /lvx/
634Disallow: /mbf/
635Disallow: /merchanism/
636Disallow: /mes/
637Disallow: /mla/
638Disallow: /mlt/
639Disallow: /myb
640Disallow: /mye
641Disallow: /myebay
642Disallow: /mys
643Disallow: /nap/
644Disallow: /nectar
645Disallow: /npk/
646Disallow: /p/*thm=
647Disallow: /p/*surveyopen
648Disallow: /p/moduleprovider/
649Disallow: /p/surveyopen
650Disallow: /personalization/
651Disallow: /pgfeapp
652Disallow: /price-guide/
653Disallow: /prp/
654Disallow: /rcm/
655Disallow: /recfb?
656Disallow: /recs/
657Disallow: /res/
658Disallow: /rewards
659Disallow: /rtm*
660Disallow: /rvh/
661Disallow: /rye
662Allow: /sch/ebayadvsearch
663Allow: /sch/allcategories/
664Allow: /sch/i.html?*&mkcid=2
665Allow: /sch/i.html*_sop=12
666Disallow: /sch/
667Disallow: /sch/*_sacat=
668Disallow: /sch/ajax
669Disallow: /sch/ebayadvsearch?_
670Disallow: /sch/i.html?_nkw=
671Disallow: /sch/i.html*_sop=12*&
672Disallow: /sh/onboarding
673Disallow: /sh/str/fvfsavings
674Disallow: /ship/
675Disallow: /shop/*&
676Allow: /signin/$
677Disallow: /signin/
678Disallow: /sio/
679Disallow: /siteminderagent/
680Disallow: /sl/*bn_*?
681Disallow: /sl/*SellLikeItem
682Disallow: /sl/*wnstart
683Disallow: /sl/ipe
684Disallow: /sl/node
685Disallow: /sme/
686Disallow: /smevi/
687Disallow: /sndmsg?
688Disallow: /soc/
689Disallow: /splashui/
690Disallow: /splashui_rc/
691Disallow: /srv/
692Disallow: /str/*_sacat
693Disallow: /str/*modules=STORE_CATEGORIES
694Disallow: /str/beacon/storefrontbeacon
695Disallow: /str/ssdemo
696Disallow: /str/svc
697Disallow: /talk/
698Disallow: /tickets/
699Disallow: /tkt
700Disallow: /today/
701Disallow: /trylater/
702Disallow: /ulk/i/
703Disallow: /ulk/sch/
704Disallow: /ulk/usr/
705Allow: /urw/*/product-reviews/
706Disallow: /urw/
707Disallow: /usr/
708Disallow: /vas
709Disallow: /viitem
710Disallow: /vlabl
711Disallow: /vlt
712Disallow: /vod/
713Disallow: /vplbl/
714Disallow: /vsp/
715Disallow: /.well-known/resource-that-should-not-exist-whose-status-code-should-not-be-200
716Disallow: /wcs/
717Disallow: /ws/
718
719User-agent: AdsBot-Google
720Disallow: /*src=urllib
721Disallow: /motors/diy/beacon/
722Disallow: /adell-mutfak
723Disallow: /ahu-kadin
724Disallow: /antika-sanat
725Disallow: /arama
726Disallow: /bebek-anne
727Disallow: /bilgisayar-tablet
728Disallow: /cep-telefonu-ve-aksesuar
729Disallow: /ev-bahce
730Disallow: /giyim-aksesuar
731Disallow: /muzik-plak-enstruman
732Disallow: /nap/
733Disallow: /otomobil-motor-aksesuar
734Disallow: /srv/
735
736User-agent: AdIdxBot
737Disallow: /*src=urllib
738Disallow: /adell-mutfak
739Disallow: /ahu-kadin
740Disallow: /antika-sanat
741Disallow: /arama
742Disallow: /bebek-anne
743Disallow: /bilgisayar-tablet
744Disallow: /cep-telefonu-ve-aksesuar
745Disallow: /ev-bahce
746Disallow: /giyim-aksesuar
747Disallow: /muzik-plak-enstruman
748Disallow: /nap/
749Disallow: /otomobil-motor-aksesuar
750Disallow: /srv/
751
752User-agent: Twitterbot
753Disallow: /*src=urllib
754Disallow: /srv/
755
756#
757# LLM / AI bot directives
758#
759
760User-agent: Bytespider
761User-agent: CCBot
762User-agent: ChatGLM-Spider
763User-agent: ClaudeBot
764User-agent: PerplexityBot
765User-agent: anthropic-ai
766User-agent: AmazonBot
767User-agent: meta-externalagent
768User-agent: GPTBot
769User-agent: Applebot-Extended
770Disallow: /
771Allow: /adchoice
772Allow: /authenticity-guarantee
773Allow: /motors/blog
774Allow: /motors/diy
775Allow: /help
776Allow: /sellercenter
777Allow: /ebaylive/seller
778Allow: /sl/sell
779Allow: /sh/landing
780Allow: /giftcards
781Allow: /shp/calc/rates
782
783User-agent: OAI-SearchBot
784User-agent: ChatGPT-User
785User-agent: Claude-SearchBot
786User-agent: Claude-User
787Disallow: /*_kw
788Disallow: /*?maspect
789Disallow: /*modules=SEARCH_REFINEMENTS_MODEL_V2
790Disallow: /*redirect=mobile
791Disallow: /*redirect%3Dmobile
792Disallow: /*rt%3Dnc
793Disallow: /*rt=nc
794Disallow: /*src=urllib
795Disallow: /?SSOWebDispatcher&tg=web&ru=
796Disallow: /act/
797Disallow: /adchoice
798Disallow: /buyer-preferences
799Disallow: /motors/diy/blog/*
800Disallow: /motors/fnd/*
801Allow: /ads.txt
802Disallow: /ads
803Disallow: /adsrepository
804Disallow: /afs/
805Disallow: /atc/
806Disallow: /adell-mutfak
807Disallow: /ahu-kadin
808Disallow: /antika-sanat
809Disallow: /arama
810Disallow: */b2ajax/all-filter
811Disallow: /bebek-anne
812Disallow: /bilgisayar-tablet
813Disallow: /cep-telefonu-ve-aksesuar
814Disallow: /delicacy
815Disallow: /ev-bahce
816Disallow: /giyim-aksesuar
817Disallow: /muzik-plak-enstruman
818Disallow: /otomobil-motor-aksesuar
819Allow: /b/adidas-Yeezy-Sneakers-for-Men/15709/bn_86578781?*_trkparms=*pageci:*|parentrq:*iid:0
820Allow: /b/Collectible-Sneakers/bn_7000259435?*_trkparms=*pageci:*|parentrq:*iid:0
821Allow: /b/Jordan-Sneakers-for-Men/15709/bn_96541848?*_trkparms=*pageci:*|parentrq:*iid:0
822Allow: /b/New-Balance-Sneakers-for-Men/15709/bn_58747?*_trkparms=*pageci:*|parentrq:*iid:0
823Allow: /b/Sneakers-for-Men/15709/bn_57918?*_trkparms=*pageci:*|parentrq:*iid:0
824Allow: /b/*?*_mwBanner
825Allow: /b/*?iid=*&var=
826Allow: /b/*?iid=*&chn=ps
827Allow: /b/*?iid=*&var=*&chn=ps
828Disallow: /b/*,
829Disallow: /b/*?iid=*&var=*&
830Disallow: /b/*?iid=*&*&chn=ps
831Disallow: /b/*?iid=*&var=*&*&chn=ps
832Disallow: /b/*?*_nkw
833Disallow: /b/*?*&
834Disallow: /pe/*
835Disallow: /b/*?*|
836Disallow: /b/*%EF
837Disallow: /b/*LH_
838Disallow: /b/*_dmd=
839Disallow: /b/*_dcat=
840Disallow: /b/*_pgn=
841Disallow: /b/*_sacat=
842Disallow: /b/*_saved
843Disallow: /b/*_sid=
844Disallow: /b/*_sop=
845Disallow: /b/*_stpos=
846Disallow: /b/*DO-NOT-BID
847Disallow: /b/*udhi=
848Disallow: /b/*udlo=
849Disallow: /b/Test-Category
850Disallow: /b/eBay-Use-Only
851Disallow: /b/eBay-Test-Only
852Disallow: /b/LP-Parent
853Disallow: /b/LL-Child
854Disallow: /b/eBay-User-Tools
855Disallow: /b/Test-Auctions
856Disallow: /b/Attributes
857Disallow: /bfl/
858Disallow: /bgmt/
859Disallow: /bin/
860Disallow: /blueberry/
861Disallow: /bo/
862Disallow: /brw/
863Disallow: /c/
864Disallow: /cancel/
865Disallow: /chocolatechip/
866Disallow: /clp/
867Disallow: /clt/store/
868Disallow: /cnt/
869Disallow: /contact/
870Disallow: /csc/
871Disallow: /cta/
872Disallow: /ctg/
873Disallow: /ctm/
874Disallow: /dsc/
875Disallow: /e/*?
876Disallow: /easy-shop
877Disallow: /ebay/cronus/
878Disallow: /ebaylive/host
879Disallow: /ecaptcha/
880Disallow: /edc/
881Disallow: /experience/fic
882Disallow: /explore
883Disallow: /feed/
884Disallow: /fdbk/
885Disallow: /ficapp/
886Disallow: /fol/
887Disallow: /g/api/
888Disallow: /gh/cart
889Disallow: /gh/collectbehaviorinfo
890Disallow: /gh/collectsysteminfo
891Disallow: /gh/useracquisition
892Disallow: /gh/user_profile
893Disallow: /gsr/
894Disallow: /gss/
895Disallow: /gum/
896Disallow: /gwc/
897Disallow: /hcp/
898Disallow: /heute/
899Disallow: /ico/
900Disallow: /ifh
901Disallow: /ipp/
902Disallow: /itc/
903Disallow: /itemmodules/
904Disallow: /itemnotreceived/
905Disallow: /itempolicy
906Disallow: /itm/*,
907Disallow: /itm/*/%
908Disallow: /itm/*/[
909Disallow: /itm/*/browser.json
910Disallow: /itm/*action=BESTOFFER
911Disallow: /itm/*boolp=
912Disallow: /itm/*_nkw
913Disallow: /itm/*?fits
914Disallow: /itm/*&fits
915Disallow: /itm/*.jpg
916Disallow: /itm/*/%7B%7B
917Disallow: /itm/:/
918Disallow: /itm/*_pgn=
919Disallow: /itm/addToCart
920Disallow: /itm/fetchmodules
921Disallow: /itm/sellerInfoV2
922Disallow: /itm/soi
923Disallow: /itm/variationlogistics
924Disallow: /itm/watch/
925Disallow: /itmhero/
926Disallow: /lit/
927Disallow: /logout
928Disallow: /lstng
929Disallow: /lst/ng/
930Disallow: /lux/
931Disallow: /lvx/
932Disallow: /mbf/
933Disallow: /merchanism/
934Disallow: /mes/
935Disallow: /mla/
936Disallow: /mlt/
937Disallow: /myb
938Disallow: /mye
939Disallow: /myebay
940Disallow: /mys
941Disallow: /nap/
942Disallow: /nectar
943Disallow: /npk/
944Disallow: /p/*thm=
945Disallow: /p/*surveyopen
946Disallow: /p/moduleprovider/
947Disallow: /p/surveyopen
948Disallow: /personalization/
949Disallow: /pgfeapp
950Disallow: /price-guide/
951Disallow: /prp/
952Disallow: /rcm/
953Disallow: /recfb?
954Disallow: /recs/
955Disallow: /res/
956Disallow: /rewards
957Disallow: /rtm*
958Disallow: /rvh/
959Disallow: /rye
960Allow: /sch/
961Disallow: /sch/ajax
962Disallow: /sch/ebayadvsearch?_
963Disallow: /sh/onboarding
964Disallow: /sh/str/fvfsavings
965Disallow: /ship/
966Disallow: /shop/*&
967Allow: /signin/$
968Disallow: /signin/
969Disallow: /sio/
970Disallow: /siteminderagent/
971Disallow: /sl/*bn_*?
972Disallow: /sl/*SellLikeItem
973Disallow: /sl/*wnstart
974Disallow: /sl/node
975Disallow: /sl/ipe
976Disallow: /sme/
977Disallow: /smevi/
978Disallow: /sndmsg?
979Disallow: /soc/
980Disallow: /splashui/
981Disallow: /splashui_rc/
982Disallow: /srv/
983Disallow: /str/*_sacat
984Disallow: /str/*modules=STORE_CATEGORIES
985Disallow: /str/beacon/storefrontbeacon
986Disallow: /str/ssdemo
987Disallow: /str/svc
988Disallow: /talk/
989Disallow: /tickets/
990Disallow: /tkt
991Disallow: /today/
992Disallow: /trylater/
993Disallow: /ulk/i/
994Disallow: /ulk/sch/
995Disallow: /ulk/usr/
996Allow: /urw/*/product-reviews/
997Disallow: /urw/
998Disallow: /usr/*/all-follows
999Disallow: /usr/*/followers
1000Disallow: /vas
1001Disallow: /viitem
1002Disallow: /vlabl
1003Disallow: /vlt
1004Disallow: /vod/
1005Disallow: /vplbl/
1006Disallow: /vsp/
1007Disallow: /.well-known/resource-that-should-not-exist-whose-status-code-should-not-be-200
1008Disallow: /wcs/
1009Disallow: /ws/
1010
1011User-agent: OAI-AdsBot
1012Allow: /b/*?*mkcid=32*
1013Allow: /itm/*?*mkcid=32*
1014Disallow: /
1015
1016# AUCTION Sitemaps
1017Sitemap: https://www.ebay.com/lst/AUCTION-0-index.xml
1018
1019# BROWSE Sitemaps
1020Sitemap: https://www.ebay.com/lst/BROWSE-0-index.xml
1021
1022# KWSRP Sitemaps
1023Sitemap: https://www.ebay.com/lst/KWSRP-0-index.xml
1024
1025# NGS Sitemaps
1026Sitemap: https://www.ebay.com/lst/NGS-0-index.xml
1027
1028# PRP Sitemaps
1029Sitemap: https://www.ebay.com/lst/PRP-0-index.xml
1030
1031# VIDEO Sitemaps
1032Sitemap: https://www.ebay.com/lst/VIDEO-0-index.xml
1033
1034# VIS Sitemaps
1035Sitemap: https://www.ebay.com/lst/VIS-0-index.xml
1036
1037### END FILE ###
What do the bots actually get?
This page reads robots.txt, which states what ebay.com asks of crawlers. A firewall or CDN can still refuse a bot that robots.txt allows. The live check requests the page as each bot and shows the status it gets.
Run a live check on ebay.com Test a path in the robots.txt tester
History
- 19 October 2026: first checked.
Questions
Does ebay.com block GPTBot?
Yes. ebay.com’s robots.txt disallows GPTBot from the whole site (line 770: Disallow: /). GPTBot is OpenAI’s crawler for training data; blocking it doesn’t affect ChatGPT search, which uses OAI-SearchBot. Checked 9 November 2026.
Does ebay.com block ClaudeBot?
Yes. ebay.com’s robots.txt disallows ClaudeBot from the whole site (line 770: Disallow: /). ClaudeBot is Anthropic’s crawler for training data. Checked 9 November 2026.
Does ebay.com block Google-Extended?
No. ebay.com’s robots.txt lets Google-Extended crawl the site. Google-Extended is the token that controls whether Google may use pages for Gemini training and grounding; it doesn’t affect Google Search. Checked 9 November 2026.
Does ebay.com block PerplexityBot?
Yes. ebay.com’s robots.txt disallows PerplexityBot from the whole site (line 770: Disallow: /). PerplexityBot is the crawler that indexes pages for Perplexity’s answers. Checked 9 November 2026.
Can ChatGPT search find ebay.com?
Partly. ebay.com’s robots.txt keeps OAI-SearchBot out of some paths, such as /*_kw, and lets it crawl the rest. OAI-SearchBot is the crawler behind ChatGPT search; blocking it keeps the site out of ChatGPT’s search answers. Checked 9 November 2026.