Who blocks AI · #221 in the Majestic Million
robots.txt · checked 9 Nov 2026
Does tripadvisor.com block AI crawlers?
Yes. tripadvisor.com’s robots.txt blocks 9 of the 19 AI crawlers we track, including GPTBot, ClaudeBot, Google-Extended and 6 more. It also blocks PetalBot among search engines.
GPTBotBlockedOAI-SearchBotPartly blockedClaudeBotBlockedPerplexityBotPartly blockedGoogle-ExtendedBlockedCCBotBlocked- robots.txt
- www.tripadvisor.com/robots.txt · 728 lines
- llms.txt
- none
- Checked
- 9 November 2026, as canaicrawl. We check again every week.
Every bot, and the line that decides
Search engines
| Bot | Operator | robots.txt | Deciding line |
|---|---|---|---|
Googlebot | Allowed | no rule matches the home page | |
Bingbot | Microsoft | Partly blocked | line 49 · Disallow: /5349 line 50 · Disallow: /AccommodationTips and 605 more |
DuckDuckBot | DuckDuckGo | Allowed | no rule matches the home page |
Applebot | Apple | Partly blocked | line 49 · Disallow: /5349 line 50 · Disallow: /AccommodationTips and 604 more |
PetalBot | Huawei | Blocked | line 37 · Disallow: / under User-agent: PetalBot |
YandexBot | Yandex | Allowed | no rule matches the home page |
Baiduspider | Baidu | Partly blocked | line 49 · Disallow: /5349 line 50 · Disallow: /AccommodationTips and 606 more |
AI search
| Bot | Operator | robots.txt | Deciding line |
|---|---|---|---|
OAI-SearchBot | OpenAI | Partly blocked | line 49 · Disallow: /5349 line 50 · Disallow: /AccommodationTips and 606 more |
PerplexityBot | Perplexity | Partly blocked | line 49 · Disallow: /5349 line 50 · Disallow: /AccommodationTips and 608 more |
Claude-SearchBot | Anthropic | Allowed | no rule matches the home page |
DuckAssistBot | DuckDuckGo | Allowed | no rule matches the home page |
Amazonbot | Amazon | Blocked | line 37 · Disallow: / under User-agent: Amazonbot |
YouBot | You.com | Blocked | line 37 · Disallow: / under User-agent: YouBot |
AI training
| Bot | Operator | robots.txt | Deciding line |
|---|---|---|---|
GPTBot | OpenAI | Blocked | line 37 · Disallow: / under User-agent: GPTBot |
ClaudeBot | Anthropic | Blocked | line 37 · Disallow: / under User-agent: ClaudeBot |
Google-Extended | Blocked | line 691 · Disallow: / under User-agent: Google-Extended | |
CCBot | Common Crawl | Blocked | line 37 · Disallow: / under User-agent: CCBot |
Applebot-Extended | Apple | Blocked | line 37 · Disallow: / under User-agent: Applebot-Extended |
GoogleOther | Allowed | no rule matches the home page | |
Meta-ExternalAgent | Meta | Blocked | line 37 · Disallow: / under User-agent: meta-externalagent |
Bytespider | ByteDance | Blocked | line 37 · Disallow: / under User-agent: Bytespider |
User-triggered fetchers
| Bot | Operator | robots.txt | Deciding line |
|---|---|---|---|
ChatGPT-User | OpenAI | Partly blocked | line 49 · Disallow: /5349 line 50 · Disallow: /AccommodationTips and 606 more |
Claude-User | Anthropic | Allowed | no rule matches the home page |
Perplexity-User | Perplexity | Allowed | no rule matches the home page |
MistralAI-User | Mistral | Allowed | no rule matches the home page |
Meta-ExternalFetcher | Meta | Allowed | no rule matches the home page |
SEO tools
| Bot | Operator | robots.txt | Deciding line |
|---|---|---|---|
AhrefsBot | Ahrefs | Allowed | no rule matches the home page |
SemrushBot | Semrush | Allowed | no rule matches the home page |
MJ12bot | Majestic | Allowed | no rule matches the home page |
DotBot | Moz | Allowed | no rule matches the home page |
View www.tripadvisor.com/robots.txt · 728 lines
1# Hi there,
2#
3# If you're sniffing around this file, and you're not a robot, we're looking to meet curious folks such as yourself.
4#
5# Think you have what it takes to join the best white-hat SEO growth hackers on the planet?
6#
7# Run - don't crawl - to apply to join Tripadvisor's elite SEO team
8#
9# Email seoRockstar@tripadvisor.com
10#
11# Or visit https://careers.tripadvisor.com/search-results?keywords=seo
12#
13#
14Sitemap: https://www.tripadvisor.com/sitemap/2/en_US/sitemap_en_US_index.xml
15Sitemap: https://www.tripadvisor.com/sitemap/2/en_US/sitemap_en_US_location_photo_direct_link_index.xml
16Sitemap: https://www.tripadvisor.com/sitemap/2/en_US/sitemap_en_US_show_user_reviews_index.xml
17Sitemap: https://www.tripadvisor.com/sitemap/att/en_US/sitemap_en_US_attractions_index.xml
18Sitemap: https://www.tripadvisor.com/sitemap/att/en_US/sitemap_en_US_attraction_review_index.xml
19Sitemap: https://www.tripadvisor.com/sitemap/att/en_US/sitemap_en_US_attraction_product_review_index.xml
20Sitemap: https://www.tripadvisor.com/sitemap/att/en_US/sitemap_en_US_attractions_near_index.xml
21Sitemap: https://www.tripadvisor.com/business/sitemap.xml
22User-Agent: Amazonbot
23User-Agent: Applebot-Extended
24User-Agent: Bytespider
25User-Agent: CCBot
26User-Agent: ClaudeBot
27User-Agent: Cohere-ai
28User-Agent: GPTBot
29User-Agent: Google-CloudVertexBot
30User-Agent: Img2dataset
31User-Agent: PanguBot
32User-Agent: PetalBot
33User-Agent: SentiBot
34User-Agent: YouBot
35User-Agent: magpie-crawler
36User-Agent: meta-externalagent
37Disallow: /
38
39User-Agent: *
40User-Agent: ChatGPT-User
41User-Agent: ChatGPT-User/2.0
42User-Agent: Gemini-Deep-Research
43User-Agent: OAI-SearchBot
44User-Agent: Google-Extended
45User-Agent: applebot
46User-Agent: PerplexityBot
47User-Agent: bingbot
48User-Agent: Baiduspider
49Disallow: /5349
50Disallow: /AccommodationTips
51Disallow: /AccountMerge
52Disallow: /Achievements
53Disallow: /ActionRecord
54Disallow: /AddForumUser
55Disallow: /AddListing
56Disallow: /AdRequestEventLogApi
57Disallow: /AdsManagerAjax
58Disallow: /AdsManagerLanderAjax
59Disallow: /adsoverview
60Disallow: /AirlineRegistration
61Disallow: /AirlineTips
62Disallow: /AITripBuilder
63Disallow: /AllReviews
64Disallow: /analytics
65Disallow: /AnalyticsSuite
66Disallow: /AnswersAjax
67Disallow: /api
68Disallow: /APIAccessSupport
69Disallow: /AppDetail
70Disallow: /AppleMapsAction
71Disallow: /apps
72Disallow: /AppSwipeRecommendations
73Disallow: /AppTravelModeExplore
74Disallow: /AppUploadAPhoto
75Disallow: /AppUserReview
76Disallow: /ArticlesV2
77Disallow: /Attraction_Products
78Disallow: /AttractionAmendTravelDate
79Disallow: /AttractionBookingApi
80Disallow: /AttractionBookingDetails
81Disallow: /AttractionCancelBooking
82Disallow: /AttractionCommerce
83Disallow: /AttractionPartnerRedirect
84Disallow: /AttractionProductDetail
85Disallow: /AttractionProductHighlight
86Disallow: /AuthCheck
87Disallow: /AuthorTool
88Disallow: /avis
89Disallow: /B2BClickTracking
90Disallow: /BAEmailConfirmation
91Disallow: /BALinkImpressionTracking
92Disallow: /BATools
93Disallow: /BeachSweeps
94Disallow: /bewerten
95Disallow: /billing
96Disallow: /BLImpRecord
97Disallow: /blog/wp-admin/
98Disallow: /BlPromoOptOut
99Disallow: /BookingConfirmationShare
100Disallow: /BookingConfirmationSMSResponse
101Disallow: /Bookings
102Disallow: /BrandSpotlight
103Disallow: /businessinfo
104Disallow: /BusinessListingsAjax
105Disallow: /bzzagent
106Disallow: /CampaignConfigAjax
107Disallow: /CampaignConfiguration
108Disallow: /CampaignManagement
109Disallow: /CancelBooking
110Disallow: /CarsComparePartners
111Disallow: /CauseTeaserPopup
112Disallow: /cds/media
113Disallow: /CDSimp
114Disallow: /CertificateOfExcellenceRequestSupport
115Disallow: /Civ
116Disallow: /Claim
117Disallow: /claimrewards
118Disallow: /ClientLink
119Disallow: /CMSImp
120Disallow: /cmsimp
121Disallow: /Collections
122Disallow: /Commerce
123Disallow: /CommLCT
124Disallow: /CommPT
125Disallow: /ConnectivityPartnerFAQ
126Disallow: /ConnectivityPartnerInfo
127Disallow: /Consent
128Disallow: /Content
129Disallow: /CookiePingback
130Disallow: /CoralEditor
131Disallow: /CostPerClick
132Disallow: /CountryAjax
133Disallow: /CruisesCommerce
134Disallow: /CruisesPartnerHandoff
135Disallow: /CurationTool
136Disallow: /data
137Disallow: /DeleteNotify
138Disallow: /DemandLoadAjax
139Disallow: /DestinationGuideWidget
140Disallow: /DestinationReview
141Disallow: /DevMediaRedirector
142Disallow: /DhtmlPopup
143Disallow: /DisplayMap
144Disallow: /DynamicPlacementAjax
145Disallow: /EmailHotel
146Disallow: /EmailMap
147Disallow: /EmailMemberRegistration
148Disallow: /EmailSpellCheckJson
149Disallow: /ErrorPage
150Disallow: /EventDates
151Disallow: /ExpandedUserReviews
152Disallow: /ExperiencesCommerce
153Disallow: /ExperiencesInsights/?s
154Disallow: /ExternalLinkInterstitial
155Disallow: /FacebookConnect
156Disallow: /FindRestaurants
157Disallow: /FinishAppInstall
158Disallow: /Flights?
159Disallow: /ForgotPassword
160Disallow: /ForumFAQ
161Disallow: /ForumPostPreview
162Disallow: /ForumRedirect
163Disallow: /ForumSetSortCookie
164Disallow: /ForumSignIn
165Disallow: /forumTeaser
166Disallow: /ForumVote
167Disallow: /FreeTools
168Disallow: /FullRedirect
169Disallow: /Games
170Disallow: /GARecord
171Disallow: /GeneralSupport
172Disallow: /GermanwingsPromo
173Disallow: /GermanwingsRegistration
174Disallow: /GetListedAjaxGeneral
175Disallow: /GetListedLightbox
176Disallow: /GetListedUpdateAttraction
177Disallow: /GetListedUpdateEatery
178Disallow: /GetMobileApp
179Disallow: /GMapsLocationController
180Disallow: /GOffer
181Disallow: /GOWidget
182Disallow: /Gpits
183Disallow: /GPointCampaign
184Disallow: /GroupHomeApi
185Disallow: /GroupManagementCenter
186Disallow: /GSSAjax
187Disallow: /HandleHotelSuperPortal
188Disallow: /Home-
189Disallow: /Hotel_ReviewHAC
190Disallow: /HotelGMCApi
191Disallow: /HotelHighlight
192Disallow: /HotelsManagementCenter
193Disallow: /HotelWatchAjax
194Disallow: /HowTheSiteWorks
195Disallow: /ImpressionRecord
196Disallow: /ImproveListing
197Disallow: /Inbox
198Disallow: /InformationCenter
199Disallow: /InitializeSession
200Disallow: /InlineReviewerCta
201Disallow: /InterstitialsWidget
202Disallow: /InvoicePayment
203Disallow: /IpadInterstitial
204Disallow: /JoinPlus
205Disallow: /js/
206Disallow: /js2/
207Disallow: /js3/
208Disallow: /JSErrorRecord
209Disallow: /JsonServiceController
210Disallow: /LanderLogger
211Disallow: /LandingPage
212Disallow: /Leaderboard
213Disallow: /LightSubscriptionCenter
214Disallow: /LikeButtonClicked
215Disallow: /LinkGenerator
216Disallow: /ListingQuestionsAjax
217Disallow: /LithiumEmptyPage
218Disallow: /LithiumPageNotFound
219Disallow: /LNAjax
220Disallow: /LocationPhotoAlbum
221Disallow: /LocationPhotosInline
222Disallow: /LocationPhotosLightbox
223Disallow: /LocationPhotosSearch
224Disallow: /LocationTab
225Disallow: /LocationWidget
226Disallow: /LogMediaClick
227Disallow: /MachineTranslation
228Disallow: /ManageListingApi
229Disallow: /ManagementCenter
230Disallow: /ManagePhotos
231Disallow: /ManageShopListingApi
232Disallow: /ManageStoryboard
233Disallow: /MapEmbed
234Disallow: /media/0000
235Disallow: /media/advertorials
236Disallow: /media/attractions-splice-test-spp
237Disallow: /media/bl-video
238Disallow: /media/BookingThumbnails
239Disallow: /media/careers
240Disallow: /media/daodao/photo-f
241Disallow: /media/daodao/photo-l
242Disallow: /media/daodao/photo-t
243Disallow: /media/daodao/video-t
244Disallow: /media/daodao/video-v
245Disallow: /media/fbavatar
246Disallow: /media/forums
247Disallow: /media/ja-content-thumbs
248Disallow: /media/jwplayer
249Disallow: /media/mktg
250Disallow: /media/mobile
251Disallow: /media/oyster
252Disallow: /media/photo-a
253Disallow: /media/photo-f
254Disallow: /media/photo-g
255Disallow: /media/photo-l
256Disallow: /media/photo-o
257Disallow: /media/photo-t
258Disallow: /media/photo-w
259Disallow: /media/ProviderThumbnails
260Disallow: /media/solutions
261Disallow: /media/string
262Disallow: /media/t4b
263Disallow: /media/ta
264Disallow: /media/TALSO.swf
265Disallow: /media/test
266Disallow: /media/thirdpartyflash
267Disallow: /media/tmp
268Disallow: /media/tourism-content
269Disallow: /media/travelpod-roll.flv
270Disallow: /media/TUIThumbnails
271Disallow: /media/unesco
272Disallow: /media/vr-geo-photo-j
273Disallow: /media/vr-geo-photo-l
274Disallow: /media/vr-geo-photo-m
275Disallow: /media/vr-geo-photo-s
276Disallow: /media/vr-ha-splice
277Disallow: /media/vr-nifty-headers
278Disallow: /media/vr-photo-j
279Disallow: /media/vr-photo-l
280Disallow: /media/vr-photo-m
281Disallow: /media/vr-photo-o
282Disallow: /media/vr-photo-q
283Disallow: /media/vr-photo-s
284Disallow: /media/vr-photo-test-j
285Disallow: /media/vr-photo-test-l
286Disallow: /media/vr-photo-test-m
287Disallow: /media/vr-photo-test-o
288Disallow: /media/vr-photo-test-q
289Disallow: /media/vr-photo-test-s
290Disallow: /media/vr-photos
291Disallow: /media/vr-splice-m
292Disallow: /media/vr-splice-s
293Disallow: /media/vr-splice-test-j
294Disallow: /media/vr-splice-test-l
295Disallow: /media/vr-splice-test-m
296Disallow: /media/vr-splice-test-s
297Disallow: /MediaBadgeResponse
298Disallow: /MediaKit
299Disallow: /MediaVoting
300Disallow: /MemberAuditLogger
301Disallow: /MemberBenefitsPopup
302Disallow: /MemberOverlay
303Disallow: /MemberPassportStamps
304Disallow: /MemberPhotos
305Disallow: /MemberProfile
306Disallow: /MemberResetPassword
307Disallow: /members
308Disallow: /MemberSubscribe
309Disallow: /MemberSubscriptionsController
310Disallow: /MemberTagsAjax
311Disallow: /MemberTravelMap
312Disallow: /menu
313Disallow: /Messages
314Disallow: /MessagingOptions
315Disallow: /MetaBestPriceCrossSellAjax
316Disallow: /MetaCheckRatesAjax
317Disallow: /MetaJsonAjax
318Disallow: /MetaPlacementAjax
319Disallow: /MicroMetaAjax
320Disallow: /MiniMetaCRAjax
321Disallow: /missingpage
322Disallow: /mobile
323Disallow: /MobileAddPoi
324Disallow: /MobileAddressLookupAjax
325Disallow: /MobileAirlineDeals
326Disallow: /MobileAirlines
327Disallow: /MobileAirlineTips
328Disallow: /MobileApps
329Disallow: /MobileAttractionsNear
330Disallow: /MobileBookingConfirmationShare
331Disallow: /MobileBookingConfirmationSMSResponse
332Disallow: /MobileBookings
333Disallow: /MobileCancelBooking
334Disallow: /MobileCheapFlightsHome
335Disallow: /MobileCiv
336Disallow: /MobileCookie
337Disallow: /MobileEventRecord
338Disallow: /MobileFAQ
339Disallow: /MobileFilters
340Disallow: /MobileFlights
341Disallow: /MobileFooter
342Disallow: /MobileForgotPassword
343Disallow: /MobileForumRedirect
344Disallow: /MobileForumSetSortCookie
345Disallow: /MobileGetMobileApp
346Disallow: /MobileHeaderCss
347Disallow: /MobileHotelBookingAuthorization
348Disallow: /MobileHotelBookingRecordThreatIdAjax
349Disallow: /MobileHotelCancellationPolicy
350Disallow: /MobileImpressionRecord
351Disallow: /MobileImproveThisListing
352Disallow: /MobileJSErrorRecord
353Disallow: /MobileJson
354Disallow: /MobileListForums
355Disallow: /MobileLocationPhotoDirectLink
356Disallow: /MobileLocationPhotos
357Disallow: /MobileManagementCenter
358Disallow: /MobileManagePhotos
359Disallow: /MobileMemberProfile
360Disallow: /MobileMemberResetPassword
361Disallow: /Mobilemembers
362Disallow: /MobileMyBookingsDetail
363Disallow: /MobileMyBookingsVoucher
364Disallow: /MobileNativeCountrySettings
365Disallow: /MobileNativeCurrencySettings
366Disallow: /MobileNativeSettings
367Disallow: /MobileNearbyAttractions
368Disallow: /MobileNearbyHotels
369Disallow: /MobileNearbyLander
370Disallow: /MobileNearbyRestaurants
371Disallow: /MobileNewsletterSignOut
372Disallow: /MobileNewTopic
373Disallow: /MobileNokiaLauncher
374Disallow: /MobileOlaCabsEstimateAjax
375Disallow: /MobileOwnerVerifyLocation
376Disallow: /MobilePageviewRecord
377Disallow: /MobilePasswordReset
378Disallow: /MobilePhotoUpload
379Disallow: /MobilePOITagging
380Disallow: /MobilePostPhoto
381Disallow: /MobilePostReply
382Disallow: /MobilePromotionDetail
383Disallow: /MobileQueryBBox
384Disallow: /MobileRecent
385Disallow: /MobileRedirector
386Disallow: /MobileRegistration
387Disallow: /MobileReportLocation
388Disallow: /MobileReviewCollect
389Disallow: /MobileSaves
390Disallow: /MobileSearchForums
391Disallow: /MobileShowForum
392Disallow: /MobileShowSpecialOffer
393Disallow: /MobileShowTopic
394Disallow: /MobileShowUserReviews
395Disallow: /MobileStreetView
396Disallow: /MobileTaggingAjax
397Disallow: /MobileTools
398Disallow: /MobileUberEstimateAjax
399Disallow: /MobileUpdateListing
400Disallow: /MobileUserReviewSearchAjax
401Disallow: /MobileVacation_Packages
402Disallow: /MobileWidgetEmbed
403Disallow: /MobileWinphoneLauncher
404Disallow: /ModalRegistrationController
405Disallow: /ModuleAjax
406Disallow: /ModuleBootstrap
407Disallow: /MptUrl
408Disallow: /MsnForumFeedServlet
409Disallow: /MultiOwners
410Disallow: /MultiPartAjax
411Disallow: /MyAchievements
412Disallow: /MyBookingsDetail
413Disallow: /MyBookingsVoucher
414Disallow: /NativeAds
415Disallow: /NetPromoterPopup
416Disallow: /NewMessage
417Disallow: /NewOwners
418Disallow: /NewsletterNews
419Disallow: /NewsLetterPlus
420Disallow: /NewsletterPopupBudgetRomanticFamilyPopup
421Disallow: /NewsletterPopupNewsletterPopup1
422Disallow: /NewsletterSendPassword
423Disallow: /NewsletterSignIn
424Disallow: /NewsletterSignOut
425Disallow: /NewsletterSignupWidget
426Disallow: /NewsPlus
427Disallow: /NewTopic
428Disallow: /notifications
429Disallow: /nova
430Disallow: /OAuthRegistration
431Disallow: /OfferAnnouncementManagement
432Disallow: /OpenGraphLander
433Disallow: /OpeningHours
434Disallow: /OverlayWidgetAjax
435Disallow: /overview
436Disallow: /Owners-
437Disallow: /OwnersDM
438Disallow: /OwnersNew
439Disallow: /OwnersTermsAndConditions
440Disallow: /OwnerSupport
441Disallow: /OwnerVerifyLocation
442Disallow: /PacMan
443Disallow: /pages/rss_terms.html
444Disallow: /PageviewRecord
445Disallow: /PanoramaXml
446Disallow: /PasswordReset
447Disallow: /PaymentFormV2
448Disallow: /PaymentMethodManagement
449Disallow: /PaymentOptions
450Disallow: /pdfs/advertorials/
451Disallow: /pdfs/crm/
452Disallow: /pdfs/email/
453Disallow: /pdfs/tca/
454Disallow: /PersonalizedOnboarding
455Disallow: /PhoneTrackingOptOuts
456Disallow: /photosandvideos
457Disallow: /PhotoUpload
458Disallow: /Pin_Lander
459Disallow: /PlanModeTools
460Disallow: /PlusCommerce
461Disallow: /PoiArea
462Disallow: /PoiDetails
463Disallow: /PoiReviewDetail
464Disallow: /PostPhotosHAC
465Disallow: /PostReply
466Disallow: /PostVideo
467Disallow: /Premium-
468Disallow: /PreviewImage
469Disallow: /PrintGuide
470Disallow: /ProductCart
471Disallow: /ProductError
472Disallow: /ProductPaymentUpdate
473Disallow: /ProductPayNowNewMethod
474Disallow: /Profile
475Disallow: /promotionaltools
476Disallow: /ProxyToolsCustomerSupportForm
477Disallow: /ProxyToolsDiscountCode
478Disallow: /ProxyToolsMemberEditor
479Disallow: /ProxyToolsT4BToolsAccessDenied
480Disallow: /PVLog
481Disallow: /QueryJson
482Disallow: /QuickReview
483Disallow: /Rateit
484Disallow: /RateUserReview
485Disallow: /RatingAjax
486Disallow: /RatingPagingAjax
487Disallow: /RCPCrossSell
488Disallow: /Recaptcha
489Disallow: /recensioni
490Disallow: /Recent
491Disallow: /Redirect
492Disallow: /RegActivation
493Disallow: /RegistrationController
494Disallow: /RegistrationInterceptPopup
495Disallow: /RemindMe
496Disallow: /RentalCarsRedirect
497Disallow: /ReportIAP
498Disallow: /ReportPost
499Disallow: /ResponsibleDisclosure
500Disallow: /RestaurantEnterpriseManagement
501Disallow: /ReviewCollect
502Disallow: /reviewit
503Disallow: /reviews
504Disallow: /RewardsHelp
505Disallow: /RewardsWallet
506Disallow: /RexSpamFilterAjax
507Disallow: /RMReviewCollect
508Disallow: /RsPartnerApi
509Disallow: /rss
510Disallow: /RT
511Disallow: /RuleBasedPopup
512Disallow: /SameGeoActivity
513Disallow: /SavedPhotos
514Disallow: /Saves
515Disallow: /screensaver/
516Disallow: /ScreensaverShade
517Disallow: /Search
518Disallow: /SelfServeAdvertising
519Disallow: /SendToFriend
520Disallow: /SentConfirmationEmail
521Disallow: /ServiceWorker
522Disallow: /SetCookieOverrides
523Disallow: /SetLangFilter
524Disallow: /SetReviewFilter
525Disallow: /Settings
526Disallow: /SetTranslationOption
527Disallow: /ShareWithFriends
528Disallow: /ShoppingCart
529Disallow: /ShortlinkResolver
530Disallow: /ShortSurvey
531Disallow: /ShowSpecialOffer
532Disallow: /ShowTopicWindowShade
533Disallow: /ShowUrl
534Disallow: /ShowUserReviews_Cruises_Responsive
535Disallow: /ShowUserReviewsAirlines
536Disallow: /ShowUserReviewsAttractions
537Disallow: /ShowUserReviewsCruises
538Disallow: /ShowUserReviewsGEO
539Disallow: /ShowUserReviewsHAC
540Disallow: /ShowUserReviewsHotels
541Disallow: /ShowUserReviewsRestaurants
542Disallow: /SingleClickOptOut
543Disallow: /SingleClickSignUp
544Disallow: /SmartDealsHomeAjax
545Disallow: /SocialIapReporting
546Disallow: /SolutionsDisplay
547Disallow: /SortAttractions
548Disallow: /SortEateries
549Disallow: /SortHotels
550Disallow: /SortReviews
551Disallow: /SPCommerceInternal
552Disallow: /specialoffers
553Disallow: /SPOCK
554Disallow: /SponsoredListingCommerce
555Disallow: /SPRedirect
556Disallow: /SpTracking
557Disallow: /static/decodeKey.txt
558Disallow: /StaticPage
559Disallow: /StaticVelocityPage
560Disallow: /StaticVelocityXmlPage
561Disallow: /SubscriptionLander
562Disallow: /SubscriptionPopup
563Disallow: /Summer06Widget
564Disallow: /summerbzz
565Disallow: /SurveyPanelPopup
566Disallow: /SyndicatedPhotos
567Disallow: /Tablet
568Disallow: /tacms
569Disallow: /TADemo
570Disallow: /TaggingAjax
571Disallow: /TagsJSONServlet
572Disallow: /TAMGFooterAjax
573Disallow: /TAMGSubLander
574Disallow: /TAMGSubOffers
575Disallow: /TAOffer
576Disallow: /TAScreenSaver
577Disallow: /TCDestinationsWidget
578Disallow: /TemporarilyClosedNoticeApi
579Disallow: /TestEmptyPage
580Disallow: /TestingTravelMaps
581Disallow: /ThirdPartyRedirect
582Disallow: /ThorHammer
583Disallow: /trapdir
584Disallow: /TravelAdvice
585Disallow: /TravelerInterestNotificationEndpoint
586Disallow: /TravelersChoice?
587Disallow: /TravelersChoiceHome
588Disallow: /TravelersChoicePreview
589Disallow: /TravelersChoiceWidget
590Disallow: /TravellersChoice?
591Disallow: /TravelMap-
592Disallow: /TravelMap?
593Disallow: /TravelMapHome
594Disallow: /TravelMode
595Disallow: /TripBarometer
596Disallow: /TripBuilder
597Disallow: /TripCashGiveaway
598Disallow: /TripConnectAccommodations
599Disallow: /TripConnectBadge
600Disallow: /TripConnectPartner
601Disallow: /TripConnectPaymentFormV2
602Disallow: /TripConnectPlus
603Disallow: /TripConnectPremium
604Disallow: /TripDetails
605Disallow: /Trips?
606Disallow: /Trips/
607Disallow: /TripsNative
608Disallow: /TripWatchPromoAjax
609Disallow: /TripX
610Disallow: /tucritica
611Disallow: /TypeAheadJson
612Disallow: /Unsubscribe
613Disallow: /UpdateCM
614Disallow: /UpdateListing
615Disallow: /UpdateSessionDatesAjax
616Disallow: /UploadMedia
617Disallow: /UserInteractionRecord
618Disallow: /UsernameValidation
619Disallow: /UserPage
620Disallow: /UserReviewController
621Disallow: /UserReviewEdit
622Disallow: /UserReviewHAC
623Disallow: /UserReviewSticker
624Disallow: /UserReviewSupport
625Disallow: /UserReviewThanks
626Disallow: /users
627Disallow: /UserTip
628Disallow: /UserTrackingRecord
629Disallow: /VacationRentalsBlog/?s
630Disallow: /ValidateJson
631Disallow: /VerifyReview
632Disallow: /VideoController
633Disallow: /VideoGallery
634Disallow: /VideoHome?
635Disallow: /ViewMandate
636Disallow: /virtualsupportassistant
637Disallow: /VKRegistration
638Disallow: /VolunteerTranslations
639Disallow: /WatchTopic
640Disallow: /WatermarkPhoto
641Disallow: /WeatherAjax
642Disallow: /WeatherUnderground
643Disallow: /weimg
644Disallow: /WhatsNearby
645Disallow: /WidgetBrowserExtension
646Disallow: /WidgetEmbed
647Disallow: /Widgets-
648Disallow: /WidgetsAjax
649Disallow: /WindowsApp
650Disallow: /wm
651Disallow: /WriteReviewShade
652Disallow: /ZendeskRedirector
653Disallow: /ZendeskSSO
654Disallow: /ZipCodeLookupAjax
655Allow: /api/internal/*/location
656Allow: /api/partner_select/*/price_query
657Allow: /CheapFlightsHome
658Allow: /InfoCenter-a_ctr.april_en
659Allow: /js3/ta-mobile
660Allow: /js3/vr-shared
661Allow: /data/*/crosssellaccommodations
662Allow: /data/1.0/bundle
663
664User-Agent: applebot
665Allow: /media/photo-f
666Allow: /media/daodao
667Allow: /media/photo-l
668Allow: /media/photo-o
669
670User-Agent: PerplexityBot
671Disallow: /ForumHome
672Disallow: /ListForums
673Disallow: /ShowForum
674Disallow: /ShowTopic
675
676User-Agent: bingbot
677Disallow: /LocationPhotoDirectLink
678
679User-Agent: Baiduspider
680Disallow: /LocationPhotoDirectLink
681Disallow: /ShowUserReviews
682
683User-Agent: ChatGPT-User
684User-Agent: ChatGPT-User/2.0
685User-Agent: Gemini-Deep-Research
686User-Agent: OAI-SearchBot
687Disallow: /*-g1875*
688Disallow: /*-g188*
689
690User-Agent: Google-Extended
691Disallow: /
692Allow: /Restaurants-g55711-Dallas_Texas.html
693
694#
695# ==+*##%%%%%%%%%%%%##*+=
696# =+##%%%%%%%%%%%%%%%%%%%%%%%%%%%%%##+=
697# =*%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%#+
698# =*%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%*=
699# =#%%%%%%%%%%%%%%%%%%#*+= =+*##%%%%%%%%%%%%%%%%%#=
700# *%%%%%%%%%%%%%%%%%%%%%%%%%%%%%#+= =+#%%%%%%%%%%%%%%%%%%%%%%%%%%%%%#
701# #%%%%%%%%%%%%%%%%%%%%%%%%%%%*= +%%%%%%%%%%%%%%%%%%%%%%%%%%%#=
702# =%%%%%%%%%%%%%%%%%%%%%%%%%%%%%#+ =#%%%%%%%%%%%%%%%%%%%%%%%%%%%%%+
703# +%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%# *%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%*
704# =%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%#= *%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%+
705# *%%%%%%%%%%%%%*= =+#%%%%%%%%%%%%* *%%%%%%%%%%%%%*= =+*%%%%%%%%%%%%#
706# =%%%%%%%%%%%%%%%%%%%* =*%%%%%%%%%%= =#%%%%%%%%%%%%%%%%%%* =+%%%%%%%%%%+
707# +%%%%%%%%%%%%%%%%%%%%%%= =%%%%%%%%%+ =%%%%%%%%%%%%%%%%%%%%%%+ =#%%%%%%%%*
708# =%%%%%%%%%%%%%%%%%%%%%%%%= +%%%%%%%%+ =%%%%%%%%%%%%%%%%%%%%%%%%+ +%%%%%%%%+
709# =%%%%%%%%+%%%%%%%%%%%%%%%%# =%%%%%%%% %%%%%%%%+#%%%%%%%%%%%%%%%# =#%%%%%%%=
710# #%%%%%%%+ %%%%%%%%%%%%%%%%# =%%%%%%%# *%%%%%%%+ #%%%%%%%%%%%%%%%# =%%%%%%%#
711# =%%%%%%%* *%%%%%%%%%%%%%%%= *%%%%%%%*#%%%%%%% =%%%%%%%%%%%%%%%+ +%%%%%%%+
712# +%%%%%%%= *%%%%%%%%%%%%%= %%%%%%%%%%%%%%%= +%%%%%%%%%%%%%+ %%%%%%%*
713# +%%%%%%% #%%%%%%%%%* %%%%%%%%%%%%%%% *%%%%%%%%%* #%%%%%%*
714# +%%%%%%% ++++= %%%%%%%%%%%%%%% +++++ #%%%%%%*
715# +%%%%%%%= =%%%%%%%%%%%%%%%+ =%%%%%%%+
716# =#%%%%%%# #%%%%%%%%%%%%%%%% #%%%%%%%=
717# *%%%%%%%* *%%%%%%%%%%%%%%%%%# +%%%%%%%*
718# #%%%%%%%* *%%%%%%%%%%%%%%%%%%%# +%%%%%%%%
719# #%%%%%%%%= =%%%%%%%%%%%%%%%%%%%%%%%+ =%%%%%%%%%=
720# #%%%%%%%%#= =#%%%%%%%%%%%%%%%%%%%%%%%%%#= =*%%%%%%%%%=
721# *%%%%%%%%%%#= =#%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%#+ =#%%%%%%%%%%#
722# =#%%%%%%%%%%%%%%####%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%#####%%%%%%%%%%%%%#=
723# =#%%%%%%%%%%%%%%%%%%%%%%%%%%%%#==#%%%%%%%%%%%%+ *%%%%%%%%%%%%%%%%%%%%%%%%%%%%#=
724# +#%%%%%%%%%%%%%%%%%%%%%%#+ +%%%%%%%%%* +#%%%%%%%%%%%%%%%%%%%%%%#*
725# =+#%%%%%%%%%%%%%%%*= *%%%%%# =+#%%%%%%%%%%%%%%%*=
726# ===+== =#%%= ===+===
727
728
What do the bots actually get?
This page reads robots.txt, which states what tripadvisor.com asks of crawlers. A firewall or CDN can still refuse a bot that robots.txt allows. The live check requests the page as each bot and shows the status it gets.
Run a live check on tripadvisor.com Test a path in the robots.txt tester
History
- 19 October 2026: first checked.
Questions
Does tripadvisor.com block GPTBot?
Yes. tripadvisor.com’s robots.txt disallows GPTBot from the whole site (line 37: Disallow: /). GPTBot is OpenAI’s crawler for training data; blocking it doesn’t affect ChatGPT search, which uses OAI-SearchBot. Checked 9 November 2026.
Does tripadvisor.com block ClaudeBot?
Yes. tripadvisor.com’s robots.txt disallows ClaudeBot from the whole site (line 37: Disallow: /). ClaudeBot is Anthropic’s crawler for training data. Checked 9 November 2026.
Does tripadvisor.com block Google-Extended?
Yes. tripadvisor.com’s robots.txt disallows Google-Extended from the whole site (line 691: Disallow: /). Google-Extended is the token that controls whether Google may use pages for Gemini training and grounding; it doesn’t affect Google Search. Checked 9 November 2026.
Does tripadvisor.com block PerplexityBot?
Partly. tripadvisor.com’s robots.txt keeps PerplexityBot out of some paths, such as /5349, and lets it crawl the rest. PerplexityBot is the crawler that indexes pages for Perplexity’s answers. Checked 9 November 2026.
Can ChatGPT search find tripadvisor.com?
Partly. tripadvisor.com’s robots.txt keeps OAI-SearchBot out of some paths, such as /5349, and lets it crawl the rest. OAI-SearchBot is the crawler behind ChatGPT search; blocking it keeps the site out of ChatGPT’s search answers. Checked 9 November 2026.