AI search · Amazon

Amazonbot

Amazon’s crawler, used so Alexa and other Amazon services can answer questions from web pages.

Operator: Amazon
Purpose: AI answers. Crawlers that build the indexes AI assistants answer from and cite. Blocking one keeps you out of its answers.
robots.txt token: Amazonbot
User agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 10_10_1) AppleWebKit/600.2.5 (KHTML, like Gecko) Version/8.0.2 Safari/600.2.5 (Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot)
Documentation: developer.amazon.com/amazonbot

Block Amazonbot

Add a group naming it to /robots.txt. Compliant crawlers stop before requesting any page. A firewall rule on the user agent is the only way to enforce it against crawlers that ignore robots.txt.

User-agent: Amazonbot
Disallow: /

Allow Amazonbot when everything else is blocked

A group naming the bot wins over User-agent: *, so an explicit allow lets it in while your catch-all rules stay in place.

User-agent: Amazonbot
Allow: /

User-agent: *
Disallow: /

Does Amazonbot reach your site?

The checker applies your robots.txt the way Amazonbot does, then requests your page with the user agent above, alongside 29 other bots.

Other ai search: OAI-SearchBot, PerplexityBot, Claude-SearchBot, DuckAssistBot, YouBot.

Build a complete file with the robots.txt generator.