Amazonbot
Amazonbot is Amazon’s web crawler. Amazon says it improves Amazon’s products and services, such as more accurate answers for customers, and may be used to train Amazon’s AI models. It follows robots.txt, but Amazon keeps a cached copy of your file for up to 30 days.
- Operator
- Amazon
- Purpose
- AI answers. Crawlers that build the indexes AI assistants answer from and cite. Blocking one keeps you out of its answers.
- robots.txt token
Amazonbot- We test with
Mozilla/5.0 (Macintosh; Intel Mac OS X 10_10_1) AppleWebKit/600.2.5 (KHTML, like Gecko) Version/8.0.2 Safari/600.2.5 (Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot)
an older Amazonbot string with theAmazonbot/0.1token; Amazon’s current example is above.- Documentation
- developer.amazon.com/amazonbot
What Amazonbot does
Amazonbot is used to improve our products and services. This helps us provide more accurate information to customers and may be used to train Amazon AI models.
developer.amazon.com
| Bot | What it does | Model training |
|---|---|---|
Amazonbot | Crawls for Amazon’s products and services | May be used |
Amzn-SearchBot | Crawls for Amazon’s search experiences | No, Amazon says |
Amzn-User | Fetches pages for a user’s request; may not follow every robots.txt rule | No, Amazon says |
The Amazonbot user agent
| Request | User agent string |
|---|---|
| Pages | Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1) Chrome/W.X.Y.Z Safari/537.36 |
W.X.Y.Z stands for a Chrome version. Match on Amazonbot.
How Amazonbot reads robots.txt
Automated crawling from these listed user agents respects the Robots Exclusion Protocol, honoring the user-agent and the allow/disallow directives. They will fetch host-level robots.txt files or use a cached copy from the last 30 days. When a file can’t be fetched, they will behave as if it does not exist.
developer.amazon.com
- No Crawl-delay. Amazon says its bots don’t support it.
- Changes take about a day, Amazon says, but a cached robots.txt up to 30 days old may be used.
- Page-level opt-outs work. Amazon honours
noarchive, which it treats as “do not use the page for model training”, andnoindex. - Each subdomain has its own robots.txt.
Amazonbot IP addresses and how to verify them
Amazon publishes Amazonbot’s addresses as a JSON list inside a web page, rather than as a JSON file, and documents no reverse DNS names (the addresses we checked had generic Amazon EC2 names). The list holds single addresses.
| List | Covers | IPv4 | IPv6 | Dated |
|---|---|---|---|---|
| developer.amazon.com/amazonbot/ip-addresses/ | Amazonbot | 1292 | 0 | 8 September 2026 |
Amazon publishes separate pages for Amzn-SearchBot and Amzn-User.
Check an IP now
Paste an address from your logs. We match it against Amazon’s current list, along with the lists of the other operators that publish them.
Block Amazonbot at your firewall or CDN
robots.txt asks; a firewall enforces. A rule on the user agent refuses Amazonbot even if it doesn’t honour robots.txt. Match the name case-insensitively and anywhere in the string, never a full string or a version.
Cloudflare
In Security → WAF → Custom rules, create a rule with this expression and the action Block. Cloudflare’s contains is case-sensitive, hence lower().
(lower(http.user_agent) contains "amazonbot")
Cloudflare also has one-click controls: AI bot policies, which block AI crawlers by what they do (search, agent or training), and AI Crawl Control, which lets you allow or block crawlers one by one and shows which of them fetch your pages.
nginx
# in the http block
map $http_user_agent $blocked_bot {
default 0;
~*amazonbot 1;
}
# in the server block
if ($blocked_bot) { return 403; }
Block Amazonbot
Add a group naming it to /robots.txt. Compliant crawlers stop before requesting any page. A firewall rule on the user agent is the only way to enforce it against crawlers that ignore robots.txt. Amazon says this is honoured within about a day, though its bots may use a cached robots.txt up to 30 days old. To opt individual pages out of training only, Amazon honours noarchive.
User-agent: Amazonbot
Disallow: /
Allow Amazonbot when everything else is blocked
A group naming the bot wins over User-agent: *, so an explicit allow lets it in while your catch-all rules stay in place.
User-agent: Amazonbot
Allow: /
User-agent: *
Disallow: /
Does Amazonbot reach your site?
The checker applies your robots.txt the way Amazonbot does, then requests your page with the user agent above, alongside 29 other bots, and opens the report on Amazonbot.
Questions about Amazonbot
What is Amazonbot?
Amazon’s web crawler. Amazon says it is used to improve its products and services, such as providing more accurate information to customers, and may be used to train Amazon AI models.
Does Amazonbot respect robots.txt?
Yes. Amazon says its automated crawlers follow the Robots Exclusion Protocol, though they may use a cached robots.txt up to 30 days old and don’t support Crawl-delay.
How do I stop Amazon training on my pages?
Disallow Amazonbot in robots.txt, or add a noarchive robots meta tag to pages; Amazon treats noarchive as “do not use the page for model training”.
What IP addresses does Amazonbot use?
Amazon lists them on developer.amazon.com/amazonbot/ip-addresses/: 1,292 single IPv4 addresses and no IPv6 in October 2026. It documents no reverse DNS check.
Other ai search: OAI-SearchBot, PerplexityBot, Claude-SearchBot, DuckAssistBot, YouBot.
Build a complete file with the robots.txt generator.