Amazon AdBot

Amazon AdBot FAQs

1. What is Amazon AdBot?
Amazon AdBot is a crawler used by different advertising services at Amazon to determine a website's content in order to provide relevant and appropriate advertising. Amazon AdBot only crawls websites for which Amazon or an advertiser partner may serve an ad.

2. What is the User Agent for Amazon AdBot?
Amazon AdBot identifies itself with the user agent string:
Mozilla/5.0 (compatible; AmazonAdBot/1.0; +https://adbot.amazon.com)

3. Is there a mechanism by which I can control how Amazon AdBot crawls my website?
Yes, via your website's robots.txt file. Robots.txt is a file that website administrators can place at the root of a website to control how web crawlers crawl their pages. Amazon AdBot honors these crawl instructions (Note: Amazon AdBot may crawl ads.txt irrespectively). For example:

3.1 If you want to allow Amazon AdBot to access all pages on your website, add the following lines in your website's robots.txt file:
User-agent: AmazonAdBot Disallow:

3.2 If you want to disallow Amazon AdBot from accessing all pages on your website, add:
User-agent: AmazonAdBot Disallow: /
Note: Disallowing Amazon AdBot from accessing pages on your website may decrease ad relevancy.

3.3 If you want to change the frequency in which AmazonAdBot visits your site, you can specify the acceptable delay (in seconds) between two consecutive crawl requests in your robots.txt file by using the Crawl-Delay directive with value in seconds.

User-agent: AmazonAdBot Crawl-Delay: [value in seconds]
For example: If you would like a 1 second delay between two consecutive crawl requests, you can set the Crawl-Delay to 1.

User-agent: AmazonAdBot Crawl-Delay: 1

4. Is there a mechanism to verify if the Amazon Ad Bot crawl request is genuine?
If you see what appears to be Amazon AdBot traffic in your server logs based on a user agent string such as Mozilla/5.0 (compatible; AmazonAdBot/1.0; +https://adbot.amazon.com) and you want to verify if this traffic is genuine, you may:

Run a reverse DNS lookup on the IP address accessing your website (as found in your logs), using the ‘host’ command.
Verify that the result is a sub-domain of domain name amazonadbot.com.
Run a forward DNS lookup on the fully qualified domain name retrieved in step 1 using the ‘host’ command. Verify that it's the same as the original accessing IP address from your logs.

Example DNS Lookup:

Reverse DNS Lookup


                  example.com ~ $ host 52.70.xx.52

                  52.xx.70.52.in-addr.arpa domain name pointer crawler-52-70-xx-52.amazonadbot.com.

Forward DNS Lookup:


                  example.com ~ $ host crawler-52-70-xx-52.amazonadbot.com

                  crawler-52-70-xx-52.amazonadbot.com has address 52.70.xx.52

The ‘host’ tool is a dns lookup utility that is available on Linux systems, Unix systems and Mac OS. On Windows systems, ‘host’ tool is not available. Alternatively, ’nslookup’ utility can be run from your MS-DOS command line, or from the powershell of latest Windows versions.

Amazon does not post a public list of IP addresses for website owners to add to allow-lists since IP address ranges can change.

5. I have additional questions about Amazon AdBot. Who should I contact?
If you have additional questions about Amazon AdBot, you may contact ContactAdBot@amazon.com.