AI crawler directory
What is Amzn-SearchBot?
Last verified
Used to improve search experiences in Amazon products and services, such as Alexa. Amazon says it does not crawl content for generative AI model training, and follows the rules given to other search bots when robots.txt does not name it.
Amzn-SearchBot at a glance
- Operator
- Amazon
- Kind
- Crawler: fetches on its own schedule
- Used for
- Search index
- Feeds
- Alexa; Amazon search experiences
- robots.txt token
Amzn-SearchBot- User agent string
Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amzn-SearchBot/0.1) Chrome/W.X.Y.Z Safari/537.36
- Follows robots.txt
- Yes. Amazon: automated crawling respects the Robots Exclusion Protocol; crawl-delay is not supported.
- Runs JavaScript
- Not documented by the operator
- Published IP ranges
- Amzn-SearchBot IP addresses: https://developer.amazon.com/amazonbot/searchbot-ip-addresses/
- Official source
- Amazonbothttps://developer.amazon.com/amazonbot
- Verified
Every AI crawler in one table
Amzn-SearchBot is one of 29 crawlers and fetchers in the AI crawler directory, each checked against its operator's own documentation.