AI crawler directory
What is Amazonbot?
Last verified
Used to improve Amazon's products and services, which Amazon says helps it give customers more accurate information and may be used to train Amazon AI models. Amazon says it honours the noarchive meta tag as do not use for model training.
Amazonbot at a glance
- Operator
- Amazon
- Kind
- Crawler: fetches on its own schedule
- Used for
- Model training, Other
- Feeds
- Amazon products and services; Amazon AI model training
- robots.txt token
Amazonbot- User agent string
Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1) Chrome/W.X.Y.Z Safari/537.36
- Follows robots.txt
- Yes. Amazon: automated crawling respects the Robots Exclusion Protocol; crawl-delay is not supported.
- Runs JavaScript
- Not documented by the operator
- Published IP ranges
- Amazonbot IP addresses: https://developer.amazon.com/amazonbot/ip-addresses/
- Official source
- Amazonbothttps://developer.amazon.com/amazonbot
- Verified
Every AI crawler in one table
Amazonbot is one of 29 crawlers and fetchers in the AI crawler directory, each checked against its operator's own documentation.