AI crawler directory
What is Applebot-Extended?
Last verified
A robots.txt control token, not a crawler. It governs whether content Applebot crawls may train Apple's foundation models for Apple Intelligence, Services and Developer Tools. Apple says pages that disallow it can still appear in search results.
Applebot-Extended at a glance
- Operator
- Apple
- Kind
- Control token: read in robots.txt, sends no requests
- Used for
- Model training
- Feeds
- Apple foundation model training
- robots.txt token
Applebot-Extended- User agent string
- Apple: Applebot-Extended does not crawl webpages. It is a robots.txt control token only.
- Follows robots.txt
- Yes. Apple documents the token for use in robots.txt only.
- Runs JavaScript
- Not documented by the operator
- Published IP ranges
- None of its own: the crawling is done by Applebot: https://search.developer.apple.com/applebot.json
- Official source
- About Applebothttps://support.apple.com/en-us/119829
- Verified
Every AI crawler in one table
Applebot-Extended is one of 29 crawlers and fetchers in the AI crawler directory, each checked against its operator's own documentation.