AI crawler directory
What is PerplexityBot?
Last verified
Perplexity's search crawler. It surfaces and links websites in Perplexity's search results. Perplexity says it is not used to crawl content for AI foundation models. Robots.txt changes can take up to 24 hours to apply.
PerplexityBot at a glance
- Operator
- Perplexity
- Kind
- Crawler: fetches on its own schedule
- Used for
- Search index
- Feeds
- Perplexity search results
- robots.txt token
PerplexityBot- User agent string
Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; PerplexityBot/1.0; +https://perplexity.ai/perplexitybot)
- Follows robots.txt
- Yes. Perplexity documents the PerplexityBot robots.txt tag as its control.
- Runs JavaScript
- Not documented by the operator
- Published IP ranges
- perplexitybot.json: https://www.perplexity.com/perplexitybot.jsonCheck an address against these ranges
- Official source
- Perplexity Crawlershttps://docs.perplexity.ai/docs/resources/perplexity-crawlers
- Verified
Every AI crawler in one table
PerplexityBot is one of 29 crawlers and fetchers in the AI crawler directory, each checked against its operator's own documentation.