AI crawler directory
What is MistralAI-Index?
Last verified
Crawls the web automatically, for indexing only, to build Mistral search, which helps answer questions in Vibe. Mistral says content it crawls is not used for generative AI training of any kind.
MistralAI-Index at a glance
- Operator
- Mistral
- Kind
- Crawler: fetches on its own schedule
- Used for
- Search index
- Feeds
- Mistral search; Vibe
- robots.txt token
MistralAI-Index- User agent string
Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; MistralAI-Index/1.0; +https://docs.mistral.ai/robots)
- Follows robots.txt
- Not documented by the operator
- Runs JavaScript
- Not documented by the operator
- Published IP ranges
- mistralai-index-ips.json: https://mistral.ai/mistralai-index-ips.jsonCheck an address against these ranges
- Official source
- Mistral crawlershttps://docs.mistral.ai/robots
- Verified
Every AI crawler in one table
MistralAI-Index is one of 29 crawlers and fetchers in the AI crawler directory, each checked against its operator's own documentation.