AI crawler directory
What is MistralAI-Training?
Last verified
Crawls web content to help build datasets for training Mistral's generative AI models. Mistral says it is not used for search indexing or to answer live questions in Vibe.
MistralAI-Training at a glance
- Operator
- Mistral
- Kind
- Crawler: fetches on its own schedule
- Used for
- Model training
- Feeds
- Mistral model training
- robots.txt token
MistralAI-Training- User agent string
Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; MistralAI-Training/1.0; +https://docs.mistral.ai/robots)
- Follows robots.txt
- Yes. Mistral: webmasters can disallow this user agent in robots.txt.
- Runs JavaScript
- Not documented by the operator
- Published IP ranges
- Not documented by the operator
- Official source
- Mistral crawlershttps://docs.mistral.ai/robots
- Verified
Every AI crawler in one table
MistralAI-Training is one of 29 crawlers and fetchers in the AI crawler directory, each checked against its operator's own documentation.