resulthack

All AI crawlers /

MistralAI-User

Mistral AI · User fetch · robots.txt: Yes

Visits a web page when a user asks Mistral's Vibe assistant a question, to help answer it and link the source.

Block MistralAI-User

User-agent: MistralAI-User
Disallow: /

Blocking MistralAI-User tells Mistral that Vibe should not fetch your pages when a user asks. Mistral says this agent does not crawl the web automatically and does not collect content for generative AI training.

Allow MistralAI-User

User-agent: MistralAI-User
Allow: /

An allow group only changes anything if a broader rule would block MistralAI-User. Under the robots.txt standard (RFC 9309, section 2.2.1) a crawler follows the group that names it and uses the User-agent: * group only when no group does — so this group lets it in even if your * group says Disallow: /. Token matching is case-insensitive.

Put these lines in /robots.txt at the root of each host (each subdomain has its own file). robots.txt is a request to well-behaved crawlers, not access control.

Facts

Operator
Mistral AI
Purpose
User-requested fetch
Obeys robots.txt
Yes. Mistral says MistralAI-User governs which sites these user-requested fetches can be made to.
In your server logs
The user-agent string contains "compatible; MistralAI-User/1.0;".
How to verify it
Match the IP against Mistral’s published MistralAI-User IP list.

Published list: mistral.ai/mistralai-user-ips.json — 4 IPv4 ranges when we fetched it, list dated 19 Feb 2025. Always match against the live list; operators update them. To count real and fake MistralAI-User requests in your own server log against this list, drop the log into the log reader.

What Mistral AI says

Quoted word for word from the operator's documentation.

“MistralAI-User is for user actions in Vibe. When users ask Vibe a question, it may visit a web page to help answer and include a link to the source in its response.”

“MistralAI-User governs which sites these user requests can be made to. It is not used for crawling the web in any automatic fashion, nor to crawl content for generative AI training.”

“Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; MistralAI-User/1.0;”

“All published IP addresses: MistralAI-User IP addresses”

Sources

Other crawlers from Mistral AI

Same purpose, other operators

← All 39 AI crawlers