crawlindex

Search the index. A domain that is not here can still be measured live on the check page.

Mistral . tier 2

MistralAI-User

Fetches a page live for a Le Chat user.

250 of the 3,618 sites we measured deny MistralAI-User access to their root, which is 6.9% of the index.

How to allow or block it

A group naming the token wins outright over the wildcard group. It does not inherit from it, so rules set under User-agent: * do not carry over.

# Allow MistralAI-User everywhere
User-agent: MistralAI-User
Disallow:

# Block MistralAI-User entirely
User-agent: MistralAI-User
Disallow: /

Sites blocking MistralAI-User

Most-visited first. Showing up to 100 of 250.

Domains that block MistralAI-User
RankDomainScoreAnswer-surface crawlersStack
3facebook.comScore 35 out of 100, grade F, partial assessment6 blockedunidentified
11instagram.comScore 14 out of 100, grade F, partial assessment11 blockedunidentified
12mail.ruScore 6 out of 100, grade F, partial assessment11 blockedunidentified
15twitter.comScore 14 out of 100, grade F, partial assessment11 blockedunidentified
17linkedin.comScore 17 out of 100, grade F, partial assessment9 blockedunidentified
25amazon.comScore 16 out of 100, grade F, partial assessment10 blockedAkamai
41netflix.comScore 59 out of 100, grade D, partial assessment3 blockedunidentified
49x.comScore 14 out of 100, grade F, partial assessment11 blockedunidentified
54tiktok.comScore 15 out of 100, grade F11 blockedunidentified
56pinterest.comScore 17 out of 100, grade F, partial assessment11 blockedunidentified
71myfritz.netScore 14 out of 100, grade F, partial assessment11 blockedunidentified
76chatgpt.comScore 14 out of 100, grade F, partial assessment11 blockedunidentified
87baidu.comScore 6 out of 100, grade F, partial assessment11 blockedunidentified
109reddit.comScore 6 out of 100, grade F, partial assessment11 blockedunidentified
122amazonvideo.comScore 37 out of 100, grade F5 blockedAmazon CloudFront
190flickr.comScore 42 out of 100, grade D, partial assessment6 blockedunidentified
204cnn.comScore 31 out of 100, grade F10 blockedFastly
249meraki.comScore 8 out of 100, grade F, partial assessment11 blockedunidentified
268imdb.comScore 9 out of 100, grade F, partial assessment11 blockedunidentified
287reuters.comScore 26 out of 100, grade F, partial assessment9 blockedunidentified
307weibo.comScore 18 out of 100, grade F, partial assessment11 blockedunidentified
335amazon.co.ukScore 16 out of 100, grade F, partial assessment10 blockedAmazon CloudFront
350trustpilot.comScore 59 out of 100, grade D, partial assessment3 blockedunidentified
353naver.comScore 6 out of 100, grade F, partial assessment11 blockedunidentified
380wsj.comScore 31 out of 100, grade F, partial assessment8 blockedunidentified
391amazon.deScore 16 out of 100, grade F, partial assessment10 blockedAmazon CloudFront
411nflxvideo.netScore 59 out of 100, grade D, partial assessment3 blockedunidentified
459gcdn.coScore 6 out of 100, grade F, partial assessment11 blockedunidentified
462edgecdn.ruScore 6 out of 100, grade F, partial assessment11 blockedunidentified
477sohu.comScore 8 out of 100, grade F, partial assessment11 blockedunidentified
483amazon.co.zaScore 16 out of 100, grade F, partial assessment10 blockedAkamai
488skybridge.clickScore 6 out of 100, grade F, partial assessment11 blockedunidentified
495amazon.co.jpScore 16 out of 100, grade F, partial assessment10 blockedAkamai
499quora.comScore 13 out of 100, grade F, partial assessment10 blockedunidentified
550netflix.netScore 59 out of 100, grade D, partial assessment3 blockedunidentified
554wired.comScore 51 out of 100, grade D8 blockedCloudflare
561uol.com.brScore 47 out of 100, grade D8 blockedAmazon CloudFront
586usatoday.comScore 24 out of 100, grade F11 blockedunidentified
600imgsmail.ruScore 6 out of 100, grade F, partial assessment11 blockedunidentified
617threads.comScore 14 out of 100, grade F, partial assessment11 blockedunidentified
621telegraph.co.ukScore 37 out of 100, grade F10 blockedAdobe Experience Manager . Fastly
626amazon.frScore 16 out of 100, grade F, partial assessment10 blockedAmazon CloudFront
637sharethrough.comScore 14 out of 100, grade F, partial assessment11 blockedunidentified
647amazon.caScore 22 out of 100, grade F10 blockedAmazon CloudFront
664yelp.comScore 6 out of 100, grade F, partial assessment11 blockedunidentified
668hstgr.netScore 6 out of 100, grade F, partial assessment11 blockedunidentified
672elpais.comScore 54 out of 100, grade D5 blockedunidentified
673primevideo.comScore 37 out of 100, grade F5 blockedAmazon CloudFront
687hihonorcloud.comScore 6 out of 100, grade F, partial assessment11 blockedunidentified
690amazon.inScore 16 out of 100, grade F, partial assessment10 blockedAmazon CloudFront
692dailymail.co.ukrefused GPTBotScore 26 out of 100, grade F11 blockedAkamai
698vkontakte.ruScore 6 out of 100, grade F, partial assessment11 blockedunidentified
707lemonde.frScore 49 out of 100, grade D5 blockedFastly
708dailymail.comrefused GPTBotScore 26 out of 100, grade F11 blockedAkamai
717fb.comScore 6 out of 100, grade F, partial assessment11 blockedunidentified
720amazon.esScore 16 out of 100, grade F, partial assessment10 blockedAmazon CloudFront
721pinimg.comScore 17 out of 100, grade F, partial assessment11 blockedunidentified
725amazon.itScore 16 out of 100, grade F, partial assessment10 blockedAmazon CloudFront
730quantserve.comScore 6 out of 100, grade F, partial assessment11 blockedunidentified
732cnet.comScore 44 out of 100, grade D10 blockedWordPress
741creativecdn.comScore 6 out of 100, grade F, partial assessment11 blockedunidentified
766bild.deScore 62 out of 100, grade C3 blockedunidentified
802welt.deScore 50 out of 100, grade D3 blockedVarnish
809disneyplus.comScore 77 out of 100, grade B, partial assessment1 blockedunidentified
811people.comScore 37 out of 100, grade F, partial assessment8 blockedCloudflare
817adform.netScore 6 out of 100, grade F, partial assessment11 blockedunidentified
837lefigaro.frScore 55 out of 100, grade D7 blockedunidentified
843daum.netScore 6 out of 100, grade F, partial assessment11 blockedunidentified
849amazon.com.auScore 15 out of 100, grade F10 blockedAmazon CloudFront
853theverge.comScore 44 out of 100, grade D9 blockedWordPress . Fastly
862amazon.com.brScore 16 out of 100, grade F, partial assessment10 blockedAkamai
890nbcnews.comScore 30 out of 100, grade F11 blockedNext.js . Akamai
942spiegel.deScore 40 out of 100, grade D8 blockedGoogle Cloud / GFE
963stbid.ruScore 6 out of 100, grade F, partial assessment11 blockedunidentified
965blackhub.teamScore 6 out of 100, grade F, partial assessment11 blockedunidentified
969mailchi.mpScore 6 out of 100, grade F, partial assessment11 blockedunidentified
982investopedia.comScore 37 out of 100, grade F, partial assessment8 blockedCloudflare
987btloader.comScore 6 out of 100, grade F, partial assessment11 blockedunidentified
1035theatlantic.comScore 50 out of 100, grade D8 blockedNext.js . Cloudflare
1040amazon.com.mxrefused GPTBotScore 15 out of 100, grade F10 blockedAmazon CloudFront
1071rocketmoney.devScore 6 out of 100, grade F, partial assessment11 blockedunidentified
1078as.comScore 51 out of 100, grade D5 blockedunidentified
1083bfmtv.comScore 35 out of 100, grade F11 blockedAmazon CloudFront
1113theconversation.comScore 26 out of 100, grade F11 blockedNext.js . Fastly
1118xiaohongshu.comScore 14 out of 100, grade F, partial assessment11 blockedunidentified
1138netcraze.ioScore 6 out of 100, grade F, partial assessment11 blockedunidentified
1191nu.nlrefused GPTBotScore 38 out of 100, grade F, partial assessment8 blockedAkamai
1193ad.nlrefused GPTBotScore 38 out of 100, grade F, partial assessment8 blockedAkamai
1196fmkorea.comScore 34 out of 100, grade F, partial assessment6 blockedunidentified
1228namu.wikiScore 6 out of 100, grade F, partial assessment11 blockedunidentified
1236namecheaphosting.comScore 6 out of 100, grade F, partial assessment11 blockedunidentified
1237kakao.comScore 6 out of 100, grade F, partial assessment11 blockedunidentified
1247amap.comScore 54 out of 100, grade D, partial assessment5 blockedunidentified
1254furaffinity.netrefused GPTBotScore 6 out of 100, grade F, partial assessment11 blockedCloudflare
1257hln.berefused GPTBotScore 38 out of 100, grade F, partial assessment8 blockedAkamai
1287themoviedb.orgScore 24 out of 100, grade F11 blockedAmazon CloudFront
1305actu.frScore 42 out of 100, grade D8 blockedCloudflare
1410iltalehti.fiScore 26 out of 100, grade F11 blockedAmazon CloudFront
1481eenadu.netScore 42 out of 100, grade D11 blockedAmazon CloudFront
1515exhentai.orgScore 6 out of 100, grade F, partial assessment11 blockedunidentified

Using these figures

Free to reuse in research, journalism or a product under CC BY 4.0, with credit to Fidget Labs BV. Quote the measurement date so the claim stays checkable as the index moves.

CrawlIndex by Fidget Labs BV. "Sites blocking MistralAI-User." https://crawlindex.org (measured 2026-09-22). Licensed CC BY 4.0.