crawlindex

Search the index. A domain that is not here can still be measured live on the check page.

OpenAI . tier 1

ChatGPT-User

Fetches a page live when a ChatGPT user asks about it.

306 of the 3,656 sites we measured deny ChatGPT-User access to their root, which is 8.4% of the index.

How to allow or block it

A group naming the token wins outright over the wildcard group. It does not inherit from it, so rules set under User-agent: * do not carry over.

# Allow ChatGPT-User everywhere
User-agent: ChatGPT-User
Disallow:

# Block ChatGPT-User entirely
User-agent: ChatGPT-User
Disallow: /

Sites blocking ChatGPT-User

Most-visited first. Showing up to 100 of 306.

Domains that block ChatGPT-User
RankDomainScoreAnswer-surface crawlersStack
5facebook.comScore 6 out of 100, grade F, partial assessment11 blockedunidentified
14instagram.comScore 14 out of 100, grade F, partial assessment11 blockedunidentified
16twitter.comScore 14 out of 100, grade F, partial assessment11 blockedunidentified
17linkedin.comScore 17 out of 100, grade F, partial assessment9 blockedunidentified
27mail.ruScore 6 out of 100, grade F, partial assessment11 blockedunidentified
29amazon.comrefused GPTBotScore 16 out of 100, grade F, partial assessment10 blockedAmazon CloudFront
48x.comScore 14 out of 100, grade F, partial assessment11 blockedunidentified
55pinterest.comScore 17 out of 100, grade F, partial assessment11 blockedunidentified
62myfritz.netScore 14 out of 100, grade F, partial assessment11 blockedunidentified
63tiktok.comScore 15 out of 100, grade F11 blockedunidentified
72yahoo.comrefused GPTBotScore 43 out of 100, grade D5 blockedNext.js
81amazonvideo.comScore 40 out of 100, grade D5 blockedAmazon CloudFront
90baidu.comScore 6 out of 100, grade F, partial assessment11 blockedunidentified
111reddit.comScore 6 out of 100, grade F, partial assessment11 blockedunidentified
114chatgpt.comScore 14 out of 100, grade F, partial assessment11 blockedunidentified
155nytimes.comrefused GPTBotScore 21 out of 100, grade F, partial assessment11 blockedFastly
170skybridge.clickScore 6 out of 100, grade F, partial assessment11 blockedunidentified
192cnn.comScore 31 out of 100, grade F9 blockedFastly
202soundcloud.comScore 31 out of 100, grade F, partial assessment10 blockedAmazon CloudFront
219bbc.comScore 31 out of 100, grade F10 blockedNext.js . Fastly
242bbc.co.ukScore 34 out of 100, grade F10 blockedFastly
265imdb.comScore 9 out of 100, grade F, partial assessment11 blockedunidentified
294nature.comScore 45 out of 100, grade D, partial assessment7 blockedFastly
331weibo.comScore 18 out of 100, grade F, partial assessment11 blockedunidentified
333amazon.co.ukrefused GPTBotScore 16 out of 100, grade F, partial assessment10 blockedAmazon CloudFront
340espn.comScore 72 out of 100, grade C, partial assessment3 blockedAmazon CloudFront
351naver.comScore 6 out of 100, grade F, partial assessment11 blockedunidentified
386amazon.derefused GPTBotScore 16 out of 100, grade F, partial assessment10 blockedAmazon CloudFront
404bloomberg.comrefused GPTBotScore 27 out of 100, grade F, partial assessment10 blockedFastly
413claude.airefused GPTBotScore 51 out of 100, grade D4 blockedCloudflare
425gcdn.coScore 6 out of 100, grade F, partial assessment11 blockedunidentified
458netcraze.ioScore 6 out of 100, grade F, partial assessment11 blockedunidentified
486cnbc.comrefused GPTBotScore 24 out of 100, grade F11 blockedAkamai
495amazon.co.jprefused GPTBotScore 16 out of 100, grade F, partial assessment10 blockedAmazon CloudFront
504quora.comScore 13 out of 100, grade F, partial assessment10 blockedunidentified
565threads.comScore 14 out of 100, grade F, partial assessment11 blockedunidentified
569sohu.comScore 8 out of 100, grade F, partial assessment11 blockedunidentified
582dailymail.comrefused GPTBotScore 35 out of 100, grade F11 blockedAkamai
629usatoday.comScore 16 out of 100, grade F, partial assessment11 blockedunidentified
630telegraph.co.ukScore 37 out of 100, grade F10 blockedAdobe Experience Manager . Fastly
632amazon.frrefused GPTBotScore 15 out of 100, grade F10 blockedAmazon CloudFront
636edgecdn.ruScore 6 out of 100, grade F, partial assessment11 blockedunidentified
644amazon.carefused GPTBotScore 16 out of 100, grade F, partial assessment10 blockedAmazon CloudFront
667hstgr.netScore 6 out of 100, grade F, partial assessment11 blockedunidentified
675amazon.inrefused GPTBotScore 16 out of 100, grade F, partial assessment10 blockedAmazon CloudFront
682cambridge.orgrefused GPTBotScore 86 out of 100, grade B, partial assessment1 blockedCloudflare
690spiegel.deScore 40 out of 100, grade D8 blockedGoogle Cloud / GFE
702fb.comScore 6 out of 100, grade F, partial assessment11 blockedunidentified
706yelp.comScore 6 out of 100, grade F, partial assessment11 blockedunidentified
720amazon.esrefused GPTBotScore 16 out of 100, grade F, partial assessment10 blockedAmazon CloudFront
724quantserve.comScore 6 out of 100, grade F, partial assessment11 blockedunidentified
729pinimg.comScore 17 out of 100, grade F, partial assessment11 blockedunidentified
734dailymail.co.ukrefused GPTBotScore 35 out of 100, grade F11 blockedAkamai
736amazon.itrefused GPTBotScore 16 out of 100, grade F, partial assessment10 blockedAmazon CloudFront
741creativecdn.comScore 6 out of 100, grade F, partial assessment11 blockedunidentified
756cnet.comScore 44 out of 100, grade D10 blockedWordPress
762hihonorcloud.comScore 6 out of 100, grade F, partial assessment11 blockedunidentified
800sharethrough.comScore 14 out of 100, grade F, partial assessment11 blockedunidentified
811attn.tvScore 6 out of 100, grade F, partial assessment11 blockedunidentified
845salesforceliveagent.comScore 6 out of 100, grade F, partial assessment11 blockedunidentified
849adform.netScore 6 out of 100, grade F, partial assessment11 blockedunidentified
853theverge.comScore 44 out of 100, grade D9 blockedWordPress . Fastly
868imgsmail.ruScore 6 out of 100, grade F, partial assessment11 blockedunidentified
882nbcnews.comScore 30 out of 100, grade F11 blockedNext.js . Akamai
887amazon.com.brrefused GPTBotScore 16 out of 100, grade F, partial assessment10 blockedAmazon CloudFront
905mercadolivre.com.brrefused GPTBotScore 42 out of 100, grade D6 blockedunidentified
907figma.comScore 47 out of 100, grade D8 blockedSanity . Amazon CloudFront
935daum.netScore 6 out of 100, grade F, partial assessment11 blockedunidentified
954huffpost.comScore 46 out of 100, grade D11 blockedFastly
955corriere.itrefused GPTBotScore 34 out of 100, grade F11 blockedFastly
964amazon.com.aurefused GPTBotScore 16 out of 100, grade F, partial assessment10 blockedAmazon CloudFront
969mercadolibre.com.arrefused GPTBotScore 42 out of 100, grade D6 blockedunidentified
983mailchi.mpScore 6 out of 100, grade F, partial assessment11 blockedunidentified
987btloader.comScore 6 out of 100, grade F, partial assessment11 blockedunidentified
1010themoviedb.orgrefused GPTBotScore 18 out of 100, grade F, partial assessment11 blockedAmazon CloudFront
1027xiaohongshu.comScore 14 out of 100, grade F, partial assessment11 blockedunidentified
1030amazon.com.mxrefused GPTBotScore 16 out of 100, grade F, partial assessment10 blockedAkamai
1038ouest-france.frScore 14 out of 100, grade F, partial assessment11 blockedunidentified
1040amazon.co.zarefused GPTBotScore 15 out of 100, grade F10 blockedAmazon CloudFront
1050pimpbunny.comrefused GPTBotScore 29 out of 100, grade F8 blockedunidentified
1063bfmtv.comScore 35 out of 100, grade F11 blockedAmazon CloudFront
1074archiveofourown.orgrefused GPTBotScore 47 out of 100, grade D2 blockedCloudflare
1093marca.comScore 42 out of 100, grade D11 blockedFastly
1109cookpad.comScore 41 out of 100, grade D7 blockedFastly
1149mercadolibre.com.mxrefused GPTBotScore 42 out of 100, grade D6 blockedunidentified
1159namecheaphosting.comScore 6 out of 100, grade F, partial assessment11 blockedunidentified
1184nu.nlrefused GPTBotScore 18 out of 100, grade F, partial assessment11 blockedAkamai
1190ad.nlrefused GPTBotScore 27 out of 100, grade F, partial assessment10 blockedAkamai
1195theconversation.comScore 26 out of 100, grade F11 blockedNext.js . Fastly
1196namu.wikiScore 6 out of 100, grade F, partial assessment11 blockedunidentified
1219furaffinity.netrefused GPTBotScore 6 out of 100, grade F, partial assessment11 blockedCloudflare
1225gazzetta.itrefused GPTBotScore 32 out of 100, grade F11 blockedunidentified
1262abc.net.auScore 60 out of 100, grade C6 blockedNext.js
1265hln.berefused GPTBotScore 27 out of 100, grade F, partial assessment10 blockedAkamai
1292actu.frScore 36 out of 100, grade F10 blockedCloudflare
1296kakao.comScore 6 out of 100, grade F, partial assessment11 blockedunidentified
1305economist.comrefused GPTBotScore 33 out of 100, grade F, partial assessment10 blockedCloudflare
1307vkontakte.ruScore 6 out of 100, grade F, partial assessment11 blockedunidentified
1330aljazeera.comScore 65 out of 100, grade C4 blockedWordPress
1351ovh.comScore 61 out of 100, grade C2 blockedDrupal

Using these figures

Free to reuse in research, journalism or a product under CC BY 4.0, with credit to Fidget Labs BV. Quote the measurement date so the claim stays checkable as the index moves.

CrawlIndex by Fidget Labs BV. "Sites blocking ChatGPT-User." https://crawlindex.org (measured 2026-11-22). Licensed CC BY 4.0.