OpenAI . tier 1
ChatGPT-User
Fetches a page live when a ChatGPT user asks about it.
303 of the 3,618 sites we measured deny ChatGPT-User access to their root, which is 8.4% of the index.
How to allow or block it
A group naming the token wins outright over the wildcard group. It does not inherit from it, so rules set under User-agent: * do not carry over.
# Allow ChatGPT-User everywhere
User-agent: ChatGPT-User
Disallow:
# Block ChatGPT-User entirely
User-agent: ChatGPT-User
Disallow: /Sites blocking ChatGPT-User
Most-visited first. Showing up to 100 of 303.
| Rank | Domain | Score | Answer-surface crawlers | Stack |
|---|---|---|---|---|
| 3 | facebook.com | Score 35 out of 100, grade F, partial assessment | 6 blocked | unidentified |
| 11 | instagram.com | Score 14 out of 100, grade F, partial assessment | 11 blocked | unidentified |
| 12 | mail.ru | Score 6 out of 100, grade F, partial assessment | 11 blocked | unidentified |
| 15 | twitter.com | Score 14 out of 100, grade F, partial assessment | 11 blocked | unidentified |
| 17 | linkedin.com | Score 17 out of 100, grade F, partial assessment | 9 blocked | unidentified |
| 25 | amazon.com | Score 16 out of 100, grade F, partial assessment | 10 blocked | Akamai |
| 49 | x.com | Score 14 out of 100, grade F, partial assessment | 11 blocked | unidentified |
| 54 | tiktok.com | Score 15 out of 100, grade F | 11 blocked | unidentified |
| 56 | pinterest.com | Score 17 out of 100, grade F, partial assessment | 11 blocked | unidentified |
| 59 | yahoo.comrefused GPTBot | Score 47 out of 100, grade D | 5 blocked | Next.js |
| 71 | myfritz.net | Score 14 out of 100, grade F, partial assessment | 11 blocked | unidentified |
| 76 | chatgpt.com | Score 14 out of 100, grade F, partial assessment | 11 blocked | unidentified |
| 87 | baidu.com | Score 6 out of 100, grade F, partial assessment | 11 blocked | unidentified |
| 109 | reddit.com | Score 6 out of 100, grade F, partial assessment | 11 blocked | unidentified |
| 122 | amazonvideo.com | Score 37 out of 100, grade F | 5 blocked | Amazon CloudFront |
| 159 | nytimes.comrefused GPTBot | Score 21 out of 100, grade F, partial assessment | 11 blocked | Fastly |
| 189 | soundcloud.com | Score 42 out of 100, grade D, partial assessment | 8 blocked | Amazon CloudFront |
| 204 | cnn.com | Score 31 out of 100, grade F | 10 blocked | Fastly |
| 218 | bbc.com | Score 34 out of 100, grade F | 9 blocked | Next.js . Fastly |
| 236 | bbc.co.uk | Score 37 out of 100, grade F | 9 blocked | Fastly |
| 249 | meraki.com | Score 8 out of 100, grade F, partial assessment | 11 blocked | unidentified |
| 268 | imdb.com | Score 9 out of 100, grade F, partial assessment | 11 blocked | unidentified |
| 304 | nature.com | Score 45 out of 100, grade D, partial assessment | 7 blocked | Fastly |
| 307 | weibo.com | Score 18 out of 100, grade F, partial assessment | 11 blocked | unidentified |
| 335 | amazon.co.uk | Score 16 out of 100, grade F, partial assessment | 10 blocked | Amazon CloudFront |
| 353 | naver.com | Score 6 out of 100, grade F, partial assessment | 11 blocked | unidentified |
| 379 | bloomberg.comrefused GPTBot | Score 27 out of 100, grade F, partial assessment | 10 blocked | Fastly |
| 391 | amazon.de | Score 16 out of 100, grade F, partial assessment | 10 blocked | Amazon CloudFront |
| 402 | espn.com | Score 72 out of 100, grade C, partial assessment | 3 blocked | Amazon CloudFront |
| 436 | claude.airefused GPTBot | Score 48 out of 100, grade D | 4 blocked | Cloudflare |
| 459 | gcdn.co | Score 6 out of 100, grade F, partial assessment | 11 blocked | unidentified |
| 462 | edgecdn.ru | Score 6 out of 100, grade F, partial assessment | 11 blocked | unidentified |
| 467 | aol.com | Score 44 out of 100, grade D | 5 blocked | Next.js . Amazon CloudFront |
| 477 | sohu.com | Score 8 out of 100, grade F, partial assessment | 11 blocked | unidentified |
| 483 | amazon.co.za | Score 16 out of 100, grade F, partial assessment | 10 blocked | Akamai |
| 485 | cnbc.comrefused GPTBot | Score 30 out of 100, grade F | 9 blocked | Akamai |
| 488 | skybridge.click | Score 6 out of 100, grade F, partial assessment | 11 blocked | unidentified |
| 495 | amazon.co.jp | Score 16 out of 100, grade F, partial assessment | 10 blocked | Akamai |
| 499 | quora.com | Score 13 out of 100, grade F, partial assessment | 10 blocked | unidentified |
| 586 | usatoday.com | Score 24 out of 100, grade F | 11 blocked | unidentified |
| 600 | imgsmail.ru | Score 6 out of 100, grade F, partial assessment | 11 blocked | unidentified |
| 617 | threads.com | Score 14 out of 100, grade F, partial assessment | 11 blocked | unidentified |
| 621 | telegraph.co.uk | Score 37 out of 100, grade F | 10 blocked | Adobe Experience Manager . Fastly |
| 626 | amazon.fr | Score 16 out of 100, grade F, partial assessment | 10 blocked | Amazon CloudFront |
| 637 | sharethrough.com | Score 14 out of 100, grade F, partial assessment | 11 blocked | unidentified |
| 647 | amazon.ca | Score 22 out of 100, grade F | 10 blocked | Amazon CloudFront |
| 656 | techcrunch.com | Score 61 out of 100, grade C | 5 blocked | WordPress |
| 664 | yelp.com | Score 6 out of 100, grade F, partial assessment | 11 blocked | unidentified |
| 668 | hstgr.net | Score 6 out of 100, grade F, partial assessment | 11 blocked | unidentified |
| 673 | primevideo.com | Score 37 out of 100, grade F | 5 blocked | Amazon CloudFront |
| 683 | cambridge.orgrefused GPTBot | Score 86 out of 100, grade B, partial assessment | 1 blocked | Cloudflare |
| 687 | hihonorcloud.com | Score 6 out of 100, grade F, partial assessment | 11 blocked | unidentified |
| 690 | amazon.in | Score 16 out of 100, grade F, partial assessment | 10 blocked | Amazon CloudFront |
| 692 | dailymail.co.ukrefused GPTBot | Score 26 out of 100, grade F | 11 blocked | Akamai |
| 698 | vkontakte.ru | Score 6 out of 100, grade F, partial assessment | 11 blocked | unidentified |
| 708 | dailymail.comrefused GPTBot | Score 26 out of 100, grade F | 11 blocked | Akamai |
| 717 | fb.com | Score 6 out of 100, grade F, partial assessment | 11 blocked | unidentified |
| 720 | amazon.es | Score 16 out of 100, grade F, partial assessment | 10 blocked | Amazon CloudFront |
| 721 | pinimg.com | Score 17 out of 100, grade F, partial assessment | 11 blocked | unidentified |
| 725 | amazon.it | Score 16 out of 100, grade F, partial assessment | 10 blocked | Amazon CloudFront |
| 730 | quantserve.com | Score 6 out of 100, grade F, partial assessment | 11 blocked | unidentified |
| 732 | cnet.com | Score 44 out of 100, grade D | 10 blocked | WordPress |
| 741 | creativecdn.com | Score 6 out of 100, grade F, partial assessment | 11 blocked | unidentified |
| 817 | adform.net | Score 6 out of 100, grade F, partial assessment | 11 blocked | unidentified |
| 837 | lefigaro.fr | Score 55 out of 100, grade D | 7 blocked | unidentified |
| 843 | daum.net | Score 6 out of 100, grade F, partial assessment | 11 blocked | unidentified |
| 849 | amazon.com.au | Score 15 out of 100, grade F | 10 blocked | Amazon CloudFront |
| 853 | theverge.com | Score 44 out of 100, grade D | 9 blocked | WordPress . Fastly |
| 862 | amazon.com.br | Score 16 out of 100, grade F, partial assessment | 10 blocked | Akamai |
| 868 | figma.com | Score 48 out of 100, grade D | 8 blocked | Sanity . Amazon CloudFront |
| 890 | nbcnews.com | Score 30 out of 100, grade F | 11 blocked | Next.js . Akamai |
| 892 | mercadolivre.com.brrefused GPTBot | Score 42 out of 100, grade D | 6 blocked | Amazon CloudFront |
| 942 | spiegel.de | Score 40 out of 100, grade D | 8 blocked | Google Cloud / GFE |
| 955 | mercadolibre.com.arrefused GPTBot | Score 42 out of 100, grade D | 6 blocked | Amazon CloudFront |
| 963 | stbid.ru | Score 6 out of 100, grade F, partial assessment | 11 blocked | unidentified |
| 965 | blackhub.team | Score 6 out of 100, grade F, partial assessment | 11 blocked | unidentified |
| 969 | mailchi.mp | Score 6 out of 100, grade F, partial assessment | 11 blocked | unidentified |
| 978 | corriere.itrefused GPTBot | Score 50 out of 100, grade D | 6 blocked | Fastly |
| 987 | btloader.com | Score 6 out of 100, grade F, partial assessment | 11 blocked | unidentified |
| 1005 | elmundo.es | Score 56 out of 100, grade D | 5 blocked | Fastly |
| 1040 | amazon.com.mxrefused GPTBot | Score 15 out of 100, grade F | 10 blocked | Amazon CloudFront |
| 1046 | archiveofourown.orgrefused GPTBot | Score 47 out of 100, grade D | 2 blocked | Cloudflare |
| 1071 | rocketmoney.dev | Score 6 out of 100, grade F, partial assessment | 11 blocked | unidentified |
| 1083 | bfmtv.com | Score 35 out of 100, grade F | 11 blocked | Amazon CloudFront |
| 1084 | marca.com | Score 63 out of 100, grade C | 5 blocked | Fastly |
| 1093 | huffpost.com | Score 46 out of 100, grade D | 11 blocked | Fastly |
| 1113 | theconversation.com | Score 26 out of 100, grade F | 11 blocked | Next.js . Fastly |
| 1118 | xiaohongshu.com | Score 14 out of 100, grade F, partial assessment | 11 blocked | unidentified |
| 1124 | gsmarena.com | Score 42 out of 100, grade D | 6 blocked | unidentified |
| 1135 | cookpad.com | Score 41 out of 100, grade D | 7 blocked | Fastly |
| 1136 | mercadolibre.com.mxrefused GPTBot | Score 42 out of 100, grade D | 6 blocked | Amazon CloudFront |
| 1138 | netcraze.io | Score 6 out of 100, grade F, partial assessment | 11 blocked | unidentified |
| 1171 | pimpbunny.comrefused GPTBot | Score 32 out of 100, grade F | 8 blocked | Cloudflare |
| 1191 | nu.nlrefused GPTBot | Score 38 out of 100, grade F, partial assessment | 8 blocked | Akamai |
| 1193 | ad.nlrefused GPTBot | Score 38 out of 100, grade F, partial assessment | 8 blocked | Akamai |
| 1205 | economist.comrefused GPTBot | Score 33 out of 100, grade F, partial assessment | 10 blocked | Cloudflare |
| 1228 | namu.wiki | Score 6 out of 100, grade F, partial assessment | 11 blocked | unidentified |
| 1236 | namecheaphosting.com | Score 6 out of 100, grade F, partial assessment | 11 blocked | unidentified |
| 1237 | kakao.com | Score 6 out of 100, grade F, partial assessment | 11 blocked | unidentified |
| 1254 | furaffinity.netrefused GPTBot | Score 6 out of 100, grade F, partial assessment | 11 blocked | Cloudflare |
Using these figures
Free to reuse in research, journalism or a product under CC BY 4.0, with credit to Fidget Labs BV. Quote the measurement date so the claim stays checkable as the index moves.
CrawlIndex by Fidget Labs BV. "Sites blocking ChatGPT-User." https://crawlindex.org (measured 2026-09-22). Licensed CC BY 4.0.