Perplexity . tier 1

Perplexity-User

Fetches a page live for a Perplexity user query.

274 of the 3,642 sites we measured deny Perplexity-User access to their root, which is 7.5% of the index.

How to allow or block it

A group naming the token wins outright over the wildcard group. It does not inherit from it, so rules set under User-agent: * do not carry over.

# Allow Perplexity-User everywhere
User-agent: Perplexity-User
Disallow:

# Block Perplexity-User entirely
User-agent: Perplexity-User
Disallow: /

Sites blocking Perplexity-User

Most-visited first. Showing up to 100 of 274.

Domains that block Perplexity-User
Rank	Domain	Score	Answer-surface crawlers	Stack
5	facebook.com	Score 6 out of 100, grade F, partial assessment	11 blocked	unidentified
14	instagram.com	Score 14 out of 100, grade F, partial assessment	11 blocked	unidentified
16	twitter.com	Score 14 out of 100, grade F, partial assessment	11 blocked	unidentified
17	linkedin.com	Score 17 out of 100, grade F, partial assessment	9 blocked	unidentified
18	mail.ru	Score 6 out of 100, grade F, partial assessment	11 blocked	unidentified
31	amazon.comrefused GPTBot	Score 15 out of 100, grade F	10 blocked	Amazon CloudFront
43	netflix.com	Score 59 out of 100, grade D, partial assessment	3 blocked	unidentified
47	x.com	Score 14 out of 100, grade F, partial assessment	11 blocked	unidentified
52	pinterest.com	Score 17 out of 100, grade F, partial assessment	11 blocked	unidentified
61	myfritz.net	Score 14 out of 100, grade F, partial assessment	11 blocked	unidentified
63	tiktok.com	Score 15 out of 100, grade F	11 blocked	unidentified
83	amazonvideo.com	Score 40 out of 100, grade D	5 blocked	Amazon CloudFront
85	baidu.com	Score 6 out of 100, grade F, partial assessment	11 blocked	unidentified
103	reddit.com	Score 6 out of 100, grade F, partial assessment	11 blocked	unidentified
112	chatgpt.com	Score 14 out of 100, grade F, partial assessment	11 blocked	unidentified
126	skybridge.click	Score 6 out of 100, grade F, partial assessment	11 blocked	unidentified
163	nytimes.comrefused GPTBot	Score 21 out of 100, grade F, partial assessment	11 blocked	Fastly
180	flickr.com	Score 42 out of 100, grade D, partial assessment	6 blocked	unidentified
193	cnn.com	Score 31 out of 100, grade F	9 blocked	Fastly
218	bbc.com	Score 31 out of 100, grade F	10 blocked	Next.js . Fastly
240	bbc.co.uk	Score 34 out of 100, grade F	10 blocked	Fastly
263	imdb.com	Score 9 out of 100, grade F, partial assessment	11 blocked	unidentified
283	reuters.com	Score 26 out of 100, grade F, partial assessment	9 blocked	unidentified
325	weibo.com	Score 18 out of 100, grade F, partial assessment	11 blocked	unidentified
330	amazon.co.ukrefused GPTBot	Score 16 out of 100, grade F, partial assessment	10 blocked	Amazon CloudFront
344	naver.com	Score 6 out of 100, grade F, partial assessment	11 blocked	unidentified
353	trustpilot.com	Score 66 out of 100, grade C, partial assessment	2 blocked	unidentified
359	nflxvideo.net	Score 59 out of 100, grade D, partial assessment	3 blocked	unidentified
372	wsj.com	Score 31 out of 100, grade F, partial assessment	8 blocked	unidentified
385	amazon.derefused GPTBot	Score 16 out of 100, grade F, partial assessment	10 blocked	Amazon CloudFront
421	netflix.net	Score 59 out of 100, grade D, partial assessment	3 blocked	unidentified
439	gcdn.co	Score 6 out of 100, grade F, partial assessment	11 blocked	unidentified
476	netcraze.io	Score 6 out of 100, grade F, partial assessment	11 blocked	unidentified
481	cnbc.comrefused GPTBot	Score 24 out of 100, grade F	11 blocked	Akamai
494	amazon.co.jprefused GPTBot	Score 16 out of 100, grade F, partial assessment	10 blocked	Amazon CloudFront
497	quora.com	Score 13 out of 100, grade F, partial assessment	10 blocked	unidentified
498	statista.comrefused GPTBot	Score 43 out of 100, grade D	7 blocked	Amazon CloudFront
549	ft.comrefused GPTBot	Score 53 out of 100, grade D, partial assessment	6 blocked	Cloudflare
552	uol.com.br	Score 47 out of 100, grade D	8 blocked	Amazon CloudFront
566	sohu.com	Score 8 out of 100, grade F, partial assessment	11 blocked	unidentified
574	wired.com	Score 51 out of 100, grade D	8 blocked	Cloudflare
580	edgecdn.ru	Score 6 out of 100, grade F, partial assessment	11 blocked	unidentified
589	threads.com	Score 14 out of 100, grade F, partial assessment	11 blocked	unidentified
609	dailymail.comrefused GPTBot	Score 35 out of 100, grade F	11 blocked	Akamai
622	usatoday.com	Score 24 out of 100, grade F	11 blocked	Sitecore
630	telegraph.co.uk	Score 37 out of 100, grade F	10 blocked	Adobe Experience Manager . Fastly
642	amazon.frrefused GPTBot	Score 16 out of 100, grade F, partial assessment	10 blocked	Akamai
645	amazon.carefused GPTBot	Score 15 out of 100, grade F	10 blocked	Amazon CloudFront
655	hstgr.net	Score 6 out of 100, grade F, partial assessment	11 blocked	unidentified
676	amazon.inrefused GPTBot	Score 16 out of 100, grade F, partial assessment	10 blocked	Amazon CloudFront
677	elpais.com	Score 51 out of 100, grade D, partial assessment	5 blocked	unidentified
681	primevideo.com	Score 40 out of 100, grade D	5 blocked	Amazon CloudFront
692	sharethrough.com	Score 14 out of 100, grade F, partial assessment	11 blocked	unidentified
703	yelp.com	Score 6 out of 100, grade F, partial assessment	11 blocked	unidentified
708	fb.com	Score 6 out of 100, grade F, partial assessment	11 blocked	unidentified
713	amazon.esrefused GPTBot	Score 16 out of 100, grade F, partial assessment	10 blocked	Amazon CloudFront
723	dailymail.co.ukrefused GPTBot	Score 35 out of 100, grade F	11 blocked	Akamai
730	pinimg.com	Score 17 out of 100, grade F, partial assessment	11 blocked	unidentified
733	hihonorcloud.com	Score 6 out of 100, grade F, partial assessment	11 blocked	unidentified
736	amazon.itrefused GPTBot	Score 16 out of 100, grade F, partial assessment	10 blocked	Amazon CloudFront
737	quantserve.com	Score 6 out of 100, grade F, partial assessment	11 blocked	unidentified
749	cnet.com	Score 44 out of 100, grade D	10 blocked	WordPress
757	creativecdn.com	Score 6 out of 100, grade F, partial assessment	11 blocked	unidentified
762	bild.de	Score 59 out of 100, grade D	3 blocked	unidentified
765	imgsmail.ru	Score 6 out of 100, grade F, partial assessment	11 blocked	unidentified
787	welt.de	Score 50 out of 100, grade D	3 blocked	unidentified
799	apnews.comrefused GPTBot	Score 49 out of 100, grade D, partial assessment	7 blocked	Cloudflare
820	disneyplus.com	Score 77 out of 100, grade B, partial assessment	1 blocked	unidentified
825	people.com	Score 35 out of 100, grade F, partial assessment	8 blocked	Cloudflare
850	adform.net	Score 6 out of 100, grade F, partial assessment	11 blocked	unidentified
852	academia.edu	Score 48 out of 100, grade D, partial assessment	6 blocked	unidentified
866	theverge.com	Score 44 out of 100, grade D	9 blocked	WordPress . Fastly
871	amazon.com.brrefused GPTBot	Score 15 out of 100, grade F	10 blocked	Amazon CloudFront
875	amazon.co.zarefused GPTBot	Score 16 out of 100, grade F, partial assessment	10 blocked	Akamai
885	daum.net	Score 6 out of 100, grade F, partial assessment	11 blocked	unidentified
899	mercadolivre.com.brrefused GPTBot	Score 42 out of 100, grade D	6 blocked	unidentified
900	nbcnews.com	Score 30 out of 100, grade F	11 blocked	Next.js . Akamai
934	xiaohongshu.com	Score 14 out of 100, grade F, partial assessment	11 blocked	unidentified
958	amazon.com.aurefused GPTBot	Score 16 out of 100, grade F, partial assessment	10 blocked	Amazon CloudFront
959	mercadolibre.com.arrefused GPTBot	Score 42 out of 100, grade D	6 blocked	unidentified
964	corriere.itrefused GPTBot	Score 34 out of 100, grade F	11 blocked	Fastly
978	huffpost.com	Score 46 out of 100, grade D	11 blocked	Fastly
980	vkontakte.ru	Score 6 out of 100, grade F, partial assessment	11 blocked	unidentified
986	mailchi.mp	Score 6 out of 100, grade F, partial assessment	11 blocked	unidentified
997	btloader.com	Score 6 out of 100, grade F, partial assessment	11 blocked	unidentified
1016	namecheaphosting.com	Score 6 out of 100, grade F, partial assessment	11 blocked	unidentified
1033	amazon.com.mxrefused GPTBot	Score 15 out of 100, grade F	10 blocked	Amazon CloudFront
1037	attn.tv	Score 6 out of 100, grade F, partial assessment	11 blocked	unidentified
1048	theatlantic.comrefused GPTBot	Score 43 out of 100, grade D, partial assessment	8 blocked	Cloudflare
1055	ouest-france.fr	Score 14 out of 100, grade F, partial assessment	11 blocked	unidentified
1059	investopedia.com	Score 35 out of 100, grade F, partial assessment	8 blocked	Cloudflare
1068	themoviedb.orgrefused GPTBot	Score 18 out of 100, grade F, partial assessment	11 blocked	Amazon CloudFront
1070	bfmtv.com	Score 35 out of 100, grade F	11 blocked	Amazon CloudFront
1093	as.comrefused GPTBot	Score 49 out of 100, grade D, partial assessment	5 blocked	unidentified
1098	marca.com	Score 42 out of 100, grade D	11 blocked	Fastly
1120	rocketmoney.dev	Score 6 out of 100, grade F, partial assessment	11 blocked	unidentified
1147	mercadolibre.com.mxrefused GPTBot	Score 42 out of 100, grade D	6 blocked	unidentified
1186	theconversation.com	Score 26 out of 100, grade F	11 blocked	Next.js . Fastly
1190	namu.wiki	Score 6 out of 100, grade F, partial assessment	11 blocked	unidentified
1191	nu.nlrefused GPTBot	Score 18 out of 100, grade F, partial assessment	11 blocked	Akamai

Using these figures

Free to reuse in research, journalism or a product under CC BY 4.0, with credit to Fidget Labs BV. Quote the measurement date so the claim stays checkable as the index moves.

CrawlIndex by Fidget Labs BV. "Sites blocking Perplexity-User." https://crawlindex.org (measured 2026-11-07). Licensed CC BY 4.0.