Edge network

Fastly

Name: CrawlIndex dataset
License: https://creativecommons.org/licenses/by/4.0/

205 measured sites. 49 of them, 23.9%, block at least one answer-surface AI crawler. Mean readiness score 64.5.

Compare against every other edge network

Sites on Fastly
Rank	Domain	Score	Answer-surface crawlers	Stack
36	fastly.net	Score 80 out of 100, grade B	all allowed	Fastly
44	gandi.net	Score 77 out of 100, grade B	all allowed	Fastly
47	digicert.com	Score 83 out of 100, grade B	all allowed	Adobe Experience Manager . Fastly
64	spotify.com	Score 52 out of 100, grade D	all allowed	Fastly
100	mozilla.org	Score 60 out of 100, grade C	all allowed	Fastly
126	github.io	Score 55 out of 100, grade D	all allowed	Fastly
131	apache.org	Score 60 out of 100, grade C	all allowed	Fastly
159	nytimes.comrefused GPTBot	Score 21 out of 100, grade F, partial assessment	11 blocked	Fastly
175	adobe.io	Score 61 out of 100, grade C	all allowed	Fastly
180	telekom.net	Score 59 out of 100, grade D	all allowed	Adobe Experience Manager . Fastly
204	cnn.com	Score 31 out of 100, grade F	10 blocked	Fastly
218	bbc.com	Score 34 out of 100, grade F	9 blocked	Next.js . Fastly
219	forbes.com	Score 57 out of 100, grade D, partial assessment	5 blocked	Next.js . Fastly
236	bbc.co.uk	Score 37 out of 100, grade F	9 blocked	Fastly
289	dnsmadeeasy.com	Score 55 out of 100, grade D	all allowed	Adobe Experience Manager . Fastly
292	springer.com	Score 92 out of 100, grade A, partial assessment	all allowed	Fastly
304	nature.com	Score 45 out of 100, grade D, partial assessment	7 blocked	Fastly
309	gov.uk	Score 64 out of 100, grade C	all allowed	Fastly
333	mozilla.com	Score 76 out of 100, grade B	all allowed	Fastly
338	etsy.comrefused GPTBot	Score 84 out of 100, grade B, partial assessment	all allowed	Fastly
375	issuu.com	Score 64 out of 100, grade C	all allowed	Next.js . Fastly
379	bloomberg.comrefused GPTBot	Score 27 out of 100, grade F, partial assessment	10 blocked	Fastly
460	businessinsider.com	Score 65 out of 100, grade C	1 blocked	WordPress . Fastly
479	arxiv.org	Score 57 out of 100, grade D	all allowed	Fastly
506	scribd.com	Score 67 out of 100, grade C	all allowed	Next.js . Fastly
510	docker.com	Score 80 out of 100, grade B	all allowed	WordPress . Fastly
514	behance.net	Score 60 out of 100, grade C, partial assessment	5 blocked	Fastly
515	foxnews.com	Score 89 out of 100, grade B	all allowed	Fastly
530	slideshare.net	Score 78 out of 100, grade B, partial assessment	all allowed	Fastly
546	firefox.com	Score 80 out of 100, grade B	all allowed	Fastly
571	time.com	Score 74 out of 100, grade C	all allowed	Next.js . Fastly
592	openstreetmap.orgrefused GPTBot	Score 48 out of 100, grade D	all allowed	Fastly
608	playstation.com	Score 73 out of 100, grade C	all allowed	Adobe Experience Manager . Fastly
621	telegraph.co.uk	Score 37 out of 100, grade F	10 blocked	Adobe Experience Manager . Fastly
623	nintendo.com	Score 58 out of 100, grade D	5 blocked	Next.js . Fastly
632	wix.com	Score 83 out of 100, grade B	all allowed	Wix . Fastly
667	service.gov.uk	Score 57 out of 100, grade D	all allowed	Fastly
706	imgur.com	Score 48 out of 100, grade D	all allowed	Fastly
707	lemonde.fr	Score 49 out of 100, grade D	5 blocked	Fastly
731	independent.co.uk	Score 68 out of 100, grade C	all allowed	Fastly
740	mlb.com	Score 61 out of 100, grade C	all allowed	Contentful . Fastly
743	bandcamp.com	Score 46 out of 100, grade D	4 blocked	Fastly
752	python.org	Score 65 out of 100, grade C	all allowed	Fastly
801	ted.com	Score 46 out of 100, grade D	5 blocked	Next.js . Fastly
853	theverge.com	Score 44 out of 100, grade D	9 blocked	WordPress . Fastly
935	docker.io	Score 80 out of 100, grade B	all allowed	WordPress . Fastly
977	firefox-portal-detection.com	Score 78 out of 100, grade B, partial assessment	all allowed	Fastly
978	corriere.itrefused GPTBot	Score 50 out of 100, grade D	6 blocked	Fastly
1005	elmundo.es	Score 56 out of 100, grade D	5 blocked	Fastly
1070	adblockplus.org	Score 54 out of 100, grade D	all allowed	Fastly
1084	marca.com	Score 63 out of 100, grade C	5 blocked	Fastly
1093	huffpost.com	Score 46 out of 100, grade D	11 blocked	Fastly
1094	instructure.com	Score 83 out of 100, grade B	all allowed	Drupal . Fastly
1103	giphy.com	Score 58 out of 100, grade D	all allowed	Next.js . Fastly
1113	theconversation.com	Score 26 out of 100, grade F	11 blocked	Next.js . Fastly
1135	cookpad.com	Score 41 out of 100, grade D	7 blocked	Fastly
1214	upenn.edu	Score 63 out of 100, grade C	all allowed	Drupal . Fastly
1222	rightmove.co.uk	Score 85 out of 100, grade B, partial assessment	1 blocked	Fastly
1316	biomedcentral.com	Score 78 out of 100, grade B, partial assessment	all allowed	Fastly
1322	startappservice.comrefused GPTBot	Score 78 out of 100, grade B, partial assessment	all allowed	Fastly
1334	jstor.org	Score 74 out of 100, grade C, partial assessment	3 blocked	Fastly
1376	huffingtonpost.com	Score 46 out of 100, grade D	11 blocked	Fastly
1407	inps.it	Score 61 out of 100, grade C	all allowed	Adobe Experience Manager . Fastly
1462	leroymerlin.esrefused GPTBot	Score 92 out of 100, grade A, partial assessment	all allowed	Fastly
1467	cam.ac.uk	Score 61 out of 100, grade C	all allowed	Drupal . Fastly
1498	twilio.com	Score 81 out of 100, grade B	all allowed	Adobe Experience Manager . Fastly
1504	immobiliare.itrefused GPTBot	Score 92 out of 100, grade A, partial assessment	all allowed	Fastly
1552	buzzfeed.com	Score 41 out of 100, grade D	7 blocked	Fastly
1700	eff.org	Score 55 out of 100, grade D	all allowed	Drupal . Fastly
1793	cmu.edu	Score 63 out of 100, grade C	all allowed	Drupal . Fastly
1811	adroll.com	Score 81 out of 100, grade B	all allowed	Fastly
1814	newsweek.comrefused GPTBot	Score 57 out of 100, grade D, partial assessment	5 blocked	WordPress . Fastly
1820	acs.org	Score 67 out of 100, grade C	all allowed	Adobe Experience Manager . Fastly
1843	rtve.es	Score 68 out of 100, grade C	all allowed	Fastly
1871	utexas.edu	Score 57 out of 100, grade D	all allowed	Drupal . Fastly
1935	cloud.com	Score 64 out of 100, grade C	all allowed	Fastly
1942	fastcompany.com	Score 59 out of 100, grade D, partial assessment	4 blocked	Fastly
1953	euronews.com	Score 71 out of 100, grade C	2 blocked	Fastly
1997	savvis.net	Score 60 out of 100, grade C	all allowed	Adobe Experience Manager . Fastly
2062	mastercard.com	Score 58 out of 100, grade D	all allowed	Adobe Experience Manager . Fastly
2103	ticketmaster.comrefused GPTBot	Score 78 out of 100, grade B, partial assessment	all allowed	Fastly
2171	chartbeat.net	Score 80 out of 100, grade B	all allowed	WordPress . Fastly
2177	unc.edu	Score 80 out of 100, grade B	all allowed	WordPress . Fastly
2180	constellix.com	Score 52 out of 100, grade D	all allowed	Adobe Experience Manager . Fastly
2211	bazaarvoice.com	Score 80 out of 100, grade B	all allowed	WordPress . Fastly
2231	techradar.com	Score 65 out of 100, grade C	1 blocked	Fastly
2232	vox.com	Score 44 out of 100, grade D	9 blocked	WordPress . Fastly
2292	elastic.co	Score 64 out of 100, grade C	all allowed	Next.js . Fastly
2307	inc.com	Score 59 out of 100, grade D, partial assessment	4 blocked	Fastly
2333	last.fm	Score 65 out of 100, grade C	all allowed	Fastly
2343	utoronto.carefused GPTBot	Score 78 out of 100, grade B, partial assessment	all allowed	Fastly
2379	usc.edu	Score 75 out of 100, grade B	all allowed	WordPress . Fastly
2395	pypi.org	Score 64 out of 100, grade C	all allowed	Fastly
2402	ucdavis.edu	Score 60 out of 100, grade C	all allowed	Drupal . Fastly
2403	slate.com	Score 46 out of 100, grade D	5 blocked	Fastly
2410	ey.com	Score 75 out of 100, grade B	all allowed	Adobe Experience Manager . Fastly
2423	accenture.com	Score 71 out of 100, grade C	all allowed	Adobe Experience Manager . Fastly
2436	urbanairship.com	Score 86 out of 100, grade B	all allowed	WordPress . Fastly
2458	apachefriends.org	Score 61 out of 100, grade C	all allowed	Fastly
2478	peacocktv.com	Score 52 out of 100, grade D	all allowed	Next.js . Fastly
2498	zend.com	Score 71 out of 100, grade C	all allowed	Drupal . Fastly
2509	iheart.com	Score 61 out of 100, grade C	all allowed	Fastly
2526	letour.fr	Score 62 out of 100, grade C	all allowed	Fastly
2527	arizona.edu	Score 69 out of 100, grade C	all allowed	Drupal . Fastly
2536	sfgate.com	Score 56 out of 100, grade D, partial assessment	5 blocked	Fastly
2553	zeit.de	Score 49 out of 100, grade D, partial assessment	7 blocked	Fastly
2554	smh.com.au	Score 44 out of 100, grade D	8 blocked	Fastly
2570	tvazteca.com	Score 74 out of 100, grade C	all allowed	Fastly
2595	hola.com	Score 62 out of 100, grade C	3 blocked	Next.js . Fastly
2599	splunkcloud.com	Score 65 out of 100, grade C	all allowed	Adobe Experience Manager . Fastly
2600	perl.org	Score 55 out of 100, grade D	all allowed	Fastly
2604	drupal.org	Score 84 out of 100, grade B, partial assessment	all allowed	Fastly
2613	colorado.edu	Score 60 out of 100, grade C	all allowed	Drupal . Fastly
2641	thehill.comrefused GPTBot	Score 42 out of 100, grade D, partial assessment	8 blocked	Fastly
2660	thomsonreuters.com	Score 71 out of 100, grade C	all allowed	Adobe Experience Manager . Fastly
2717	int08h.com	Score 57 out of 100, grade D	all allowed	Fastly
2803	mastodon.social	Score 45 out of 100, grade D	1 blocked	Fastly
2823	shazam.com	Score 92 out of 100, grade A, partial assessment	all allowed	Fastly
2835	splashtop.com	Score 74 out of 100, grade C	all allowed	Contentful . Fastly
2944	ucsb.edu	Score 57 out of 100, grade D	all allowed	Drupal . Fastly
2954	anchor.fm	Score 57 out of 100, grade D	all allowed	Next.js . Fastly
2955	thawte.com	Score 75 out of 100, grade B	all allowed	Adobe Experience Manager . Fastly
3019	nokia.com	Score 67 out of 100, grade C	all allowed	Drupal . Fastly
3068	kpmg.com	Score 85 out of 100, grade B	all allowed	Adobe Experience Manager . Fastly
3083	cpan.org	Score 60 out of 100, grade C	all allowed	Fastly
3095	ntppool.org	Score 55 out of 100, grade D	all allowed	Fastly
3101	curl.se	Score 55 out of 100, grade D	all allowed	Fastly
3156	imagemagick.org	Score 66 out of 100, grade C	all allowed	Fastly
3188	0xrpc.io	Score 52 out of 100, grade D	all allowed	Fastly
3216	pitt.edu	Score 57 out of 100, grade D	all allowed	Drupal . Fastly
3252	esa.int	Score 55 out of 100, grade D	all allowed	Fastly
3259	nyc.gov	Score 63 out of 100, grade C	all allowed	Adobe Experience Manager . Fastly
3271	gog.com	Score 57 out of 100, grade D	all allowed	Fastly
3325	isc.org	Score 62 out of 100, grade C	all allowed	Fastly
3355	tomshardware.com	Score 68 out of 100, grade C	1 blocked	Fastly
3358	mediavine.com	Score 80 out of 100, grade B	all allowed	HubSpot CMS . Fastly
3367	iterable.com	Score 89 out of 100, grade B	all allowed	WordPress . Fastly
3393	bbci.co.uk	Score 60 out of 100, grade C	all allowed	Fastly
3403	cancer.org	Score 67 out of 100, grade C	all allowed	Adobe Experience Manager . Fastly
3420	foursquare.com	Score 74 out of 100, grade C	2 blocked	HubSpot CMS . Fastly
3442	gnome.org	Score 57 out of 100, grade D	all allowed	Fastly
3493	chartbeat.com	Score 80 out of 100, grade B	all allowed	WordPress . Fastly
3504	nymag.com	Score 44 out of 100, grade D	9 blocked	Fastly
3510	zemanta.com	Score 67 out of 100, grade C	all allowed	WordPress . Fastly
3517	georgetown.edu	Score 84 out of 100, grade B, partial assessment	all allowed	Fastly
3541	nfl.com	Score 64 out of 100, grade C	all allowed	Next.js . Fastly
3572	hrw.org	Score 63 out of 100, grade C	all allowed	Drupal . Fastly
3580	wustl.edu	Score 80 out of 100, grade B	all allowed	WordPress . Fastly
3586	wistia.com	Score 73 out of 100, grade C	all allowed	Contentful . Fastly
3629	smartsheet.com	Score 76 out of 100, grade B	all allowed	Drupal . Fastly
3642	prtimes.jp	Score 70 out of 100, grade C	all allowed	Fastly
3644	fox.com	Score 86 out of 100, grade B	all allowed	Next.js . Fastly
3668	stuff.co.nz	Score 27 out of 100, grade F	8 blocked	Fastly
3680	gimp.org	Score 60 out of 100, grade C	all allowed	Fastly
3708	tufts.edu	Score 67 out of 100, grade C	all allowed	Drupal . Fastly
3729	iii.com	Score 80 out of 100, grade B	all allowed	WordPress . Fastly
3747	chron.com	Score 50 out of 100, grade D, partial assessment	6 blocked	Fastly
3748	gatech.edu	Score 60 out of 100, grade C	all allowed	Drupal . Fastly
3752	newsroom.bi	Score 64 out of 100, grade C	all allowed	Fastly
3754	xkcd.com	Score 54 out of 100, grade D	1 blocked	Fastly
3760	uwaterloo.ca	Score 57 out of 100, grade D	all allowed	Drupal . Fastly
3770	foxbusiness.com	Score 77 out of 100, grade B	all allowed	Fastly
3789	dev.to	Score 76 out of 100, grade B	all allowed	Fastly
3862	fsu.edu	Score 60 out of 100, grade C	all allowed	Drupal . Fastly
3890	perl.com	Score 52 out of 100, grade D	all allowed	Fastly
3896	mysterium.network	Score 73 out of 100, grade C	all allowed	Wix . Fastly
3902	foxsports.com	Score 69 out of 100, grade C	all allowed	Nuxt . Fastly
3927	yomiuri.co.jp	Score 40 out of 100, grade D	11 blocked	WordPress . Fastly
3968	bell-labs.com	Score 60 out of 100, grade C	all allowed	Drupal . Fastly
3978	space.com	Score 68 out of 100, grade C	1 blocked	Fastly
3994	rapidssl.com	Score 68 out of 100, grade C	all allowed	Adobe Experience Manager . Fastly
4029	au.com	Score 69 out of 100, grade C	all allowed	Adobe Experience Manager . Fastly
4172	abb.com	Score 54 out of 100, grade D	all allowed	Adobe Experience Manager . Fastly
4175	seekingalpha.com	Score 52 out of 100, grade D	7 blocked	Fastly
4249	hbo.com	Score 67 out of 100, grade C	all allowed	Next.js . Fastly
4353	chromium.org	Score 92 out of 100, grade A, partial assessment	all allowed	Fastly
4423	nber.org	Score 63 out of 100, grade C	all allowed	Drupal . Fastly
4461	nordstrom.com	Score 52 out of 100, grade D	all allowed	Fastly
4466	answers.com	Score 65 out of 100, grade C	all allowed	Fastly
4522	syncthing.net	Score 52 out of 100, grade D	all allowed	Fastly
4552	uadns.com	Score 67 out of 100, grade C	all allowed	Wix . Fastly
4571	principal.com	Score 67 out of 100, grade C	all allowed	Drupal . Fastly
4578	freelancer.com	Score 72 out of 100, grade C	all allowed	Fastly
4597	swisscom.ch	Score 72 out of 100, grade C	all allowed	Adobe Experience Manager . Fastly
4639	parade.comrefused GPTBot	Score 92 out of 100, grade A, partial assessment	all allowed	Fastly
4705	kayak.com	Score 86 out of 100, grade B	all allowed	Fastly
4736	bankrate.com	Score 83 out of 100, grade B	all allowed	Next.js . Fastly
4744	pa.gov	Score 64 out of 100, grade C	all allowed	Adobe Experience Manager . Fastly
4777	tomsguide.com	Score 70 out of 100, grade C	1 blocked	Fastly
4798	nine.com.au	Score 48 out of 100, grade D	8 blocked	Fastly
4809	nic.ai	Score 73 out of 100, grade C	all allowed	Wix . Fastly
4823	patch.com	Score 72 out of 100, grade C	all allowed	Next.js . Fastly
4828	nationalacademies.org	Score 59 out of 100, grade D	all allowed	Fastly
4831	mtrtb.comrefused GPTBot	Score 69 out of 100, grade C	all allowed	Wix . Fastly
4858	zazzle.comrefused GPTBot	Score 92 out of 100, grade A, partial assessment	all allowed	Fastly
4910	unwomen.orgrefused GPTBot	Score 78 out of 100, grade B, partial assessment	all allowed	Fastly
4913	barracudanetworks.com	Score 75 out of 100, grade B	all allowed	Adobe Experience Manager . Fastly
4936	viator.comrefused GPTBot	Score 78 out of 100, grade B, partial assessment	all allowed	Fastly
4938	gmu.edurefused GPTBot	Score 53 out of 100, grade D	all allowed	Drupal . Fastly
4946	thestreet.comrefused GPTBot	Score 92 out of 100, grade A, partial assessment	all allowed	Fastly

Showing the 200 most-visited.

Using these figures

Free to reuse in research, journalism or a product under CC BY 4.0, with credit to Fidget Labs BV. Quote the measurement date so the claim stays checkable as the index moves.

CrawlIndex by Fidget Labs BV. "Agent readiness on Fastly." https://crawlindex.org (measured 2026-09-22). Licensed CC BY 4.0.