Edge network

Fastly

Name: CrawlIndex dataset
License: https://creativecommons.org/licenses/by/4.0/

216 measured sites. 53 of them, 24.5%, block at least one answer-surface AI crawler. Mean readiness score 66.3.

Compare against every other edge network

Sites on Fastly
Rank	Domain	Score	Answer-surface crawlers	Stack
33	fastly.net	Score 79 out of 100, grade B	all allowed	Fastly
46	digicert.com	Score 91 out of 100, grade A	all allowed	Adobe Experience Manager . Fastly
48	gandi.net	Score 83 out of 100, grade B	all allowed	Fastly
67	spotify.com	Score 53 out of 100, grade D	all allowed	Fastly
92	mozilla.org	Score 62 out of 100, grade C	all allowed	Fastly
118	github.io	Score 57 out of 100, grade D	all allowed	Fastly
122	apache.org	Score 62 out of 100, grade C	all allowed	Fastly
154	nytimes.comrefused GPTBot	Score 38 out of 100, grade F	11 blocked	WordPress . Fastly
159	paypal.com	Score 88 out of 100, grade B	all allowed	Fastly
178	adobe.io	Score 64 out of 100, grade C	all allowed	Fastly
188	cnn.com	Score 32 out of 100, grade F	10 blocked	Fastly
200	forbes.com	Score 63 out of 100, grade C, partial assessment	5 blocked	Next.js . Fastly
207	bbc.com	Score 38 out of 100, grade F	9 blocked	Next.js . Fastly
227	bbc.co.uk	Score 41 out of 100, grade D	9 blocked	Fastly
275	springer.com	Score 57 out of 100, grade D	all allowed	Fastly
282	mozilla.com	Score 78 out of 100, grade B	all allowed	Fastly
286	nature.com	Score 34 out of 100, grade F	7 blocked	Fastly
289	gov.uk	Score 67 out of 100, grade C	all allowed	Fastly
318	etsy.comrefused GPTBot	Score 89 out of 100, grade B, partial assessment	all allowed	Fastly
328	dnsmadeeasy.com	Score 56 out of 100, grade D	all allowed	Adobe Experience Manager . Fastly
342	issuu.com	Score 67 out of 100, grade C	all allowed	Next.js . Fastly
359	bloomberg.comrefused GPTBot	Score 30 out of 100, grade F, partial assessment	10 blocked	Fastly
431	businessinsider.com	Score 70 out of 100, grade C	1 blocked	Fastly
482	arxiv.org	Score 59 out of 100, grade D	all allowed	Fastly
487	scribd.com	Score 71 out of 100, grade C	all allowed	Next.js . Fastly
488	docker.com	Score 83 out of 100, grade B	all allowed	WordPress . Fastly
497	behance.net	Score 66 out of 100, grade C, partial assessment	5 blocked	Fastly
500	foxnews.com	Score 95 out of 100, grade A	all allowed	Fastly
512	slideshare.net	Score 49 out of 100, grade D	all allowed	Fastly
517	firefox.com	Score 83 out of 100, grade B	all allowed	Fastly
535	time.com	Score 79 out of 100, grade B	all allowed	Next.js . Fastly
567	telegraph.co.uk	Score 39 out of 100, grade F	10 blocked	Adobe Experience Manager . Fastly
590	wix.com	Score 91 out of 100, grade A	all allowed	Wix . Fastly
622	nintendo.com	Score 51 out of 100, grade D	5 blocked	Next.js . Fastly
651	service.gov.uk	Score 59 out of 100, grade D	all allowed	Fastly
659	imgur.com	Score 48 out of 100, grade D	all allowed	Fastly
665	independent.co.uk	Score 72 out of 100, grade C	all allowed	Fastly
674	openstreetmap.orgrefused GPTBot	Score 49 out of 100, grade D	all allowed	Fastly
679	lemonde.fr	Score 53 out of 100, grade D	5 blocked	Fastly
712	bandcamp.com	Score 48 out of 100, grade D	4 blocked	Fastly
714	ted.com	Score 47 out of 100, grade D	5 blocked	Next.js . Fastly
741	python.org	Score 63 out of 100, grade C	all allowed	Fastly
753	mlb.com	Score 64 out of 100, grade C	all allowed	Contentful . Fastly
771	lenovo.com	Score 56 out of 100, grade D	all allowed	Adobe Experience Manager . Fastly
807	theverge.com	Score 46 out of 100, grade D	9 blocked	WordPress . Fastly
945	docker.io	Score 83 out of 100, grade B	all allowed	WordPress . Fastly
957	corriere.itrefused GPTBot	Score 56 out of 100, grade D	5 blocked	Fastly
977	elmundo.es	Score 56 out of 100, grade D	5 blocked	Fastly
985	giphy.com	Score 59 out of 100, grade D	all allowed	Next.js . Fastly
1002	theconversation.com	Score 29 out of 100, grade F	11 blocked	Next.js . Fastly
1006	huffpost.com	Score 49 out of 100, grade D	11 blocked	Fastly
1036	yale.edu	Score 59 out of 100, grade D	all allowed	Drupal . Fastly
1065	marca.com	Score 60 out of 100, grade C	5 blocked	Fastly
1073	adblockplus.org	Score 56 out of 100, grade D	all allowed	Fastly
1083	cam.ac.uk	Score 63 out of 100, grade C	all allowed	Drupal . Fastly
1101	cookpad.com	Score 41 out of 100, grade D	7 blocked	Fastly
1135	upenn.edu	Score 62 out of 100, grade C	all allowed	Drupal . Fastly
1177	biomedcentral.com	Score 49 out of 100, grade D	all allowed	Fastly
1212	rightmove.co.uk	Score 93 out of 100, grade A, partial assessment	1 blocked	Fastly
1229	nsone.net	Score 45 out of 100, grade D	all allowed	Fastly
1234	jstor.org	Score 81 out of 100, grade B, partial assessment	3 blocked	Fastly
1242	huffingtonpost.com	Score 49 out of 100, grade D	11 blocked	Fastly
1346	0xrpc.io	Score 53 out of 100, grade D	all allowed	Fastly
1369	buzzfeed.com	Score 41 out of 100, grade D	7 blocked	Next.js . Fastly
1431	inps.it	Score 64 out of 100, grade C	all allowed	Adobe Experience Manager . Fastly
1453	immobiliare.itrefused GPTBot	Score 100 out of 100, grade A, partial assessment	all allowed	Fastly
1462	eff.org	Score 56 out of 100, grade D	all allowed	Drupal . Fastly
1472	ekstrabladet.dk	Score 31 out of 100, grade F	11 blocked	Fastly
1483	leroymerlin.esrefused GPTBot	Score 100 out of 100, grade A, partial assessment	all allowed	Fastly
1560	newsweek.comrefused GPTBot	Score 41 out of 100, grade D	5 blocked	WordPress . Fastly
1568	cmu.edu	Score 66 out of 100, grade C	all allowed	Drupal . Fastly
1785	acs.org	Score 67 out of 100, grade C	all allowed	Adobe Experience Manager . Fastly
1800	twilio.com	Score 83 out of 100, grade B	all allowed	Adobe Experience Manager . Fastly
1810	adroll.com	Score 88 out of 100, grade B	all allowed	Fastly
1880	utexas.edu	Score 59 out of 100, grade D	all allowed	Drupal . Fastly
1887	tvazteca.com	Score 76 out of 100, grade B	all allowed	Fastly
1906	fastcompany.comrefused GPTBot	Score 88 out of 100, grade B, partial assessment	2 blocked	Fastly
1975	norton.com	Score 88 out of 100, grade B	all allowed	Adobe Experience Manager . Fastly
1988	cloud.com	Score 67 out of 100, grade C	all allowed	Fastly
2051	euronews.com	Score 74 out of 100, grade C	2 blocked	Fastly
2098	ign.comrefused GPTBot	Score 31 out of 100, grade F	10 blocked	WordPress . Fastly
2110	instructure.com	Score 91 out of 100, grade A	all allowed	Drupal . Fastly
2175	ticketmaster.comrefused GPTBot	Score 83 out of 100, grade B, partial assessment	all allowed	Fastly
2234	chartbeat.net	Score 83 out of 100, grade B	all allowed	WordPress . Fastly
2244	vox.com	Score 46 out of 100, grade D	9 blocked	WordPress . Fastly
2248	savvis.net	Score 63 out of 100, grade C	all allowed	Adobe Experience Manager . Fastly
2279	mastercard.com	Score 60 out of 100, grade C	all allowed	Adobe Experience Manager . Fastly
2299	techradar.com	Score 70 out of 100, grade C	1 blocked	Fastly
2312	last.fm	Score 68 out of 100, grade C	all allowed	Fastly
2314	bazaarvoice.com	Score 83 out of 100, grade B	all allowed	WordPress . Fastly
2320	unc.edu	Score 83 out of 100, grade B	all allowed	WordPress . Fastly
2321	inc.comrefused GPTBot	Score 88 out of 100, grade B, partial assessment	2 blocked	Fastly
2365	utoronto.carefused GPTBot	Score 83 out of 100, grade B, partial assessment	all allowed	Fastly
2374	apachefriends.org	Score 64 out of 100, grade C	all allowed	Fastly
2401	accenture.com	Score 75 out of 100, grade B	all allowed	Adobe Experience Manager . Fastly
2402	slate.com	Score 52 out of 100, grade D	5 blocked	Fastly
2442	usc.edu	Score 75 out of 100, grade B	all allowed	WordPress . Fastly
2459	sfgate.com	Score 39 out of 100, grade F	5 blocked	Fastly
2463	geotrust.com	Score 75 out of 100, grade B	all allowed	Adobe Experience Manager . Fastly
2469	ey.com	Score 77 out of 100, grade B	all allowed	Adobe Experience Manager . Fastly
2473	ucdavis.edu	Score 62 out of 100, grade C	all allowed	Drupal . Fastly
2479	splunkcloud.com	Score 68 out of 100, grade C	all allowed	Adobe Experience Manager . Fastly
2491	zend.com	Score 75 out of 100, grade B	all allowed	Drupal . Fastly
2500	urbanairship.com	Score 92 out of 100, grade A	all allowed	WordPress . Fastly
2530	colorado.edu	Score 62 out of 100, grade C	all allowed	Drupal . Fastly
2534	iheart.com	Score 64 out of 100, grade C	all allowed	Fastly
2547	smh.com.au	Score 45 out of 100, grade D	8 blocked	Fastly
2587	livescience.com	Score 70 out of 100, grade C	1 blocked	Fastly
2596	drupal.org	Score 52 out of 100, grade D	all allowed	Fastly
2598	arizona.edu	Score 70 out of 100, grade C	all allowed	Drupal . Fastly
2607	zeit.derefused GPTBot	Score 55 out of 100, grade D	7 blocked	Fastly
2609	thehill.comrefused GPTBot	Score 47 out of 100, grade D, partial assessment	8 blocked	Fastly
2641	perl.org	Score 59 out of 100, grade D	all allowed	Fastly
2716	int08h.com	Score 55 out of 100, grade D	all allowed	Fastly
2728	pypi.org	Score 67 out of 100, grade C	all allowed	Fastly
2733	elastic.co	Score 67 out of 100, grade C	all allowed	Next.js . Fastly
2753	anchor.fm	Score 59 out of 100, grade D	all allowed	Next.js . Fastly
2762	thomsonreuters.com	Score 75 out of 100, grade B	all allowed	Adobe Experience Manager . Fastly
2798	startappservice.comrefused GPTBot	Score 83 out of 100, grade B, partial assessment	all allowed	Fastly
2809	shazam.com	Score 100 out of 100, grade A, partial assessment	all allowed	Fastly
2811	history.com	Score 80 out of 100, grade B	all allowed	Next.js . Fastly
2847	nic.ai	Score 79 out of 100, grade B	all allowed	Wix . Fastly
2875	splashtop.com	Score 75 out of 100, grade B	all allowed	Contentful . Fastly
2885	kpmg.com	Score 91 out of 100, grade A	all allowed	Adobe Experience Manager . Fastly
2903	thawte.com	Score 80 out of 100, grade B	all allowed	Adobe Experience Manager . Fastly
2905	nokia.com	Score 71 out of 100, grade C	all allowed	Drupal . Fastly
2953	mastodon.social	Score 45 out of 100, grade D	1 blocked	Fastly
3029	ucsb.edu	Score 59 out of 100, grade D	all allowed	Drupal . Fastly
3045	cpan.org	Score 59 out of 100, grade D	all allowed	Fastly
3048	ntppool.org	Score 56 out of 100, grade D	all allowed	Fastly
3064	imagemagick.org	Score 70 out of 100, grade C	all allowed	Fastly
3093	curl.se	Score 56 out of 100, grade D	all allowed	Fastly
3097	innogames.de	Score 56 out of 100, grade D	all allowed	TYPO3 . Fastly
3117	esa.int	Score 56 out of 100, grade D	all allowed	Fastly
3141	gog.com	Score 53 out of 100, grade D	all allowed	Fastly
3160	foursquare.com	Score 75 out of 100, grade B	2 blocked	HubSpot CMS . Fastly
3168	nyc.gov	Score 62 out of 100, grade C	all allowed	Adobe Experience Manager . Fastly
3189	foxsports.com	Score 72 out of 100, grade C	all allowed	Nuxt . Fastly
3193	zemanta.com	Score 76 out of 100, grade B	all allowed	WordPress . Fastly
3200	pitt.edu	Score 59 out of 100, grade D	all allowed	Drupal . Fastly
3228	rtve.es	Score 72 out of 100, grade C	all allowed	Fastly
3237	cancer.org	Score 71 out of 100, grade C	all allowed	Adobe Experience Manager . Fastly
3245	fox.com	Score 83 out of 100, grade B	all allowed	Next.js . Fastly
3265	tomshardware.com	Score 70 out of 100, grade C	1 blocked	Fastly
3269	mediavine.com	Score 83 out of 100, grade B	all allowed	WordPress . Fastly
3288	nymag.com	Score 49 out of 100, grade D	9 blocked	Fastly
3293	cox.net	Score 45 out of 100, grade D	all allowed	Adobe Experience Manager . Fastly
3295	isc.org	Score 62 out of 100, grade C	all allowed	Fastly
3300	mcdonalds.com	Score 76 out of 100, grade B	all allowed	Adobe Experience Manager . Fastly
3302	chartbeat.com	Score 83 out of 100, grade B	all allowed	WordPress . Fastly
3320	georgetown.edu	Score 89 out of 100, grade B, partial assessment	all allowed	Fastly
3330	wustl.edu	Score 83 out of 100, grade B	all allowed	WordPress . Fastly
3348	hrw.org	Score 66 out of 100, grade C	all allowed	Drupal . Fastly
3359	bbci.co.uk	Score 63 out of 100, grade C	all allowed	Fastly
3366	gnome.org	Score 59 out of 100, grade D	all allowed	Fastly
3388	iterable.com	Score 95 out of 100, grade A	all allowed	WordPress . Fastly
3412	newsroom.bi	Score 67 out of 100, grade C	all allowed	Fastly
3431	chron.com	Score 37 out of 100, grade F	6 blocked	Fastly
3474	smartsheet.com	Score 82 out of 100, grade B	all allowed	Drupal . Fastly
3487	stuff.co.nz	Score 28 out of 100, grade F	8 blocked	Fastly
3515	wistia.com	Score 75 out of 100, grade B	all allowed	Contentful . Fastly
3532	foxbusiness.com	Score 79 out of 100, grade B	all allowed	Fastly
3534	uwaterloo.ca	Score 59 out of 100, grade D	all allowed	Drupal . Fastly
3545	tufts.edu	Score 72 out of 100, grade C	all allowed	Drupal . Fastly
3553	gimp.org	Score 62 out of 100, grade C	all allowed	Fastly
3627	prtimes.jp	Score 71 out of 100, grade C	all allowed	Next.js . Fastly
3638	xkcd.com	Score 53 out of 100, grade D	1 blocked	Fastly
3645	admaster.cc	Score 80 out of 100, grade B	all allowed	Wix . Fastly
3706	dev.to	Score 67 out of 100, grade C	all allowed	Fastly
3720	freelancer.com	Score 76 out of 100, grade B	all allowed	Fastly
3735	yomiuri.co.jp	Score 41 out of 100, grade D	11 blocked	WordPress . Fastly
3761	space.com	Score 70 out of 100, grade C	1 blocked	Fastly
3812	perl.com	Score 53 out of 100, grade D	all allowed	Fastly
3883	bell-labs.com	Score 63 out of 100, grade C	all allowed	Drupal . Fastly
3932	mysterium.network	Score 80 out of 100, grade B	all allowed	Wix . Fastly
3935	seekingalpha.com	Score 58 out of 100, grade D	7 blocked	Fastly
4086	abb.com	Score 56 out of 100, grade D	all allowed	Adobe Experience Manager . Fastly
4090	iii.com	Score 80 out of 100, grade B	all allowed	WordPress . Fastly
4111	uoregon.edu	Score 59 out of 100, grade D	all allowed	Drupal . Fastly
4134	au.com	Score 72 out of 100, grade C	all allowed	Adobe Experience Manager . Fastly
4173	hbo.com	Score 71 out of 100, grade C	all allowed	Next.js . Fastly
4203	answers.com	Score 68 out of 100, grade C	all allowed	Fastly
4215	nordstrom.com	Score 53 out of 100, grade D	all allowed	Fastly
4311	sendgrid.com	Score 62 out of 100, grade C	all allowed	Adobe Experience Manager . Fastly
4321	nfl.com	Score 64 out of 100, grade C	all allowed	Next.js . Fastly
4339	chromium.org	Score 53 out of 100, grade D	all allowed	Fastly
4346	rapidssl.com	Score 72 out of 100, grade C	all allowed	Adobe Experience Manager . Fastly
4354	syncthing.net	Score 53 out of 100, grade D	all allowed	Fastly
4383	nber.org	Score 62 out of 100, grade C	all allowed	Drupal . Fastly
4404	mtrtb.com	Score 83 out of 100, grade B	all allowed	Wix . Fastly
4568	uadns.com	Score 71 out of 100, grade C	all allowed	Wix . Fastly
4616	thestreet.comrefused GPTBot	Score 100 out of 100, grade A, partial assessment	all allowed	Fastly
4620	viator.comrefused GPTBot	Score 83 out of 100, grade B, partial assessment	all allowed	Fastly
4640	nationalacademies.org	Score 59 out of 100, grade D	all allowed	Fastly
4672	bankrate.com	Score 91 out of 100, grade A	all allowed	Next.js . Fastly
4674	patch.com	Score 75 out of 100, grade B	all allowed	Next.js . Fastly
4687	barracudanetworks.com	Score 75 out of 100, grade B	all allowed	Adobe Experience Manager . Fastly
4720	tomsguide.com	Score 70 out of 100, grade C	1 blocked	Fastly
4730	parade.comrefused GPTBot	Score 100 out of 100, grade A, partial assessment	all allowed	Fastly
4749	pa.gov	Score 67 out of 100, grade C	all allowed	Adobe Experience Manager . Fastly

Showing the 200 most-visited.

Using these figures

Free to reuse in research, journalism or a product under CC BY 4.0, with credit to Fidget Labs BV. Quote the measurement date so the claim stays checkable as the index moves.

CrawlIndex by Fidget Labs BV. "Agent readiness on Fastly." https://crawlindex.org (measured 2026-08-09). Licensed CC BY 4.0.