crawlindex

Search the index. A domain that is not here can still be measured live on the check page.

Edge network

Fastly

213 measured sites. 57 of them, 26.8%, block at least one answer-surface AI crawler. Mean readiness score 63.7.

Compare against every other edge network

Sites on Fastly
RankDomainScoreAnswer-surface crawlersStack
41fastly.netScore 80 out of 100, grade Ball allowedFastly
67gandi.netScore 77 out of 100, grade Ball allowedFastly
78spotify.comScore 52 out of 100, grade Dall allowedFastly
93mozilla.orgScore 60 out of 100, grade Call allowedFastly
128adobe.ioScore 61 out of 100, grade Call allowedFastly
129github.ioScore 55 out of 100, grade Dall allowedFastly
141apache.orgScore 60 out of 100, grade Call allowedFastly
155nytimes.comrefused GPTBotScore 21 out of 100, grade F, partial assessment11 blockedFastly
158telekom.netScore 59 out of 100, grade Dall allowedAdobe Experience Manager . Fastly
175paypal.comrefused GPTBotScore 92 out of 100, grade A, partial assessmentall allowedFastly
179firefox-portal-detection.comScore 78 out of 100, grade B, partial assessmentall allowedFastly
192cnn.comScore 31 out of 100, grade F9 blockedFastly
219bbc.comScore 31 out of 100, grade F10 blockedNext.js . Fastly
227forbes.comrefused GPTBotScore 57 out of 100, grade D, partial assessment5 blockedFastly
242bbc.co.ukScore 34 out of 100, grade F10 blockedFastly
249dnsmadeeasy.comScore 55 out of 100, grade Dall allowedAdobe Experience Manager . Fastly
294nature.comScore 45 out of 100, grade D, partial assessment7 blockedFastly
295gov.ukScore 64 out of 100, grade Call allowedFastly
311springer.comScore 92 out of 100, grade A, partial assessmentall allowedFastly
323avast.comScore 62 out of 100, grade Call allowedAdobe Experience Manager . Fastly
345etsy.comrefused GPTBotScore 84 out of 100, grade B, partial assessmentall allowedFastly
402issuu.comScore 64 out of 100, grade Call allowedNext.js . Fastly
404bloomberg.comrefused GPTBotScore 27 out of 100, grade F, partial assessment10 blockedFastly
453arxiv.orgScore 57 out of 100, grade Dall allowedFastly
489openstreetmap.orgrefused GPTBotScore 48 out of 100, grade Dall allowedFastly
492businessinsider.comScore 72 out of 100, grade C2 blockedFastly
500scribd.comScore 78 out of 100, grade B, partial assessmentall allowedNext.js . Fastly
503foxnews.comScore 89 out of 100, grade Ball allowedFastly
530docker.comScore 80 out of 100, grade Ball allowedWordPress . Fastly
536behance.netrefused GPTBotScore 60 out of 100, grade C, partial assessment5 blockedFastly
548mozilla.comScore 76 out of 100, grade Ball allowedFastly
550firefox.comScore 80 out of 100, grade Ball allowedFastly
568slideshare.netScore 78 out of 100, grade B, partial assessmentall allowedFastly
581time.comrefused GPTBotScore 67 out of 100, grade Call allowedNext.js . Fastly
595wix.comScore 83 out of 100, grade Ball allowedWix . Fastly
630telegraph.co.ukScore 37 out of 100, grade F10 blockedAdobe Experience Manager . Fastly
654service.gov.ukScore 57 out of 100, grade Dall allowedFastly
668nintendo.comScore 48 out of 100, grade D5 blockedNext.js . Fastly
695lemonde.frScore 48 out of 100, grade D, partial assessment5 blockedFastly
700bandcamp.comScore 46 out of 100, grade D4 blockedFastly
707globalsign.comScore 56 out of 100, grade D5 blockedFastly
742independent.co.ukScore 68 out of 100, grade Call allowedFastly
746python.orgScore 65 out of 100, grade Call allowedFastly
796imgur.comScore 48 out of 100, grade Dall allowedFastly
799lenovo.comScore 54 out of 100, grade Dall allowedAdobe Experience Manager . Fastly
838ted.comScore 52 out of 100, grade D5 blockedNext.js . Fastly
853theverge.comScore 44 out of 100, grade D9 blockedWordPress . Fastly
864instructure.comScore 83 out of 100, grade Ball allowedDrupal . Fastly
903mlb.comScore 61 out of 100, grade Call allowedContentful . Fastly
946docker.ioScore 80 out of 100, grade Ball allowedWordPress . Fastly
954huffpost.comScore 46 out of 100, grade D11 blockedFastly
955corriere.itrefused GPTBotScore 34 out of 100, grade F11 blockedFastly
970twilio.comScore 78 out of 100, grade Ball allowedAdobe Experience Manager . Fastly
9910xrpc.ioScore 52 out of 100, grade Dall allowedFastly
1093marca.comScore 42 out of 100, grade D11 blockedFastly
1097adblockplus.orgScore 67 out of 100, grade Call allowedWordPress . Fastly
1109cookpad.comScore 41 out of 100, grade D7 blockedFastly
1113yale.eduScore 60 out of 100, grade Call allowedDrupal . Fastly
1178nsone.netScore 78 out of 100, grade B, partial assessmentall allowedFastly
1188giphy.comScore 58 out of 100, grade Dall allowedNext.js . Fastly
1195theconversation.comScore 26 out of 100, grade F11 blockedNext.js . Fastly
1224rightmove.co.ukScore 85 out of 100, grade B, partial assessment1 blockedFastly
1248jstor.orgScore 74 out of 100, grade C, partial assessment3 blockedFastly
1271upenn.eduScore 84 out of 100, grade B, partial assessmentall allowedFastly
1275cloud.comScore 64 out of 100, grade Call allowedFastly
1394adroll.comScore 81 out of 100, grade Ball allowedFastly
1416inps.itScore 61 out of 100, grade Call allowedAdobe Experience Manager . Fastly
1433biomedcentral.comScore 78 out of 100, grade B, partial assessmentall allowedFastly
1447ekstrabladet.dkScore 28 out of 100, grade F11 blockedFastly
1487huffingtonpost.comScore 46 out of 100, grade D11 blockedFastly
1488leroymerlin.esrefused GPTBotScore 92 out of 100, grade A, partial assessmentall allowedFastly
1504immobiliare.itrefused GPTBotScore 92 out of 100, grade A, partial assessmentall allowedFastly
1505cam.ac.ukScore 61 out of 100, grade Call allowedDrupal . Fastly
1525newsweek.comScore 53 out of 100, grade D, partial assessment6 blockedWordPress . Fastly
1656eff.orgScore 64 out of 100, grade Call allowedDrupal . Fastly
1812acs.orgScore 67 out of 100, grade Call allowedAdobe Experience Manager . Fastly
1817buzzfeed.comScore 38 out of 100, grade F7 blockedNext.js . Fastly
1846hola.comScore 63 out of 100, grade C3 blockedNext.js . Fastly
1864cmu.eduScore 63 out of 100, grade Call allowedDrupal . Fastly
1925euronews.comScore 74 out of 100, grade C1 blockedFastly
1928utexas.eduScore 57 out of 100, grade Dall allowedDrupal . Fastly
1971certcenter.comScore 60 out of 100, grade Call allowedAdobe Experience Manager . Fastly
2050ticketmaster.comrefused GPTBotScore 78 out of 100, grade B, partial assessmentall allowedFastly
2053fastcompany.comScore 59 out of 100, grade D, partial assessment4 blockedFastly
2102utoronto.carefused GPTBotScore 78 out of 100, grade B, partial assessmentall allowedFastly
2107crowdstrike.comScore 86 out of 100, grade Ball allowedAdobe Experience Manager . Fastly
2125constellix.comScore 52 out of 100, grade Dall allowedAdobe Experience Manager . Fastly
2146elastic.coScore 76 out of 100, grade Ball allowedNext.js . Fastly
2148ign.comrefused GPTBotScore 29 out of 100, grade F10 blockedWordPress . Fastly
2313chartbeat.netScore 80 out of 100, grade Ball allowedWordPress . Fastly
2342mastercard.comScore 58 out of 100, grade Dall allowedAdobe Experience Manager . Fastly
2351colorado.eduScore 60 out of 100, grade Call allowedDrupal . Fastly
2407splashtop.comScore 74 out of 100, grade Call allowedContentful . Fastly
2425vox.comScore 44 out of 100, grade D9 blockedWordPress . Fastly
2435ucdavis.eduScore 60 out of 100, grade Call allowedDrupal . Fastly
2437usc.eduScore 75 out of 100, grade Ball allowedWordPress . Fastly
2442arizona.eduScore 69 out of 100, grade Call allowedDrupal . Fastly
2444unc.eduScore 92 out of 100, grade A, partial assessmentall allowedWordPress . Fastly
2458iheart.comScore 55 out of 100, grade D5 blockedFastly
2476inc.comScore 59 out of 100, grade D, partial assessment4 blockedFastly
2480techradar.comScore 62 out of 100, grade C2 blockedFastly
2481last.fmScore 65 out of 100, grade Call allowedFastly
2490pypi.orgScore 64 out of 100, grade Call allowedFastly
2501slate.comScore 46 out of 100, grade D5 blockedFastly
2502fox.comScore 86 out of 100, grade Ball allowedNext.js . Fastly
2505urbanairship.comScore 89 out of 100, grade Ball allowedWordPress . Fastly
2507ey.comScore 77 out of 100, grade Ball allowedAdobe Experience Manager . Fastly
2567splunkcloud.comScore 65 out of 100, grade Call allowedAdobe Experience Manager . Fastly
2579elmundo.esScore 39 out of 100, grade F11 blockedFastly
2598accenture.comScore 77 out of 100, grade Ball allowedAdobe Experience Manager . Fastly
2601thomsonreuters.comScore 71 out of 100, grade Call allowedAdobe Experience Manager . Fastly
2642thehill.comrefused GPTBotScore 48 out of 100, grade D7 blockedWordPress . Fastly
2645smh.com.auScore 44 out of 100, grade D8 blockedFastly
2667mastodon.socialScore 32 out of 100, grade F5 blockedFastly
2670perl.orgScore 58 out of 100, grade Dall allowedFastly
2715drupal.orgScore 84 out of 100, grade B, partial assessmentall allowedFastly
2725apachefriends.orgScore 61 out of 100, grade Call allowedFastly
2748savvis.netScore 60 out of 100, grade Call allowedAdobe Experience Manager . Fastly
2764sfgate.comScore 56 out of 100, grade D, partial assessment5 blockedFastly
2802kpmg.comScore 85 out of 100, grade Ball allowedAdobe Experience Manager . Fastly
2808zend.comScore 71 out of 100, grade Call allowedDrupal . Fastly
2828startappservice.comrefused GPTBotScore 78 out of 100, grade B, partial assessmentall allowedFastly
2840shazam.comScore 92 out of 100, grade A, partial assessmentall allowedFastly
2863mheducation.comScore 61 out of 100, grade C1 blockedAdobe Experience Manager . Fastly
2926anchor.fmScore 57 out of 100, grade Dall allowedNext.js . Fastly
2954pitt.eduScore 57 out of 100, grade Dall allowedDrupal . Fastly
2958curl.seScore 55 out of 100, grade Dall allowedFastly
2992history.comScore 77 out of 100, grade Ball allowedNext.js . Fastly
3004thawte.comScore 75 out of 100, grade Ball allowedAdobe Experience Manager . Fastly
3005bbci.co.ukScore 60 out of 100, grade Call allowedFastly
3023esa.intScore 60 out of 100, grade Call allowedFastly
3030ucsb.eduScore 60 out of 100, grade Call allowedDrupal . Fastly
3047ntppool.orgScore 55 out of 100, grade Dall allowedFastly
3071nokia.comScore 67 out of 100, grade Call allowedDrupal . Fastly
3072freedesktop.orgScore 58 out of 100, grade Dall allowedFastly
3076nfl.comScore 64 out of 100, grade Call allowedNext.js . Fastly
3082citrix.comScore 80 out of 100, grade Ball allowedAdobe Experience Manager . Fastly
3086nyc.govScore 63 out of 100, grade Call allowedAdobe Experience Manager . Fastly
3096cpan.orgScore 60 out of 100, grade Call allowedFastly
3127principal.comScore 67 out of 100, grade Call allowedDrupal . Fastly
3133imagemagick.orgScore 69 out of 100, grade Call allowedFastly
3156gog.comScore 57 out of 100, grade Dall allowedFastly
3157newsroom.biScore 77 out of 100, grade Ball allowedFastly
3160tomshardware.comScore 65 out of 100, grade C2 blockedFastly
3178iterable.comScore 89 out of 100, grade Ball allowedWordPress . Fastly
3179rtve.esScore 71 out of 100, grade Call allowedFastly
3201mediavine.comScore 86 out of 100, grade Ball allowedHubSpot CMS . Fastly
3308tufts.eduScore 67 out of 100, grade Call allowedDrupal . Fastly
3314isc.orgScore 62 out of 100, grade Call allowedFastly
3318gnome.orgScore 57 out of 100, grade Dall allowedFastly
3360uwaterloo.caScore 57 out of 100, grade Dall allowedDrupal . Fastly
3392nymag.comScore 44 out of 100, grade D9 blockedFastly
3410hrw.orgScore 63 out of 100, grade Call allowedDrupal . Fastly
3427cancer.orgScore 64 out of 100, grade Call allowedAdobe Experience Manager . Fastly
3432georgetown.edurefused GPTBotScore 84 out of 100, grade B, partial assessmentall allowedFastly
3472prtimes.jpScore 70 out of 100, grade Call allowedFastly
3474wustl.eduScore 80 out of 100, grade Ball allowedWordPress . Fastly
3477fsu.eduScore 60 out of 100, grade Call allowedDrupal . Fastly
3490smartsheet.comScore 76 out of 100, grade Ball allowedDrupal . Fastly
3494chartbeat.comScore 80 out of 100, grade Ball allowedWordPress . Fastly
3542wistia.comScore 73 out of 100, grade Call allowedNext.js . Fastly
3555larazon.esScore 60 out of 100, grade C4 blockedFastly
3579foxbusiness.comScore 77 out of 100, grade Ball allowedFastly
3604gatech.eduScore 60 out of 100, grade Call allowedDrupal . Fastly
3625foursquare.comScore 74 out of 100, grade C2 blockedHubSpot CMS . Fastly
3639gimp.orgScore 60 out of 100, grade Call allowedFastly
3655xkcd.comScore 54 out of 100, grade D1 blockedFastly
3704dev.toScore 76 out of 100, grade Ball allowedFastly
3744zimbra.comScore 62 out of 100, grade Call allowedHubSpot CMS . Fastly
3845chron.comScore 50 out of 100, grade D, partial assessment6 blockedFastly
3859yomiuri.co.jpScore 40 out of 100, grade D11 blockedWordPress . Fastly
3881mysterium.networkScore 73 out of 100, grade Call allowedWix . Fastly
3894bell-labs.comScore 60 out of 100, grade Call allowedDrupal . Fastly
3899space.comScore 65 out of 100, grade C2 blockedFastly
3916perl.comScore 55 out of 100, grade Dall allowedFastly
3927abb.comScore 54 out of 100, grade Dall allowedAdobe Experience Manager . Fastly
3971veeam.comScore 77 out of 100, grade Ball allowedAdobe Experience Manager . Fastly
4004hbo.comScore 67 out of 100, grade Call allowedNext.js . Fastly
4055rapidssl.comScore 68 out of 100, grade Call allowedAdobe Experience Manager . Fastly
4064nber.orgScore 63 out of 100, grade Call allowedDrupal . Fastly
4070seekingalpha.comScore 71 out of 100, grade C4 blockedFastly
4116chromium.orgScore 92 out of 100, grade A, partial assessmentall allowedFastly
4201fubo.tvScore 64 out of 100, grade Call allowedNext.js . Fastly
4205au.comScore 69 out of 100, grade Call allowedAdobe Experience Manager . Fastly
4221unwomen.orgrefused GPTBotScore 78 out of 100, grade B, partial assessmentall allowedFastly
4223gmu.eduScore 60 out of 100, grade Call allowedDrupal . Fastly
4240int08h.comScore 57 out of 100, grade Dall allowedFastly
4274barracuda.comScore 75 out of 100, grade Ball allowedAdobe Experience Manager . Fastly
4298syncthing.netScore 52 out of 100, grade Dall allowedFastly
4318telekom.comScore 66 out of 100, grade Call allowedAdobe Experience Manager . Fastly
4386nine.com.auScore 48 out of 100, grade D8 blockedFastly
4423aetna.comScore 64 out of 100, grade Call allowedAdobe Experience Manager . Fastly
4431tubemogul.comScore 58 out of 100, grade Dall allowedFastly
4446bible.comrefused GPTBotScore 84 out of 100, grade B, partial assessmentall allowedFastly
4487swisscom.chScore 72 out of 100, grade Call allowedAdobe Experience Manager . Fastly
4495cox.netScore 45 out of 100, grade Dall allowedAdobe Experience Manager . Fastly
4596foxsports.comScore 69 out of 100, grade Call allowedNuxt . Fastly
4601gentoo.orgScore 21 out of 100, grade F11 blockedFastly
4647tomsguide.comScore 67 out of 100, grade C2 blockedFastly
4662pearson.comScore 61 out of 100, grade Call allowedAdobe Experience Manager . Fastly

Showing the 200 most-visited.

Using these figures

Free to reuse in research, journalism or a product under CC BY 4.0, with credit to Fidget Labs BV. Quote the measurement date so the claim stays checkable as the index moves.

CrawlIndex by Fidget Labs BV. "Agent readiness on Fastly." https://crawlindex.org (measured 2026-11-22). Licensed CC BY 4.0.