Edge network

Netlify

Name: CrawlIndex dataset
License: https://creativecommons.org/licenses/by/4.0/

25 measured sites. 1 of them, 4.0%, block at least one answer-surface AI crawler. Mean readiness score 73.7.

Compare against every other edge network

Sites on Netlify
Rank	Domain	Score	Answer-surface crawlers	Stack
224	lencr.org	Score 53 out of 100, grade D, partial assessment	all allowed	Netlify
320	launchdarkly.com	Score 75 out of 100, grade B	all allowed	Next.js . Netlify
363	stanford.edu	Score 67 out of 100, grade C	all allowed	Storyblok . Netlify
386	ampproject.org	Score 60 out of 100, grade C	all allowed	Netlify
962	netlify.app	Score 95 out of 100, grade A	all allowed	Astro . Netlify
1116	letsencrypt.org	Score 59 out of 100, grade D	all allowed	Netlify
1285	lc.chat	Score 62 out of 100, grade C	all allowed	Netlify
1588	kingbokep.tv	Score 71 out of 100, grade C	all allowed	Netlify
2246	asana.com	Score 92 out of 100, grade A	all allowed	Next.js . Netlify
2336	fullstory.com	Score 73 out of 100, grade C, partial assessment	all allowed	Contentful . Netlify
2466	sendbird.com	Score 81 out of 100, grade B	2 blocked	Nuxt . Netlify
2471	msu.edu	Score 67 out of 100, grade C	all allowed	Next.js . Netlify
3063	callrail.com	Score 53 out of 100, grade D	all allowed	Netlify
3174	docusign.com	Score 83 out of 100, grade B	all allowed	Contentful . Netlify
3569	ampproject.net	Score 60 out of 100, grade C	all allowed	Netlify
3587	wasabisys.com	Score 61 out of 100, grade C, partial assessment	all allowed	Storyblok . Netlify
3979	trimble.com	Score 95 out of 100, grade A, partial assessment	all allowed	Contentful . Netlify
4069	adyen.com	Score 86 out of 100, grade B, partial assessment	all allowed	Nuxt . Netlify
4122	ghost.org	Score 69 out of 100, grade C, partial assessment	all allowed	Netlify
4251	netlify.com	Score 95 out of 100, grade A	all allowed	Astro . Netlify
4273	sketchup.com	Score 95 out of 100, grade A	all allowed	Contentful . Netlify
4332	leagueoflegends.com	Score 83 out of 100, grade B	all allowed	Next.js . Netlify
4533	gohugo.io	Score 59 out of 100, grade D	all allowed	Netlify
4873	eufylife.com	Score 85 out of 100, grade B	all allowed	Shopify . Netlify
4968	anker-in.com	Score 64 out of 100, grade C	all allowed	Next.js . Netlify

Using these figures

Free to reuse in research, journalism or a product under CC BY 4.0, with credit to Fidget Labs BV. Quote the measurement date so the claim stays checkable as the index moves.

CrawlIndex by Fidget Labs BV. "Agent readiness on Netlify." https://crawlindex.org (measured 2026-08-09). Licensed CC BY 4.0.