Edge network

Google Cloud / GFE

Name: CrawlIndex dataset
License: https://creativecommons.org/licenses/by/4.0/

156 measured sites. 6 of them, 3.8%, block at least one answer-surface AI crawler. Mean readiness score 57.9.

Compare against every other edge network

Sites on Google Cloud / GFE
Rank	Domain	Score	Answer-surface crawlers	Stack
1	google.comrefused GPTBot	Score 49 out of 100, grade D	all allowed	Google Cloud / GFE
9	youtube.com	Score 56 out of 100, grade D	all allowed	Google Cloud / GFE
129	snapchat.com	Score 46 out of 100, grade D	5 blocked	Next.js . Google Cloud / GFE
164	applovin.com	Score 79 out of 100, grade B	all allowed	Next.js . Google Cloud / GFE
227	gmail.com	Score 64 out of 100, grade C	all allowed	Google Cloud / GFE
242	statsigapi.netrefused GPTBot	Score 78 out of 100, grade B, partial assessment	all allowed	Google Cloud / GFE
305	inmobi.com	Score 62 out of 100, grade C	all allowed	Next.js . Google Cloud / GFE
329	googleblog.com	Score 57 out of 100, grade D	all allowed	Google Cloud / GFE
341	crashlytics.com	Score 60 out of 100, grade C	all allowed	Google Cloud / GFE
450	ipinfo.io	Score 74 out of 100, grade C	all allowed	Next.js . Google Cloud / GFE
471	g.page	Score 63 out of 100, grade C	all allowed	Google Cloud / GFE
513	google.derefused GPTBot	Score 49 out of 100, grade D	all allowed	Google Cloud / GFE
541	google.com.hkrefused GPTBot	Score 52 out of 100, grade D	all allowed	Google Cloud / GFE
650	jotform.com	Score 74 out of 100, grade C	all allowed	Google Cloud / GFE
651	withgoogle.comrefused GPTBot	Score 42 out of 100, grade D	all allowed	Google Cloud / GFE
657	allegro.plrefused GPTBot	Score 84 out of 100, grade B, partial assessment	all allowed	Google Cloud / GFE
757	google.co.ukrefused GPTBot	Score 49 out of 100, grade D	all allowed	Google Cloud / GFE
769	featureassets.orgrefused GPTBot	Score 78 out of 100, grade B, partial assessment	all allowed	Google Cloud / GFE
793	google.com.brrefused GPTBot	Score 52 out of 100, grade D	all allowed	Google Cloud / GFE
878	appspot.com	Score 57 out of 100, grade D	all allowed	Google Cloud / GFE
893	myspace.com	Score 64 out of 100, grade C	all allowed	Google Cloud / GFE
906	dv.techrefused GPTBot	Score 78 out of 100, grade B, partial assessment	all allowed	Google Cloud / GFE
942	spiegel.de	Score 40 out of 100, grade D	8 blocked	Google Cloud / GFE
988	app-ads-services.comrefused GPTBot	Score 52 out of 100, grade D	all allowed	Google Cloud / GFE
1010	flashscore.com	Score 57 out of 100, grade D	1 blocked	Google Cloud / GFE
1095	google.frrefused GPTBot	Score 49 out of 100, grade D	all allowed	Google Cloud / GFE
1105	finn.no	Score 68 out of 100, grade C	all allowed	Contentful . Google Cloud / GFE
1173	google.carefused GPTBot	Score 49 out of 100, grade D	all allowed	Google Cloud / GFE
1197	indiamart.comrefused GPTBot	Score 77 out of 100, grade B, partial assessment	1 blocked	Google Cloud / GFE
1252	google.co.jprefused GPTBot	Score 49 out of 100, grade D	all allowed	Google Cloud / GFE
1255	tori.fi	Score 68 out of 100, grade C	all allowed	Google Cloud / GFE
1272	livescore.com	Score 68 out of 100, grade C	all allowed	Contentful . Google Cloud / GFE
1288	labs.google	Score 64 out of 100, grade C	all allowed	Angular . Google Cloud / GFE
1319	grow.google	Score 74 out of 100, grade C	all allowed	Google Cloud / GFE
1369	tapad.com	Score 72 out of 100, grade C	all allowed	Google Cloud / GFE
1381	waze.com	Score 52 out of 100, grade D	all allowed	Google Cloud / GFE
1421	paramountplus.com	Score 60 out of 100, grade C	all allowed	Google Cloud / GFE
1466	klikbca.com	Score 55 out of 100, grade D	all allowed	Google Cloud / GFE
1490	google.co.inrefused GPTBot	Score 49 out of 100, grade D	all allowed	Google Cloud / GFE
1494	ioh.co.id	Score 45 out of 100, grade D	all allowed	Nuxt . Google Cloud / GFE
1555	google.nlrefused GPTBot	Score 49 out of 100, grade D	all allowed	Google Cloud / GFE
1648	flashscore.fr	Score 57 out of 100, grade D	1 blocked	Google Cloud / GFE
1786	google.rurefused GPTBot	Score 52 out of 100, grade D	all allowed	Google Cloud / GFE
1809	google.esrefused GPTBot	Score 52 out of 100, grade D	all allowed	Google Cloud / GFE
1828	pluto.tv	Score 70 out of 100, grade C	all allowed	Next.js . Google Cloud / GFE
1879	shopifycloud.com	Score 84 out of 100, grade B, partial assessment	all allowed	Google Cloud / GFE
1885	google.itrefused GPTBot	Score 52 out of 100, grade D	all allowed	Google Cloud / GFE
1938	google.co.idrefused GPTBot	Score 52 out of 100, grade D	all allowed	Google Cloud / GFE
2010	business.site	Score 63 out of 100, grade C	all allowed	Google Cloud / GFE
2060	evernote.com	Score 80 out of 100, grade B	all allowed	Next.js . Google Cloud / GFE
2084	blog.google	Score 64 out of 100, grade C	all allowed	Google Cloud / GFE
2152	semrush.com	Score 80 out of 100, grade B	all allowed	Google Cloud / GFE
2173	snapkit.com	Score 52 out of 100, grade D	all allowed	Google Cloud / GFE
2187	im-apps.net	Score 49 out of 100, grade D	all allowed	Google Cloud / GFE
2256	google.com.aurefused GPTBot	Score 52 out of 100, grade D	all allowed	Google Cloud / GFE
2266	axon.ai	Score 79 out of 100, grade B	all allowed	Next.js . Google Cloud / GFE
2268	googlesource.comrefused GPTBot	Score 57 out of 100, grade D	all allowed	Google Cloud / GFE
2287	windy.com	Score 50 out of 100, grade D	all allowed	Google Cloud / GFE
2321	ioam.de	Score 45 out of 100, grade D	all allowed	Google Cloud / GFE
2337	web.dev	Score 74 out of 100, grade C	all allowed	Google Cloud / GFE
2453	ztomy.com	Score 84 out of 100, grade B, partial assessment	all allowed	Google Cloud / GFE
2577	optimove.net	Score 52 out of 100, grade D	all allowed	Google Cloud / GFE
2632	auone.jp	Score 54 out of 100, grade D	all allowed	Next.js . Google Cloud / GFE
2674	google.usrefused GPTBot	Score 52 out of 100, grade D	all allowed	Google Cloud / GFE
2679	nest.com	Score 61 out of 100, grade C	all allowed	Google Cloud / GFE
2872	google.plrefused GPTBot	Score 49 out of 100, grade D	all allowed	Google Cloud / GFE
2877	flashscore.com.ng	Score 57 out of 100, grade D	1 blocked	Google Cloud / GFE
2883	web.app	Score 60 out of 100, grade C	all allowed	Google Cloud / GFE
2951	history.com	Score 55 out of 100, grade D	all allowed	Google Cloud / GFE
3004	assetsconfigcdn.orgrefused GPTBot	Score 78 out of 100, grade B, partial assessment	all allowed	Google Cloud / GFE
3016	ifconfig.me	Score 55 out of 100, grade D	all allowed	Google Cloud / GFE
3026	tenor.com	Score 66 out of 100, grade C	all allowed	Google Cloud / GFE
3158	google.atrefused GPTBot	Score 49 out of 100, grade D	all allowed	Google Cloud / GFE
3210	google.berefused GPTBot	Score 49 out of 100, grade D	all allowed	Google Cloud / GFE
3228	google.com.twrefused GPTBot	Score 52 out of 100, grade D	all allowed	Google Cloud / GFE
3237	google.chrefused GPTBot	Score 49 out of 100, grade D	all allowed	Google Cloud / GFE
3255	google.com.mxrefused GPTBot	Score 52 out of 100, grade D	all allowed	Google Cloud / GFE
3257	google.com.trrefused GPTBot	Score 52 out of 100, grade D	all allowed	Google Cloud / GFE
3289	go.dev	Score 60 out of 100, grade C	all allowed	Google Cloud / GFE
3321	google.com.uarefused GPTBot	Score 49 out of 100, grade D	all allowed	Google Cloud / GFE
3335	nianticlabs.com	Score 57 out of 100, grade D	all allowed	Google Cloud / GFE
3437	dns-finder.comrefused GPTBot	Score 78 out of 100, grade B, partial assessment	all allowed	Google Cloud / GFE
3445	google.serefused GPTBot	Score 49 out of 100, grade D	all allowed	Google Cloud / GFE
3501	google.co.ilrefused GPTBot	Score 49 out of 100, grade D	all allowed	Google Cloud / GFE
3542	google.co.threfused GPTBot	Score 52 out of 100, grade D	all allowed	Google Cloud / GFE
3570	timeout.com	Score 69 out of 100, grade C	all allowed	Google Cloud / GFE
3603	blogspot.co.ukrefused GPTBot	Score 49 out of 100, grade D	all allowed	Google Cloud / GFE
3638	google.com.arrefused GPTBot	Score 52 out of 100, grade D	all allowed	Google Cloud / GFE
3671	rtbwise.com	Score 54 out of 100, grade D	all allowed	Google Cloud / GFE
3707	clinicaltrials.gov	Score 56 out of 100, grade D	all allowed	Google Cloud / GFE
3712	google.co.zarefused GPTBot	Score 49 out of 100, grade D	all allowed	Google Cloud / GFE
3722	google.czrefused GPTBot	Score 52 out of 100, grade D	all allowed	Google Cloud / GFE
3723	bitly.com	Score 77 out of 100, grade B	all allowed	HubSpot CMS . Google Cloud / GFE
3730	google.com.sgrefused GPTBot	Score 49 out of 100, grade D	all allowed	Google Cloud / GFE
3766	google.com.vnrefused GPTBot	Score 49 out of 100, grade D	all allowed	Google Cloud / GFE
3768	virustotal.com	Score 48 out of 100, grade D	all allowed	Google Cloud / GFE
3791	google.co.krrefused GPTBot	Score 52 out of 100, grade D	all allowed	Google Cloud / GFE
3825	google.com.phrefused GPTBot	Score 49 out of 100, grade D	all allowed	Google Cloud / GFE
3836	elevenlabs.io	Score 91 out of 100, grade A	all allowed	Next.js . Google Cloud / GFE
3857	google.ptrefused GPTBot	Score 49 out of 100, grade D	all allowed	Google Cloud / GFE
3876	google.com.egrefused GPTBot	Score 49 out of 100, grade D	all allowed	Google Cloud / GFE
3887	clean.gg	Score 78 out of 100, grade B, partial assessment	all allowed	Google Cloud / GFE
3888	google.dkrefused GPTBot	Score 52 out of 100, grade D	all allowed	Google Cloud / GFE
3905	siteground.biz	Score 92 out of 100, grade A, partial assessment	all allowed	Google Cloud / GFE
3922	google.clrefused GPTBot	Score 52 out of 100, grade D	all allowed	Google Cloud / GFE
3923	pchome.com.tw	Score 68 out of 100, grade C	all allowed	Google Cloud / GFE
3936	ekatox.com	Score 49 out of 100, grade D	all allowed	Google Cloud / GFE
3950	google.com.corefused GPTBot	Score 52 out of 100, grade D	all allowed	Google Cloud / GFE
3962	google.firefused GPTBot	Score 52 out of 100, grade D	all allowed	Google Cloud / GFE
3974	google.norefused GPTBot	Score 49 out of 100, grade D	all allowed	Google Cloud / GFE
3991	google.co.nzrefused GPTBot	Score 52 out of 100, grade D	all allowed	Google Cloud / GFE
3999	google.ierefused GPTBot	Score 49 out of 100, grade D	all allowed	Google Cloud / GFE
4005	google.com.myrefused GPTBot	Score 49 out of 100, grade D	all allowed	Google Cloud / GFE
4052	google.grrefused GPTBot	Score 49 out of 100, grade D	all allowed	Google Cloud / GFE
4068	jpost.com	Score 71 out of 100, grade C	all allowed	Next.js . Google Cloud / GFE
4072	google.aerefused GPTBot	Score 52 out of 100, grade D	all allowed	Google Cloud / GFE
4092	google.com.perefused GPTBot	Score 49 out of 100, grade D	all allowed	Google Cloud / GFE
4094	mediagotechnology.com	Score 78 out of 100, grade B, partial assessment	all allowed	Google Cloud / GFE
4108	twingate.com	Score 84 out of 100, grade B	all allowed	Framer . Google Cloud / GFE
4143	google.com.pkrefused GPTBot	Score 52 out of 100, grade D	all allowed	Google Cloud / GFE
4158	db.com	Score 76 out of 100, grade B	all allowed	Google Cloud / GFE
4248	ollama.com	Score 69 out of 100, grade C	all allowed	Google Cloud / GFE
4256	google.com.sarefused GPTBot	Score 49 out of 100, grade D	all allowed	Google Cloud / GFE
4314	joinhoney.com	Score 58 out of 100, grade D	all allowed	Google Cloud / GFE
4344	google.com.bdrefused GPTBot	Score 52 out of 100, grade D	all allowed	Google Cloud / GFE
4352	pub.networkrefused GPTBot	Score 78 out of 100, grade B, partial assessment	all allowed	Google Cloud / GFE
4384	google.co.verefused GPTBot	Score 52 out of 100, grade D	all allowed	Google Cloud / GFE
4429	google.co.kerefused GPTBot	Score 49 out of 100, grade D	all allowed	Google Cloud / GFE
4482	google.com.ngrefused GPTBot	Score 52 out of 100, grade D	all allowed	Google Cloud / GFE
4486	rtbhouse.com	Score 86 out of 100, grade B	all allowed	Next.js . Google Cloud / GFE
4487	fitbit.com	Score 65 out of 100, grade C	all allowed	Google Cloud / GFE
4516	acorns.com	Score 62 out of 100, grade C	all allowed	Google Cloud / GFE
4528	mercadopago.comrefused GPTBot	Score 47 out of 100, grade D	all allowed	Google Cloud / GFE
4535	google.com.nprefused GPTBot	Score 49 out of 100, grade D	all allowed	Google Cloud / GFE
4577	kaggle.com	Score 51 out of 100, grade D	all allowed	Google Cloud / GFE
4616	google.dzrefused GPTBot	Score 49 out of 100, grade D	all allowed	Google Cloud / GFE
4617	google.com.jmrefused GPTBot	Score 49 out of 100, grade D	all allowed	Google Cloud / GFE
4622	justwatch.com	Score 58 out of 100, grade D	all allowed	Google Cloud / GFE
4631	google.skrefused GPTBot	Score 49 out of 100, grade D	all allowed	Google Cloud / GFE
4633	google.sirefused GPTBot	Score 49 out of 100, grade D	all allowed	Google Cloud / GFE
4649	google.com.ghrefused GPTBot	Score 49 out of 100, grade D	all allowed	Google Cloud / GFE
4684	google.com.pyrefused GPTBot	Score 49 out of 100, grade D	all allowed	Google Cloud / GFE
4718	google.co.zmrefused GPTBot	Score 49 out of 100, grade D	all allowed	Google Cloud / GFE
4731	google.tmrefused GPTBot	Score 49 out of 100, grade D	all allowed	Google Cloud / GFE
4749	google.snrefused GPTBot	Score 49 out of 100, grade D	all allowed	Google Cloud / GFE
4752	blogspot.derefused GPTBot	Score 49 out of 100, grade D	all allowed	Google Cloud / GFE
4768	google.gmrefused GPTBot	Score 49 out of 100, grade D	all allowed	Google Cloud / GFE
4780	google.com.narefused GPTBot	Score 52 out of 100, grade D	all allowed	Google Cloud / GFE
4796	statsig.com	Score 58 out of 100, grade D	all allowed	Contentful . Google Cloud / GFE
4860	google.mvrefused GPTBot	Score 52 out of 100, grade D	all allowed	Google Cloud / GFE
4861	google.mwrefused GPTBot	Score 49 out of 100, grade D	all allowed	Google Cloud / GFE
4885	google.com.uyrefused GPTBot	Score 49 out of 100, grade D	all allowed	Google Cloud / GFE
4892	google.com.pgrefused GPTBot	Score 52 out of 100, grade D	all allowed	Google Cloud / GFE
5021	joom.com	Score 54 out of 100, grade D	all allowed	Google Cloud / GFE
5033	google.imrefused GPTBot	Score 49 out of 100, grade D	all allowed	Google Cloud / GFE
5110	google.com.dorefused GPTBot	Score 52 out of 100, grade D	all allowed	Google Cloud / GFE

Using these figures

Free to reuse in research, journalism or a product under CC BY 4.0, with credit to Fidget Labs BV. Quote the measurement date so the claim stays checkable as the index moves.

CrawlIndex by Fidget Labs BV. "Agent readiness on Google Cloud / GFE." https://crawlindex.org (measured 2026-09-22). Licensed CC BY 4.0.