Edge network

Google Cloud / GFE

Name: CrawlIndex dataset
License: https://creativecommons.org/licenses/by/4.0/

153 measured sites. 5 of them, 3.3%, block at least one answer-surface AI crawler. Mean readiness score 57.8.

Compare against every other edge network

Sites on Google Cloud / GFE
Rank	Domain	Score	Answer-surface crawlers	Stack
1	google.comrefused GPTBot	Score 50 out of 100, grade D	all allowed	Google Cloud / GFE
8	youtube.com	Score 57 out of 100, grade D	all allowed	Google Cloud / GFE
119	snapchat.com	Score 35 out of 100, grade F	5 blocked	Next.js . Google Cloud / GFE
164	applovin.com	Score 80 out of 100, grade B	all allowed	Next.js . Google Cloud / GFE
217	gmail.com	Score 67 out of 100, grade C	all allowed	Google Cloud / GFE
290	inmobi.com	Score 64 out of 100, grade C	all allowed	Next.js . Google Cloud / GFE
333	crashlytics.com	Score 63 out of 100, grade C	all allowed	Google Cloud / GFE
448	g.page	Score 67 out of 100, grade C	all allowed	Google Cloud / GFE
468	featureassets.orgrefused GPTBot	Score 83 out of 100, grade B, partial assessment	all allowed	Google Cloud / GFE
506	google.derefused GPTBot	Score 50 out of 100, grade D	all allowed	Google Cloud / GFE
513	google.com.hkrefused GPTBot	Score 54 out of 100, grade D	all allowed	Google Cloud / GFE
547	ipinfo.io	Score 79 out of 100, grade B	all allowed	Next.js . Google Cloud / GFE
615	jotform.com	Score 79 out of 100, grade B	all allowed	Google Cloud / GFE
647	withgoogle.comrefused GPTBot	Score 42 out of 100, grade D	all allowed	Google Cloud / GFE
699	google.co.ukrefused GPTBot	Score 50 out of 100, grade D	all allowed	Google Cloud / GFE
735	google.com.brrefused GPTBot	Score 50 out of 100, grade D	all allowed	Google Cloud / GFE
814	appspot.com	Score 59 out of 100, grade D	all allowed	Google Cloud / GFE
1014	app-ads-services.comrefused GPTBot	Score 50 out of 100, grade D	all allowed	Google Cloud / GFE
1017	paramountplus.com	Score 62 out of 100, grade C	all allowed	Google Cloud / GFE
1056	flashscore.com	Score 60 out of 100, grade C	1 blocked	Google Cloud / GFE
1061	google.carefused GPTBot	Score 50 out of 100, grade D	all allowed	Google Cloud / GFE
1077	google.co.jprefused GPTBot	Score 50 out of 100, grade D	all allowed	Google Cloud / GFE
1094	google.frrefused GPTBot	Score 50 out of 100, grade D	all allowed	Google Cloud / GFE
1156	finn.no	Score 72 out of 100, grade C	all allowed	Contentful . Google Cloud / GFE
1197	waze.com	Score 53 out of 100, grade D	all allowed	Google Cloud / GFE
1200	indiamart.comrefused GPTBot	Score 82 out of 100, grade B, partial assessment	1 blocked	Google Cloud / GFE
1276	labs.google	Score 67 out of 100, grade C	all allowed	Angular . Google Cloud / GFE
1286	livescore.com	Score 71 out of 100, grade C	all allowed	Contentful . Google Cloud / GFE
1302	google.itrefused GPTBot	Score 50 out of 100, grade D	all allowed	Google Cloud / GFE
1330	google.co.inrefused GPTBot	Score 54 out of 100, grade D	all allowed	Google Cloud / GFE
1340	tapad.com	Score 71 out of 100, grade C	all allowed	Google Cloud / GFE
1441	spiegel.derefused GPTBot	Score 41 out of 100, grade D	6 blocked	Google Cloud / GFE
1486	klikbca.com	Score 56 out of 100, grade D	all allowed	Google Cloud / GFE
1499	ioh.co.id	Score 45 out of 100, grade D	all allowed	Nuxt . Google Cloud / GFE
1664	flashscore.fr	Score 60 out of 100, grade C	1 blocked	Google Cloud / GFE
1743	google.rurefused GPTBot	Score 50 out of 100, grade D	all allowed	Google Cloud / GFE
1790	google.esrefused GPTBot	Score 50 out of 100, grade D	all allowed	Google Cloud / GFE
1794	google.nlrefused GPTBot	Score 50 out of 100, grade D	all allowed	Google Cloud / GFE
1959	google.com.aurefused GPTBot	Score 50 out of 100, grade D	all allowed	Google Cloud / GFE
2049	business.site	Score 67 out of 100, grade C	all allowed	Google Cloud / GFE
2083	snapkit.com	Score 53 out of 100, grade D	all allowed	Google Cloud / GFE
2104	evernote.com	Score 87 out of 100, grade B	all allowed	Next.js . Google Cloud / GFE
2160	shopifycloud.com	Score 61 out of 100, grade C	all allowed	Google Cloud / GFE
2206	blog.google	Score 68 out of 100, grade C	all allowed	Google Cloud / GFE
2213	google.co.idrefused GPTBot	Score 54 out of 100, grade D	all allowed	Google Cloud / GFE
2257	semrush.com	Score 87 out of 100, grade B	all allowed	Google Cloud / GFE
2264	im-apps.net	Score 49 out of 100, grade D	all allowed	Google Cloud / GFE
2300	axon.ai	Score 80 out of 100, grade B	all allowed	Next.js . Google Cloud / GFE
2405	windy.com	Score 45 out of 100, grade D	all allowed	Google Cloud / GFE
2412	web.dev	Score 80 out of 100, grade B	all allowed	Google Cloud / GFE
2456	ioam.de	Score 45 out of 100, grade D	all allowed	Google Cloud / GFE
2515	google.com.trrefused GPTBot	Score 50 out of 100, grade D	all allowed	Google Cloud / GFE
2579	tenor.com	Score 64 out of 100, grade C	all allowed	Google Cloud / GFE
2615	google.plrefused GPTBot	Score 50 out of 100, grade D	all allowed	Google Cloud / GFE
2617	nest.com	Score 75 out of 100, grade B	all allowed	Google Cloud / GFE
2670	google.usrefused GPTBot	Score 50 out of 100, grade D	all allowed	Google Cloud / GFE
2765	ztomy.com	Score 48 out of 100, grade D	all allowed	Google Cloud / GFE
2942	web.app	Score 63 out of 100, grade C	all allowed	Google Cloud / GFE
2971	ifconfig.me	Score 56 out of 100, grade D	all allowed	Google Cloud / GFE
2976	google.com.sgrefused GPTBot	Score 50 out of 100, grade D	all allowed	Google Cloud / GFE
2997	assetsconfigcdn.orgrefused GPTBot	Score 83 out of 100, grade B, partial assessment	all allowed	Google Cloud / GFE
3040	googlesource.comrefused GPTBot	Score 61 out of 100, grade C	all allowed	Google Cloud / GFE
3065	google.atrefused GPTBot	Score 50 out of 100, grade D	all allowed	Google Cloud / GFE
3124	google.berefused GPTBot	Score 50 out of 100, grade D	all allowed	Google Cloud / GFE
3133	google.chrefused GPTBot	Score 50 out of 100, grade D	all allowed	Google Cloud / GFE
3147	google.com.mxrefused GPTBot	Score 50 out of 100, grade D	all allowed	Google Cloud / GFE
3194	google.com.twrefused GPTBot	Score 50 out of 100, grade D	all allowed	Google Cloud / GFE
3256	google.com.uarefused GPTBot	Score 50 out of 100, grade D	all allowed	Google Cloud / GFE
3257	nianticlabs.com	Score 59 out of 100, grade D	all allowed	Google Cloud / GFE
3267	rtbhouse.com	Score 95 out of 100, grade A	all allowed	Next.js . Google Cloud / GFE
3291	pub.networkrefused GPTBot	Score 83 out of 100, grade B, partial assessment	all allowed	Google Cloud / GFE
3292	google.serefused GPTBot	Score 50 out of 100, grade D	all allowed	Google Cloud / GFE
3316	virustotal.com	Score 48 out of 100, grade D	all allowed	Google Cloud / GFE
3327	dns-finder.comrefused GPTBot	Score 83 out of 100, grade B, partial assessment	all allowed	Google Cloud / GFE
3350	google.co.threfused GPTBot	Score 50 out of 100, grade D	all allowed	Google Cloud / GFE
3368	google.co.ilrefused GPTBot	Score 50 out of 100, grade D	all allowed	Google Cloud / GFE
3395	blogspot.co.ukrefused GPTBot	Score 50 out of 100, grade D	all allowed	Google Cloud / GFE
3408	go.dev	Score 62 out of 100, grade C	all allowed	Google Cloud / GFE
3417	jio.com	Score 87 out of 100, grade B	all allowed	Adobe Experience Manager . Google Cloud / GFE
3484	google.com.arrefused GPTBot	Score 50 out of 100, grade D	all allowed	Google Cloud / GFE
3496	bitly.com	Score 80 out of 100, grade B	all allowed	HubSpot CMS . Google Cloud / GFE
3506	google.grrefused GPTBot	Score 50 out of 100, grade D	all allowed	Google Cloud / GFE
3547	google.czrefused GPTBot	Score 50 out of 100, grade D	all allowed	Google Cloud / GFE
3552	google.co.zarefused GPTBot	Score 54 out of 100, grade D	all allowed	Google Cloud / GFE
3586	google.com.vnrefused GPTBot	Score 50 out of 100, grade D	all allowed	Google Cloud / GFE
3617	timeout.com	Score 68 out of 100, grade C	all allowed	Google Cloud / GFE
3632	clinicaltrials.gov	Score 57 out of 100, grade D	all allowed	Google Cloud / GFE
3639	google.com.phrefused GPTBot	Score 50 out of 100, grade D	all allowed	Google Cloud / GFE
3647	google.co.krrefused GPTBot	Score 50 out of 100, grade D	all allowed	Google Cloud / GFE
3668	rtbwise.com	Score 56 out of 100, grade D	all allowed	Google Cloud / GFE
3669	google.ptrefused GPTBot	Score 50 out of 100, grade D	all allowed	Google Cloud / GFE
3708	siteground.bizrefused GPTBot	Score 100 out of 100, grade A, partial assessment	all allowed	Google Cloud / GFE
3731	ekatox.com	Score 49 out of 100, grade D	all allowed	Google Cloud / GFE
3754	google.clrefused GPTBot	Score 50 out of 100, grade D	all allowed	Google Cloud / GFE
3762	google.com.myrefused GPTBot	Score 50 out of 100, grade D	all allowed	Google Cloud / GFE
3771	google.dkrefused GPTBot	Score 50 out of 100, grade D	all allowed	Google Cloud / GFE
3775	google.com.corefused GPTBot	Score 54 out of 100, grade D	all allowed	Google Cloud / GFE
3807	clean.gg	Score 45 out of 100, grade D	all allowed	Google Cloud / GFE
3852	google.com.perefused GPTBot	Score 54 out of 100, grade D	all allowed	Google Cloud / GFE
3865	google.norefused GPTBot	Score 50 out of 100, grade D	all allowed	Google Cloud / GFE
3867	google.firefused GPTBot	Score 50 out of 100, grade D	all allowed	Google Cloud / GFE
3884	google.co.nzrefused GPTBot	Score 50 out of 100, grade D	all allowed	Google Cloud / GFE
3890	elevenlabs.io	Score 91 out of 100, grade A	all allowed	Next.js . Google Cloud / GFE
3921	pchome.com.tw	Score 68 out of 100, grade C	all allowed	Google Cloud / GFE
3928	google.bgrefused GPTBot	Score 50 out of 100, grade D	all allowed	Google Cloud / GFE
4002	google.com.pkrefused GPTBot	Score 50 out of 100, grade D	all allowed	Google Cloud / GFE
4015	db.com	Score 75 out of 100, grade B	all allowed	Google Cloud / GFE
4020	google.aerefused GPTBot	Score 50 out of 100, grade D	all allowed	Google Cloud / GFE
4099	tori.fi	Score 72 out of 100, grade C	all allowed	Google Cloud / GFE
4108	google.rorefused GPTBot	Score 50 out of 100, grade D	all allowed	Google Cloud / GFE
4135	google.com.sarefused GPTBot	Score 50 out of 100, grade D	all allowed	Google Cloud / GFE
4137	google.co.verefused GPTBot	Score 54 out of 100, grade D	all allowed	Google Cloud / GFE
4145	google.co.kerefused GPTBot	Score 50 out of 100, grade D	all allowed	Google Cloud / GFE
4156	google.com.bdrefused GPTBot	Score 50 out of 100, grade D	all allowed	Google Cloud / GFE
4192	google.com.egrefused GPTBot	Score 50 out of 100, grade D	all allowed	Google Cloud / GFE
4263	joinhoney.com	Score 59 out of 100, grade D	all allowed	Google Cloud / GFE
4264	google.com.uyrefused GPTBot	Score 54 out of 100, grade D	all allowed	Google Cloud / GFE
4265	google.skrefused GPTBot	Score 50 out of 100, grade D	all allowed	Google Cloud / GFE
4304	google.com.dorefused GPTBot	Score 50 out of 100, grade D	all allowed	Google Cloud / GFE
4331	statsigapi.netrefused GPTBot	Score 83 out of 100, grade B, partial assessment	all allowed	Google Cloud / GFE
4348	google.com.ngrefused GPTBot	Score 50 out of 100, grade D	all allowed	Google Cloud / GFE
4392	ollama.com	Score 75 out of 100, grade B	all allowed	Google Cloud / GFE
4403	google.co.aorefused GPTBot	Score 50 out of 100, grade D	all allowed	Google Cloud / GFE
4405	google.com.ecrefused GPTBot	Score 50 out of 100, grade D	all allowed	Google Cloud / GFE
4406	fitbit.com	Score 70 out of 100, grade C	all allowed	Google Cloud / GFE
4424	google.com.omrefused GPTBot	Score 50 out of 100, grade D	all allowed	Google Cloud / GFE
4426	google.com.nprefused GPTBot	Score 50 out of 100, grade D	all allowed	Google Cloud / GFE
4429	google.bsrefused GPTBot	Score 50 out of 100, grade D	all allowed	Google Cloud / GFE
4445	google.co.marefused GPTBot	Score 50 out of 100, grade D	all allowed	Google Cloud / GFE
4446	google.iqrefused GPTBot	Score 50 out of 100, grade D	all allowed	Google Cloud / GFE
4451	ipecho.net	Score 52 out of 100, grade D	all allowed	Google Cloud / GFE
4454	google.com.gtrefused GPTBot	Score 50 out of 100, grade D	all allowed	Google Cloud / GFE
4455	google.com.jmrefused GPTBot	Score 50 out of 100, grade D	all allowed	Google Cloud / GFE
4529	google.com.pyrefused GPTBot	Score 50 out of 100, grade D	all allowed	Google Cloud / GFE
4558	google.hurefused GPTBot	Score 50 out of 100, grade D	all allowed	Google Cloud / GFE
4578	acorns.com	Score 64 out of 100, grade C	all allowed	Google Cloud / GFE
4583	kaggle.com	Score 53 out of 100, grade D	all allowed	Google Cloud / GFE
4603	google.gmrefused GPTBot	Score 50 out of 100, grade D	all allowed	Google Cloud / GFE
4613	justwatch.com	Score 59 out of 100, grade D	all allowed	Google Cloud / GFE
4614	google.psrefused GPTBot	Score 50 out of 100, grade D	all allowed	Google Cloud / GFE
4641	google.snrefused GPTBot	Score 50 out of 100, grade D	all allowed	Google Cloud / GFE
4659	google.co.zmrefused GPTBot	Score 50 out of 100, grade D	all allowed	Google Cloud / GFE
4665	google.com.nirefused GPTBot	Score 50 out of 100, grade D	all allowed	Google Cloud / GFE
4673	blogspot.derefused GPTBot	Score 54 out of 100, grade D	all allowed	Google Cloud / GFE
4722	twingate.com	Score 89 out of 100, grade B	all allowed	Framer . Google Cloud / GFE
4794	google.com.pgrefused GPTBot	Score 50 out of 100, grade D	all allowed	Google Cloud / GFE
4810	google.cgrefused GPTBot	Score 50 out of 100, grade D	all allowed	Google Cloud / GFE
4890	google.jorefused GPTBot	Score 50 out of 100, grade D	all allowed	Google Cloud / GFE
4928	orange.com	Score 68 out of 100, grade C	all allowed	Drupal . Google Cloud / GFE
4981	google.com.qarefused GPTBot	Score 54 out of 100, grade D	all allowed	Google Cloud / GFE
5007	google.rsrefused GPTBot	Score 50 out of 100, grade D	all allowed	Google Cloud / GFE
5031	google.com.airefused GPTBot	Score 50 out of 100, grade D	all allowed	Google Cloud / GFE
5080	kijiji.carefused GPTBot	Score 67 out of 100, grade C	all allowed	Next.js . Google Cloud / GFE

Using these figures

Free to reuse in research, journalism or a product under CC BY 4.0, with credit to Fidget Labs BV. Quote the measurement date so the claim stays checkable as the index moves.

CrawlIndex by Fidget Labs BV. "Agent readiness on Google Cloud / GFE." https://crawlindex.org (measured 2026-08-09). Licensed CC BY 4.0.