crawlindex

Search the index. A domain that is not here can still be measured live on the check page.

Score band . grade C

Sites scoring 60 to 69

751 of 2,613 fully measured sites land here, 28.7% of the index. Readable but undeclared. Typically no llms.txt, thin structured data, and a robots.txt that names no AI crawler.

150 operators

One row per operator, highest score first. Partial assessments are excluded, because a renormalised score belongs to a different scale and could not be placed in a band honestly.

Sites scoring 60 to 69
RankDomainScorePolicyStack
2442arizona.eduScore 69 out of 100, grade COpenInheritedDrupal . Fastly
4205au.comScore 69 out of 100, grade COpenInheritedAdobe Experience Manager . Fastly
2523audible.comScore 69 out of 100, grade COpenInheritedAmazon CloudFront
4472avs.ioScore 69 out of 100, grade COpenInheritedAmazon CloudFront
1822blackberry.com
and 1 more domain with the same policy
Score 69 out of 100, grade COpenInheritedStoryblok . Amazon CloudFront
3064bu.eduScore 69 out of 100, grade COpenDeliberateWordPress . Amazon CloudFront
1428carsensor.netScore 69 out of 100, grade COpenInheritedunidentified
2201census.govScore 69 out of 100, grade COpenInheritedAdobe Experience Manager . Cloudflare
4551certum.plScore 69 out of 100, grade COpenInheritedWordPress
3214comodoca.comScore 69 out of 100, grade COpenInheritedHubSpot CMS . Cloudflare
571conviva.comScore 69 out of 100, grade COpenDeliberateCloudflare
2906directnic.comScore 69 out of 100, grade COpenInheritedunidentified
366dotomi.comScore 69 out of 100, grade CUndeclaredAbsentNext.js . Amazon CloudFront
1179elconfidencial.comScore 69 out of 100, grade CUndeclaredAbsentImperva
4596foxsports.comScore 69 out of 100, grade COpenInheritedNuxt . Fastly
3002freshdesk.comScore 69 out of 100, grade COpenInheritedNext.js . Cloudflare
2126gallup.comScore 69 out of 100, grade COpenDeliberateAmazon CloudFront
2499guard.ioScore 69 out of 100, grade CUndeclaredAbsentCloudflare
1298ilfattoquotidiano.itScore 69 out of 100, grade COpenInheritedWordPress . Cloudflare
3133imagemagick.orgScore 69 out of 100, grade COpenInheritedFastly
1939ionos.deScore 69 out of 100, grade COpenInheritedAstro
2423laravel.comScore 69 out of 100, grade COpenInheritedCloudflare
4123next.co.ukScore 69 out of 100, grade CUndeclaredAbsentAkamai
5108oilprice.comScore 69 out of 100, grade CNo trainingDeliberateunidentified
913pornhub.com
and 1 more domain with the same policy
Score 69 out of 100, grade COpenDeliberateunidentified
4287raspberrypi.orgScore 69 out of 100, grade COpenInheritedContentful . Cloudflare
3032register.itScore 69 out of 100, grade COpenInheritedWordPress
2034sapo.ptScore 69 out of 100, grade CUndeclaredAbsentunidentified
1791sattamatka.emailScore 69 out of 100, grade CNo trainingDeliberateCloudflare
1603ss.comScore 69 out of 100, grade COpenInheritedunidentified
3896straitstimes.comScore 69 out of 100, grade CNo trainingDeliberateAmazon CloudFront
1512testbook.comScore 69 out of 100, grade COpenInheritedCloudflare
3575timeout.comScore 69 out of 100, grade COpenInheritedGoogle Cloud / GFE
4271trulia.compolicy gapScore 69 out of 100, grade COpenInheritedNext.js . Amazon CloudFront
1485typing.comScore 69 out of 100, grade COpenInheritedCloudflare
783viber.comScore 69 out of 100, grade COpenInheritedWordPress . Akamai
372weebly.comScore 69 out of 100, grade COpenInheritedCloudflare
4727yesstyle.compolicy gapScore 69 out of 100, grade COpenInheritedNext.js . Cloudflare
1343youjizz.comScore 69 out of 100, grade COpenInheritedunidentified
747zoho.compolicy gap
and 1 more domain with the same policy
Score 69 out of 100, grade COpenInheritedCloudflare
3146abril.com.brpolicy gapScore 68 out of 100, grade COpenInheritedWordPress
3461adscale.deScore 68 out of 100, grade CUndeclaredAbsentTYPO3 . Cloudflare
792agora.ioScore 68 out of 100, grade COpenInheritedHubSpot CMS . Cloudflare
3917aljazeera.net
and 1 more domain with the same policy
Score 68 out of 100, grade CSelectiveDeliberateWordPress
2744atom.compolicy gapScore 68 out of 100, grade COpenDeliberateCloudflare
2017bfvideo.siteScore 68 out of 100, grade COpenInheritedWordPress . Cloudflare
1752bhojpurisex.siteScore 68 out of 100, grade COpenInheritedWordPress . Cloudflare
3258cbssports.comScore 68 out of 100, grade CNo trainingDeliberateNext.js
2057connatix.comScore 68 out of 100, grade COpenInheritedHubSpot CMS . Cloudflare
3387copper6.comScore 68 out of 100, grade COpenInheritedCloudflare
2675csdn.netScore 68 out of 100, grade COpenInheritedunidentified
1213dlsite.comScore 68 out of 100, grade COpenInheritedCloudflare
2194engadget.comScore 68 out of 100, grade COpenInheritedWordPress . Amazon CloudFront
1793freenet.deScore 68 out of 100, grade COpenInheritedContentful . Cloudflare
1467gamewith.jpScore 68 out of 100, grade COpenInheritedAmazon CloudFront
3614gitbook.ioScore 68 out of 100, grade CUndeclaredAbsentHubSpot CMS . Cloudflare
3615honeywell.comScore 68 out of 100, grade COpenInheritedAdobe Experience Manager . Akamai
4661hoster.kzScore 68 out of 100, grade COpenInheritedunidentified
4283hyundai.comScore 68 out of 100, grade COpenDeliberateAdobe Experience Manager . Cloudflare
742independent.co.ukScore 68 out of 100, grade COpenInheritedFastly
1182inven.co.krScore 68 out of 100, grade COpenInheritedunidentified
2911ipapi.coScore 68 out of 100, grade COpenInheritedCloudflare
2440istockphoto.comScore 68 out of 100, grade COpenInheritedAmazon CloudFront
2292jwplayer.comScore 68 out of 100, grade COpenInheritedHubSpot CMS . Cloudflare
4722kolkataff.tvScore 68 out of 100, grade COpenInheritedCloudflare
3239lenta.ruScore 68 out of 100, grade COpenInheritedunidentified
4812liquidweb.comScore 68 out of 100, grade COpenDeliberateCloudflare
1272livescore.comScore 68 out of 100, grade COpenDeliberateContentful . Google Cloud / GFE
3823pchome.com.twScore 68 out of 100, grade COpenInheritedGoogle Cloud / GFE
3537piano.ioScore 68 out of 100, grade COpenInheritedFramer . Cloudflare
3623qualcomm.comScore 68 out of 100, grade COpenInheritedAdobe Experience Manager . Cloudflare
4055rapidssl.comScore 68 out of 100, grade COpenInheritedAdobe Experience Manager . Fastly
4136rfa.orgScore 68 out of 100, grade COpenInheritedAkamai
2779robinhood.comScore 68 out of 100, grade COpenInheritedContentful . Amazon CloudFront
4748sephora.comScore 68 out of 100, grade CUndeclaredAbsentAkamai
3847skysports.comScore 68 out of 100, grade CNo trainingDeliberateAkamai
1435sozcu.com.trScore 68 out of 100, grade COpenInheritedCloudflare
1392sportybet.comScore 68 out of 100, grade COpenInheritedAmazon CloudFront
4150standard.co.ukScore 68 out of 100, grade COpenInheritedCloudflare
4979streamlabs.comScore 68 out of 100, grade COpenInheritedCloudflare
4194thestar.com.myScore 68 out of 100, grade COpenDeliberateAmazon CloudFront
4821trafficjunky.netScore 68 out of 100, grade CUndeclaredAbsentunidentified
843usps.comScore 68 out of 100, grade COpenInheritedAkamai
4008voximplant.comScore 68 out of 100, grade COpenDeliberateNuxt
5040withbuddies.comScore 68 out of 100, grade CUndeclaredAbsentNext.js . Vercel
1150wordwall.netScore 68 out of 100, grade COpenInheritedAzure Front Door
1709xvideosbr.blogScore 68 out of 100, grade COpenInheritedWordPress . Cloudflare
4143zeta-ai.ioScore 68 out of 100, grade COpenInheritedNext.js . Vercel
5060aap.orgScore 67 out of 100, grade COpenInheritedCloudflare
3702abebooks.comScore 67 out of 100, grade COpenInheritedAmazon CloudFront
4468aboutamazon.comScore 67 out of 100, grade COpenInheritedNext.js . Amazon CloudFront
1812acs.orgScore 67 out of 100, grade COpenInheritedAdobe Experience Manager . Fastly
1097adblockplus.orgScore 67 out of 100, grade CUndeclaredAbsentWordPress . Fastly
3695aepd.esScore 67 out of 100, grade COpenInheritedDrupal
2188amazonaws.com.cnScore 67 out of 100, grade COpenInheritedunidentified
813ameblo.jpScore 67 out of 100, grade COpenInheritedNext.js
133android.comScore 67 out of 100, grade COpenDeliberateunidentified
4066arin.netScore 67 out of 100, grade COpenInheritedunidentified
3434asos.comScore 67 out of 100, grade CUndeclaredAbsentSitecore . Akamai
3183aws.comScore 67 out of 100, grade COpenInheritedAmazon CloudFront
4264banahosting.compolicy gapScore 67 out of 100, grade COpenInheritedCloudflare
4911boeing.comScore 67 out of 100, grade COpenInheritedAdobe Experience Manager . Amazon CloudFront
1554caliente.mxpolicy gapScore 67 out of 100, grade COpenInheritedWordPress . Cloudflare
5044cbslocal.comScore 67 out of 100, grade CUndeclaredAbsentVarnish
4819charlestonroadregistry.comScore 67 out of 100, grade CUndeclaredAbsentunidentified
3522coca-cola.comScore 67 out of 100, grade COpenInheritedAdobe Experience Manager . Amazon CloudFront
4486detik.comScore 67 out of 100, grade CUndeclaredAbsentunidentified
1955digilocker.gov.inScore 67 out of 100, grade CUndeclaredAbsentAmazon CloudFront
1706digitallocker.gov.inScore 67 out of 100, grade CUndeclaredAbsentAmazon CloudFront
51doubleclick.netScore 67 out of 100, grade COpenDeliberateunidentified
2641dropboxapi.comScore 67 out of 100, grade CUndeclaredAbsentunidentified
1792eepurl.comScore 67 out of 100, grade CUndeclaredAbsentAdobe Experience Manager . Akamai
370elasticbeanstalk.comScore 67 out of 100, grade COpenInheritedAmazon CloudFront
4132fitbit.comScore 67 out of 100, grade COpenInheritedGoogle Cloud / GFE
1672fortinet.netScore 67 out of 100, grade CUndeclaredAbsentAdobe Experience Manager . Amazon CloudFront
660free.frScore 67 out of 100, grade COpenInheritedNext.js
3374geeksforgeeks.orgScore 67 out of 100, grade COpenDeliberateWordPress . Amazon CloudFront
4288ghost.orgScore 67 out of 100, grade COpenInheritedNetlify
4004hbo.comScore 67 out of 100, grade COpenInheritedNext.js . Fastly
617hotjar.comScore 67 out of 100, grade COpenInheritedContentful . Vercel
3643hudl.comScore 67 out of 100, grade COpenInheritedunidentified
1032huggingface.coScore 67 out of 100, grade COpenInheritedAmazon CloudFront
3571iqm.comScore 67 out of 100, grade COpenInheritedWordPress
3869ispconfig.orgScore 67 out of 100, grade COpenInheritedCloudflare
958jetbrains.comScore 67 out of 100, grade COpenInheritedAmazon CloudFront
1427jutarnji.hrpolicy gapScore 67 out of 100, grade COpenInheritedJoomla . Cloudflare
3796lnk.toScore 67 out of 100, grade COpenInheritedHubSpot CMS . Cloudflare
4383mac.comScore 67 out of 100, grade CUndeclaredAbsentNext.js
4856marksandspencer.comScore 67 out of 100, grade COpenInheritedContentful . Akamai
5061maxpreps.comScore 67 out of 100, grade COpenInheritedNext.js
1560mechacomic.jpScore 67 out of 100, grade COpenInheritedunidentified
3529mimecast.comScore 67 out of 100, grade CUndeclaredAbsentNext.js . Vercel
2895minecraft.netScore 67 out of 100, grade CUndeclaredAbsentAdobe Experience Manager . Akamai
2973mojang.comScore 67 out of 100, grade CUndeclaredAbsentAdobe Experience Manager . Akamai
2286mpg.deScore 67 out of 100, grade COpenInheritedunidentified
1861nhs.ukScore 67 out of 100, grade COpenInheritedAzure Front Door
4620nikomu.comScore 67 out of 100, grade COpenInheritedunidentified
236nist.govScore 67 out of 100, grade COpenInheritedDrupal . Cloudflare
3071nokia.comScore 67 out of 100, grade CUndeclaredAbsentDrupal . Fastly
1360novinky.czScore 67 out of 100, grade COpenInheritedunidentified
4658nsf.govScore 67 out of 100, grade COpenInheritedDrupal . Amazon CloudFront
966odoo.comScore 67 out of 100, grade COpenInheritedunidentified
4725orange.comScore 67 out of 100, grade CUndeclaredAbsentDrupal . Google Cloud / GFE
3560paysafecard.comScore 67 out of 100, grade COpenInheritedTYPO3 . Amazon CloudFront
1616piccoma.comScore 67 out of 100, grade COpenInheritedunidentified
925pikabu.ruScore 67 out of 100, grade COpenInheritedunidentified
5080pixels.comScore 67 out of 100, grade COpenInheritedunidentified
893poki.comScore 67 out of 100, grade COpenInheritedCloudflare
1175postgresql.orgScore 67 out of 100, grade COpenInheritedVarnish
3127principal.comScore 67 out of 100, grade COpenInheritedDrupal . Fastly

Showing the first 150 operators. The full list is in the dataset.

crawl 2026-11-22 10:38 UTCprobe 3.0.0rubric 2.0.0registry 1.0.0vantage gha-ubuntu3,656 of 5,006 reachable

Using these figures

Free to reuse in research, journalism or a product under CC BY 4.0, with credit to Fidget Labs BV. Quote the measurement date so the claim stays checkable as the index moves.

CrawlIndex by Fidget Labs BV. "Sites scoring 60 to 69 for AI readiness." https://crawlindex.org (measured 2026-11-22). Licensed CC BY 4.0.