crawlindex

Search the index. A domain that is not here can still be measured live on the check page.

Score band . grades C and B

Sites scoring 70 to 79

477 of 2,613 fully measured sites land here, 18.3% of the index. Readable but undeclared. Typically no llms.txt, thin structured data, and a robots.txt that names no AI crawler.

150 operators

One row per operator, highest score first. Partial assessments are excluded, because a renormalised score belongs to a different scale and could not be placed in a band honestly.

Sites scoring 70 to 79
RankDomainScorePolicyStack
4712allnewyonoapps.comScore 79 out of 100, grade BOpenInheritedCloudflare
245applovin.comScore 79 out of 100, grade BOpenInheritedNext.js . Google Cloud / GFE
2394axon.aiScore 79 out of 100, grade BOpenInheritedNext.js . Google Cloud / GFE
4959baomoi.comScore 79 out of 100, grade BOpenInheritedNext.js
1155clarin.comScore 79 out of 100, grade BOpenInheritedNext.js . Cloudflare
4615dynadot.comScore 79 out of 100, grade BOpenInheritedCloudflare
3433expressvpn.comScore 79 out of 100, grade BOpenInheritedAmazon CloudFront
2776here.compolicy gapScore 79 out of 100, grade BOpenInheritedNext.js . Amazon CloudFront
4491immersivelabs.comScore 79 out of 100, grade BOpenInheritedCloudflare
1409iscorp.comScore 79 out of 100, grade BOpenInheritedWordPress . Cloudflare
3865macrumors.comScore 79 out of 100, grade BOpenInheritedCloudflare
3264moz.comScore 79 out of 100, grade BOpenDeliberateCloudflare
1431otomoto.plScore 79 out of 100, grade BOpenInheritedNext.js . Amazon CloudFront
418plesk.comScore 79 out of 100, grade BOpenInheritedWordPress . Cloudflare
2730proton.meScore 79 out of 100, grade BOpenInheritedAstro
1096rackspace.comScore 79 out of 100, grade BOpenInheritedHubSpot CMS . Akamai
1562snaptik.appScore 79 out of 100, grade BOpenInheritedCloudflare
2280unity.comScore 79 out of 100, grade BOpenDeliberateSanity
206unity3d.comScore 79 out of 100, grade BOpenDeliberateSanity
1448xxxbp.tvScore 79 out of 100, grade BOpenInheritedBunny
3926a-ads.comScore 78 out of 100, grade BOpenInheritedNext.js . Cloudflare
3559arduino.ccScore 78 out of 100, grade BOpenInheritedWordPress . Cloudflare
381atlassian.netScore 78 out of 100, grade BOpenInheritedAmazon CloudFront
2349beget.com
and 1 more domain with the same policy
Score 78 out of 100, grade BOpenInheritedNuxt
2135bitbucket.orgScore 78 out of 100, grade BOpenInheritedunidentified
3118cloudflarestatus.comScore 78 out of 100, grade BOpenInheritedGoogle Cloud / GFE
4807easybell.deScore 78 out of 100, grade BOpenInheritedTYPO3 . Varnish
4710eufylife.comScore 78 out of 100, grade BOpenInheritedShopify . Netlify
2937gumroad.comScore 78 out of 100, grade BOpenInheritedCloudflare
2449hihonor.comScore 78 out of 100, grade BOpenInheritedAdobe Experience Manager
3366honor.comScore 78 out of 100, grade BOpenInheritedAdobe Experience Manager
3870jivox.comScore 78 out of 100, grade BOpenInheritedWordPress . Cloudflare
4433kia.comScore 78 out of 100, grade BOpenInheritedAdobe Experience Manager . Cloudflare
4029nazwa.plScore 78 out of 100, grade BOpenInheritedTYPO3
4579preply.comScore 78 out of 100, grade BOpenDeliberateNext.js . Cloudflare
3606replit.comScore 78 out of 100, grade BOpenInheritedNext.js . Cloudflare
3238sprinklr.comScore 78 out of 100, grade BOpenInheritedContentful . Amazon CloudFront
970twilio.comScore 78 out of 100, grade BOpenInheritedAdobe Experience Manager . Fastly
4817wolfram.comScore 78 out of 100, grade BOpenDeliberateunidentified
3516360totalsecurity.comScore 77 out of 100, grade BOpenInheritedNext.js
41573ds.comScore 77 out of 100, grade BOpenDeliberateAkamai
2598accenture.comScore 77 out of 100, grade BOpenInheritedAdobe Experience Manager . Fastly
3891afrinic.netScore 77 out of 100, grade BOpenInheritedunidentified
4454apkvision.orgScore 77 out of 100, grade BOpenInheritedWordPress . Cloudflare
12apple.comScore 77 out of 100, grade BOpenDeliberateunidentified
1342asurascans.comScore 77 out of 100, grade BOpenInheritedAstro . Cloudflare
2281automattic.comScore 77 out of 100, grade BOpenInheritedWordPress
1738az24.vnScore 77 out of 100, grade BOpenInheritedCloudflare
3141backblaze.comScore 77 out of 100, grade BOpenDeliberateHubSpot CMS . Cloudflare
2210bazaarvoice.comScore 77 out of 100, grade BOpenInheritedNext.js . Vercel
4872bentley.comScore 77 out of 100, grade BOpenInheritedCloudflare
1890blic.rsScore 77 out of 100, grade BOpenInheritedWordPress . Amazon CloudFront
2745capitalone.comScore 77 out of 100, grade BOpenInheritedAmazon CloudFront
4734changeip.comScore 77 out of 100, grade BOpenInheritedunidentified
2058claude.comScore 77 out of 100, grade BOpenInheritedNext.js . Cloudflare
2874clickup.comScore 77 out of 100, grade BOpenInheritedContentful . Amazon CloudFront
1250cnnbrasil.com.brScore 77 out of 100, grade BOpenInheritedWordPress
4460colostate.eduScore 77 out of 100, grade BOpenInheritedWordPress . Cloudflare
2429cpanel.com
and 1 more domain with the same policy
Score 77 out of 100, grade BOpenInheritedWordPress . Cloudflare
2891cvent.comScore 77 out of 100, grade BOpenInheritedDrupal . Amazon CloudFront
710deepl.comScore 77 out of 100, grade BOpenInheritedContentful . Cloudflare
182discord.com
and 1 more domain with the same policy
Score 77 out of 100, grade BOpenInheritedWebflow . Cloudflare
809discordapp.comScore 77 out of 100, grade BOpenInheritedWebflow . Cloudflare
2507ey.comScore 77 out of 100, grade BOpenDeliberateAdobe Experience Manager . Fastly
1556fastdl.appScore 77 out of 100, grade BOpenInheritedCloudflare
2616fidelity.comScore 77 out of 100, grade BOpenInheritedAngular . Akamai
3579foxbusiness.comScore 77 out of 100, grade BOpenInheritedFastly
67gandi.netScore 77 out of 100, grade BOpenInheritedFastly
2992history.comScore 77 out of 100, grade BOpenInheritedNext.js . Fastly
1410ilmeteo.itScore 77 out of 100, grade BNo trainingDeliberateCloudflare
3777indiatoday.inScore 77 out of 100, grade BOpenInheritedNext.js . Akamai
4634join.chatScore 77 out of 100, grade BOpenInheritedWordPress
4368kemenag.go.idScore 77 out of 100, grade BOpenInheritedNext.js
4718khabar.betScore 77 out of 100, grade BOpenInheritedCloudflare
842kleinanzeigen.deScore 77 out of 100, grade BOpenDeliberateAstro . Akamai
1926kraken.comScore 77 out of 100, grade BOpenInheritedCloudflare
1545luticlip.comScore 77 out of 100, grade BOpenInheritedWordPress
1906mapbox.comScore 77 out of 100, grade BOpenInheritedCloudflare
1123meethue.comScore 77 out of 100, grade BOpenInheritedAdobe Experience Manager . Akamai
4560meteored.com.arScore 77 out of 100, grade BOpenInheritedCloudflare
2243mgid.comScore 77 out of 100, grade BOpenDeliberateAngular . Cloudflare
2046mybharat.gov.inScore 77 out of 100, grade BOpenInheritedunidentified
4880narvar.compolicy gapScore 77 out of 100, grade BOpenInheritedCloudflare
4925nerdwallet.comScore 77 out of 100, grade BOpenInheritedCloudflare
3157newsroom.biScore 77 out of 100, grade BOpenInheritedFastly
2411nexx360.ioScore 77 out of 100, grade BOpenInheritedWordPress . Cloudflare
669nike.comScore 77 out of 100, grade BOpenInheritedNext.js . Akamai
352okta.comScore 77 out of 100, grade BOpenInheritedAdobe Experience Manager . Cloudflare
1980oreilly.comScore 77 out of 100, grade BNo trainingDeliberateAkamai
894otto.deScore 77 out of 100, grade BOpenDeliberateunidentified
1707pornobrasil.comScore 77 out of 100, grade BOpenInheritedWordPress . Cloudflare
5067preqin.comScore 77 out of 100, grade BOpenInheritedContentful . Amazon CloudFront
3841proxmox.comScore 77 out of 100, grade BOpenInheritedJoomla
4761realme.comScore 77 out of 100, grade BOpenInheritedNuxt
3747rokt.comScore 77 out of 100, grade BOpenInheritedCloudflare
213roku.comScore 77 out of 100, grade BOpenInheritedNext.js . Cloudflare
257salesforce.comScore 77 out of 100, grade BOpenInheritedContentful . Akamai
4407securly.comScore 77 out of 100, grade BOpenInheritedSvelteKit . Varnish
2746tamu.eduScore 77 out of 100, grade BOpenInheritedWordPress . Amazon CloudFront
1106terra.com.brScore 77 out of 100, grade BOpenInheritedAkamai
2832texas.govScore 77 out of 100, grade BOpenDeliberateDrupal . Amazon CloudFront
3963thenextweb.comScore 77 out of 100, grade BOpenInheritedCloudflare
472trendmicro.comScore 77 out of 100, grade BOpenDeliberateAdobe Experience Manager
4180udag.deScore 77 out of 100, grade BOpenInheritedWordPress
3971veeam.comScore 77 out of 100, grade BOpenInheritedAdobe Experience Manager . Fastly
3814venmo.comScore 77 out of 100, grade BOpenInheritedAmazon CloudFront
3918wolt.comScore 77 out of 100, grade BOpenInheritedAmazon CloudFront
100wordpress.compolicy gapScore 77 out of 100, grade BOpenInheritedWordPress
493wp.compolicy gapScore 77 out of 100, grade BOpenInheritedWordPress
3009x5.ruScore 77 out of 100, grade BOpenInheritedWordPress
1754xxxpostpic.orgScore 77 out of 100, grade BOpenInheritedWordPress . Cloudflare
3307yeastar.comScore 77 out of 100, grade BOpenInheritedHubSpot CMS . Alibaba Cloud CDN
3371zdf.deScore 77 out of 100, grade BOpenDeliberateNext.js
5083ziggo.nlScore 77 out of 100, grade BOpenInheritedAdobe Experience Manager . Amazon CloudFront
886zoom.com
and 1 more domain with the same policy
Score 77 out of 100, grade BOpenInheritedCloudflare
3598aruba.itScore 76 out of 100, grade BOpenInheritedCloudflare
3243centurygame.comScore 76 out of 100, grade BOpenInheritedWordPress
4943channelnewsasia.comScore 76 out of 100, grade BOpenInheritedDrupal . Imperva
4564cookieadmin.netScore 76 out of 100, grade BOpenInheritedCloudflare
1896cronista.comScore 76 out of 100, grade BOpenInheritedAkamai
2708databricks.comScore 76 out of 100, grade BOpenInheritedDrupal . Cloudflare
4084db.comScore 76 out of 100, grade BOpenInheritedGoogle Cloud / GFE
3704dev.toScore 76 out of 100, grade BOpenInheritedFastly
4717dpbosssattamatka.comScore 76 out of 100, grade BOpenInheritedCloudflare
2146elastic.coScore 76 out of 100, grade BOpenInheritedNext.js . Fastly
2510ex.coScore 76 out of 100, grade BOpenInheritedWordPress . Cloudflare
4963framer.comScore 76 out of 100, grade BOpenInheritedFramer
2979global-e.comScore 76 out of 100, grade BOpenInheritedHubSpot CMS . Cloudflare
2222goguardian.comScore 76 out of 100, grade BOpenInheritedCloudflare
4154growthbook.ioScore 76 out of 100, grade BOpenInheritedCloudflare
548mozilla.comScore 76 out of 100, grade BOpenInheritedFastly
1168siemens.comScore 76 out of 100, grade BOpenInheritedAstro . Amazon CloudFront
3490smartsheet.comScore 76 out of 100, grade BOpenInheritedDrupal . Fastly
2352spot.imScore 76 out of 100, grade BOpenInheritedWordPress . Cloudflare
1535ssstik.ioScore 76 out of 100, grade BOpenInheritedCloudflare
4700superawesome.tvScore 76 out of 100, grade BOpenInheritedWordPress . Cloudflare
1808surfshark.comScore 76 out of 100, grade BOpenInheritedWordPress . Cloudflare
605target.comScore 76 out of 100, grade BOpenInheritedNext.js
3242tutu.ruScore 76 out of 100, grade BOpenInheritedNext.js
4285ucsf.eduScore 76 out of 100, grade BOpenInheritedDrupal . Cloudflare
1484upskirt.tvScore 76 out of 100, grade BOpenInheritedCloudflare
1798va.govScore 76 out of 100, grade BOpenDeliberateNext.js
325vungle.comScore 76 out of 100, grade BOpenInheritedWordPress . Cloudflare
3938wetter.comScore 76 out of 100, grade BOpenInheritedAmazon CloudFront
270who.intScore 76 out of 100, grade BOpenDeliberateCloudflare
1665xorgasmo.comScore 76 out of 100, grade BOpenInheritedWordPress . Cloudflare
4657zoominfo.comScore 76 out of 100, grade BNo trainingDeliberateContentful . Cloudflare
1536aajtak.inScore 75 out of 100, grade BOpenInheritedAkamai
1857akismet.compolicy gapScore 75 out of 100, grade BOpenInheritedWordPress
727asus.comScore 75 out of 100, grade BOpenInheritedNuxt . Amazon CloudFront

Showing the first 150 operators. The full list is in the dataset.

crawl 2026-11-22 10:38 UTCprobe 3.0.0rubric 2.0.0registry 1.0.0vantage gha-ubuntu3,656 of 5,006 reachable

Using these figures

Free to reuse in research, journalism or a product under CC BY 4.0, with credit to Fidget Labs BV. Quote the measurement date so the claim stays checkable as the index moves.

CrawlIndex by Fidget Labs BV. "Sites scoring 70 to 79 for AI readiness." https://crawlindex.org (measured 2026-11-22). Licensed CC BY 4.0.