crawlindex

Search the index. A domain that is not here can still be measured live on the check page.

Score band . grade D

Sites scoring 40 to 49

293 of 2,613 fully measured sites land here, 11.2% of the index. Substantially closed or substantially unreadable. Often a platform default rather than a decision.

150 operators

One row per operator, highest score first. Partial assessments are excluded, because a renormalised score belongs to a different scale and could not be placed in a band honestly.

Sites scoring 40 to 49
RankDomainScorePolicyStack
2382ad-delivery.netScore 49 out of 100, grade DUndeclaredAbsentCloudflare
967app-ads-services.comScore 49 out of 100, grade DOpenDeliberateGoogle Cloud / GFE
3776atl-paas.netScore 49 out of 100, grade DUndeclaredAbsentAmazon CloudFront
3543blogspot.co.uk
and 1 more domain with the same policy
Score 49 out of 100, grade DOpenDeliberateGoogle Cloud / GFE
4452ekatox.comScore 49 out of 100, grade DUndeclaredAbsentGoogle Cloud / GFE
4294google.ae
and 66 more domains with the same policy
Score 49 out of 100, grade DOpenDeliberateGoogle Cloud / GFE
3949hotstar.comScore 49 out of 100, grade DUndeclaredAbsentAkamai
2285im-apps.netScore 49 out of 100, grade DUndeclaredAbsentGoogle Cloud / GFE
506lijit.comScore 49 out of 100, grade DUndeclaredAbsentAmazon CloudFront
2227livedns.co.ukScore 49 out of 100, grade DUndeclaredAbsentunidentified
2897mfadsrvr.comScore 49 out of 100, grade DUndeclaredAbsentAmazon CloudFront
3080rkdms.comScore 49 out of 100, grade DUndeclaredAbsentunidentified
541sberbank.ruScore 49 out of 100, grade DUndeclaredAbsentunidentified
2108sensic.netScore 49 out of 100, grade DUndeclaredAbsentAmazon CloudFront
1171tfkc.deScore 49 out of 100, grade DUndeclaredAbsentunidentified
2251variety.comScore 49 out of 100, grade DSelectiveDeliberateWordPress
1154vivo.comScore 49 out of 100, grade DUndeclaredAbsentNuxt
4998vix.comScore 49 out of 100, grade DNo trainingDeliberateNext.js . Fastly
2059wechat.comScore 49 out of 100, grade DUndeclaredAbsentNuxt
24481688.comScore 48 out of 100, grade DOpenInheritedAlibaba Cloud CDN
587360yield.comScore 48 out of 100, grade DOpenInheritedunidentified
1067abovedomains.comScore 48 out of 100, grade DOpenInheritedHubSpot CMS
2248av380.netScore 48 out of 100, grade DOpenInheritedunidentified
2117ay.deliveryScore 48 out of 100, grade DOpenInheritedCloudflare
1223ay267.comScore 48 out of 100, grade DNo trainingDeliberateCloudflare
1481bblaa.comScore 48 out of 100, grade DNo trainingDeliberateCloudflare
1741betpawa.cm
and 3 more domains with the same policy
Score 48 out of 100, grade DOpenDeliberateNext.js . Cloudflare
2084bollyflix.afScore 48 out of 100, grade DNo trainingDeliberateWordPress . Cloudflare
1302cdiscount.comScore 48 out of 100, grade DOpenInheritedCloudflare
4704chinaz.compolicy gapScore 48 out of 100, grade DOpenInheritedunidentified
4794collider.comScore 48 out of 100, grade DNo trainingDeliberateWordPress
1577crn77.comScore 48 out of 100, grade DNo trainingDeliberateCloudflare
3172crunchbase.comScore 48 out of 100, grade DNo trainingDeliberateCloudflare
2065didiglobal.comScore 48 out of 100, grade DUndeclaredAbsentunidentified
924disqus.comScore 48 out of 100, grade DOpenInheritedunidentified
4304dola.comScore 48 out of 100, grade DOpenInheritedunidentified
2559doubao.comScore 48 out of 100, grade DOpenInheritedunidentified
477dropcatch.comScore 48 out of 100, grade DUndeclaredAbsentCloudflare
1982ey43.comScore 48 out of 100, grade DNo trainingDeliberateCloudflare
1824featurespace.co.ukScore 48 out of 100, grade DOpenDeliberateAdobe Experience Manager . Cloudflare
1696goal7.copolicy gapScore 48 out of 100, grade DUndeclaredAbsentWordPress . Cloudflare
2000grok.comScore 48 out of 100, grade DSelectiveDeliberateNext.js . Cloudflare
1340hai8g.comScore 48 out of 100, grade DNo trainingDeliberateCloudflare
4505howtogeek.comScore 48 out of 100, grade DNo trainingDeliberateWordPress
796imgur.comScore 48 out of 100, grade DOpenInheritedFastly
3180instructables.comScore 48 out of 100, grade DOpenInheritedContentful . Amazon CloudFront
3955ixigua.comScore 48 out of 100, grade DOpenInheritedAlibaba Cloud CDN
3361kdocs.cnScore 48 out of 100, grade DOpenInheritedunidentified
2154mmcdn.comScore 48 out of 100, grade DUndeclaredAbsentCloudflare
1761mobcup.fmScore 48 out of 100, grade DNo trainingDeliberateCloudflare
3547mystrikingly.compolicy gapScore 48 out of 100, grade DUndeclaredAbsentAmazon CloudFront
4386nine.com.auScore 48 out of 100, grade DSelectiveDeliberateFastly
668nintendo.comScore 48 out of 100, grade DNo trainingDeliberateNext.js . Fastly
1999nya2.comScore 48 out of 100, grade DNo trainingDeliberateCloudflare
1916omg10.comScore 48 out of 100, grade DNo trainingDeliberateCloudflare
3561onenote.com
and 1 more domain with the same policy
Score 48 out of 100, grade DUndeclaredAbsentunidentified
892onetag-sys.comScore 48 out of 100, grade DUndeclaredAbsentunidentified
489openstreetmap.orgpolicy gapScore 48 out of 100, grade DOpenInheritedFastly
3743opensuse.orgpolicy gapScore 48 out of 100, grade DUndeclaredAbsentunidentified
1853orcid.orgScore 48 out of 100, grade DOpenInheritedCloudflare
4606pbase.compolicy gapScore 48 out of 100, grade DUndeclaredAbsentunidentified
1396rule34video.compolicy gapScore 48 out of 100, grade DOpenInheritedunidentified
4302runescape.compolicy gapScore 48 out of 100, grade DOpenInheritedContentful . Cloudflare
1756satta-king-fast.compolicy gapScore 48 out of 100, grade DUndeclaredAbsentCloudflare
4075screenrant.comScore 48 out of 100, grade DNo trainingDeliberateWordPress
4510sqlite.orgpolicy gapScore 48 out of 100, grade DOpenInheritedunidentified
4040swr.deScore 48 out of 100, grade DNo trainingDeliberateunidentified
2642thehill.comScore 48 out of 100, grade DSelectiveDeliberateWordPress . Fastly
1608txnhh.compolicy gapScore 48 out of 100, grade DOpenInheritedunidentified
4526usaa.comScore 48 out of 100, grade DUndeclaredAbsentunidentified
357userapi.comScore 48 out of 100, grade DOpenInheritedunidentified
4666ustream.tvScore 48 out of 100, grade DOpenInheritedunidentified
2456virtualearth.netScore 48 out of 100, grade DUndeclaredAbsentunidentified
3447virustotal.comScore 48 out of 100, grade DOpenInheritedGoogle Cloud / GFE
162vk.comScore 48 out of 100, grade DOpenInheritedunidentified
165vk.ruScore 48 out of 100, grade DOpenInheritedunidentified
3271worldcat.orgScore 48 out of 100, grade DSelectiveDeliberateAdobe Experience Manager . Cloudflare
4773xda-developers.comScore 48 out of 100, grade DNo trainingDeliberateWordPress
1187xhaccess.comScore 48 out of 100, grade DOpenInheritedCloudflare
688xhamster.com
and 1 more domain with the same policy
Score 48 out of 100, grade DOpenInheritedCloudflare
1315xhamster1.desiScore 48 out of 100, grade DOpenInheritedCloudflare
1309xhamster19.comScore 48 out of 100, grade DOpenInheritedunidentified
1221xhamster2.comScore 48 out of 100, grade DOpenInheritedunidentified
977xhamster46.desiScore 48 out of 100, grade DOpenInheritedCloudflare
4609xhco.liveScore 48 out of 100, grade DOpenInheritedCloudflare
4147xhfanclub.comScore 48 out of 100, grade DOpenInheritedunidentified
4471xhfuck.comScore 48 out of 100, grade DOpenInheritedunidentified
1923xhlink.blogScore 48 out of 100, grade DOpenInheritedCloudflare
1368xhname.comScore 48 out of 100, grade DOpenInheritedunidentified
1335xhopen.comScore 48 out of 100, grade DOpenInheritedunidentified
1339xhsocial.comScore 48 out of 100, grade DOpenInheritedunidentified
1319xhspot.comScore 48 out of 100, grade DOpenInheritedunidentified
1384xhstream.comScore 48 out of 100, grade DOpenInheritedunidentified
2052xhtv.liveScore 48 out of 100, grade DOpenInheritedCloudflare
1920xhzone.liveScore 48 out of 100, grade DOpenInheritedunidentified
1518xnxx-arabic.compolicy gapScore 48 out of 100, grade DOpenInheritedCloudflare
981xnxx.compolicy gap
and 1 more domain with the same policy
Score 48 out of 100, grade DOpenInheritedunidentified
1502xnxx.espolicy gapScore 48 out of 100, grade DOpenInheritedCloudflare
1500xnxx2.compolicy gapScore 48 out of 100, grade DOpenInheritedunidentified
1371xnxxvideos.mepolicy gapScore 48 out of 100, grade DOpenInheritedunidentified
1189aftonbladet.seScore 47 out of 100, grade DAssistant onlyDeliberateAstro . Amazon CloudFront
2150apple.newsScore 47 out of 100, grade DUndeclaredAbsentunidentified
1074archiveofourown.orgScore 47 out of 100, grade DSelectiveDeliberateCloudflare
4554bidvol.comScore 47 out of 100, grade DUndeclaredAbsentNuxt
3295billboard.comScore 47 out of 100, grade DSelectiveDeliberateWordPress
2007botinok.pornScore 47 out of 100, grade DNo trainingDeliberateunidentified
1344e621.netScore 47 out of 100, grade DAssistant onlyDeliberateCloudflare
907figma.comScore 47 out of 100, grade DSelectiveDeliberateSanity . Amazon CloudFront
1480hdtube.pornScore 47 out of 100, grade DSelectiveDeliberateunidentified
2614hollywoodreporter.comScore 47 out of 100, grade DSelectiveDeliberateWordPress
4743inaturalist.orgScore 47 out of 100, grade DNo trainingDeliberateCloudflare
4438mercadopago.compolicy gapScore 47 out of 100, grade DUndeclaredAbsentunidentified
1764pornoborshch.comScore 47 out of 100, grade DNo trainingDeliberateunidentified
1919scientificamerican.comScore 47 out of 100, grade DSelectiveDeliberateAmazon CloudFront
600uol.com.brScore 47 out of 100, grade DSelectiveDeliberateAmazon CloudFront
321wiley.compolicy gapScore 47 out of 100, grade DUndeclaredAbsentCloudflare
3523ardmediathek.deScore 46 out of 100, grade DNo trainingDeliberateunidentified
700bandcamp.comScore 46 out of 100, grade DNo trainingDeliberateFastly
3942gitea.comScore 46 out of 100, grade DSelectiveDeliberateHubSpot CMS . Cloudflare
2494guardian.co.ukScore 46 out of 100, grade DSelectiveDeliberateunidentified
1487huffingtonpost.comScore 46 out of 100, grade DWalledDeliberateFastly
954huffpost.comScore 46 out of 100, grade DWalledDeliberateFastly
209medium.comScore 46 out of 100, grade DNo trainingDeliberateCloudflare
3281myanimelist.netScore 46 out of 100, grade DNo trainingDeliberateunidentified
2501slate.comScore 46 out of 100, grade DNo trainingDeliberateFastly
159snapchat.comScore 46 out of 100, grade DNo trainingDeliberateNext.js . Google Cloud / GFE
203theguardian.comScore 46 out of 100, grade DSelectiveDeliberateunidentified
2978thehindu.comScore 46 out of 100, grade DSelectiveDeliberateCloudflare
383310086.cnScore 45 out of 100, grade DUndeclaredAbsentunidentified
2014adsco.reScore 45 out of 100, grade DUndeclaredAbsentunidentified
1086alipay.comScore 45 out of 100, grade DUndeclaredAbsentAlibaba Cloud CDN
1990aucey.compolicy gapScore 45 out of 100, grade DUndeclaredAbsentCloudflare
4159banki.ruScore 45 out of 100, grade DUndeclaredAbsentunidentified
2015betway.co.bwScore 45 out of 100, grade DUndeclaredAbsentNuxt . Cloudflare
2472cafe24.comScore 45 out of 100, grade DUndeclaredAbsentunidentified
221charter.netpolicy gapScore 45 out of 100, grade DOpenInheritedAmazon CloudFront
1604colliderporn.comScore 45 out of 100, grade DNo trainingDeliberateunidentified
4495cox.netScore 45 out of 100, grade DUndeclaredAbsentAdobe Experience Manager . Fastly
4069cribl.cloudScore 45 out of 100, grade DUndeclaredAbsentNext.js . Amazon CloudFront
1648darkero.comScore 45 out of 100, grade DSelectiveDeliberateWordPress . Cloudflare
1237dcinside.comScore 45 out of 100, grade DAssistant onlyDeliberateunidentified
4597dnsmeasurement.comScore 45 out of 100, grade DUndeclaredAbsentunidentified
2368dnspod.comScore 45 out of 100, grade DUndeclaredAbsentunidentified
2880dnsv5.comScore 45 out of 100, grade DUndeclaredAbsentunidentified
1697dord.gov.inScore 45 out of 100, grade DUndeclaredAbsentNext.js . Akamai
459eye4.cnScore 45 out of 100, grade DUndeclaredAbsentunidentified
1948fflivegame.comScore 45 out of 100, grade DUndeclaredAbsentNext.js
3583forticloud.comScore 45 out of 100, grade DUndeclaredAbsentunidentified
1619happy-porn.comScore 45 out of 100, grade DNo trainingDeliberateunidentified
2357hotmail.comScore 45 out of 100, grade DUndeclaredAbsentunidentified

Showing the first 150 operators. The full list is in the dataset.

crawl 2026-11-22 10:38 UTCprobe 3.0.0rubric 2.0.0registry 1.0.0vantage gha-ubuntu3,656 of 5,006 reachable

Using these figures

Free to reuse in research, journalism or a product under CC BY 4.0, with credit to Fidget Labs BV. Quote the measurement date so the claim stays checkable as the index moves.

CrawlIndex by Fidget Labs BV. "Sites scoring 40 to 49 for AI readiness." https://crawlindex.org (measured 2026-11-22). Licensed CC BY 4.0.