crawlindex

Search the index. A domain that is not here can still be measured live on the check page.

Score band . grade F

Sites scoring 10 to 19

8 of 2,613 fully measured sites land here, 0.3% of the index. Blocks most answer-surface crawlers, or serves almost nothing a crawler can read.

3 operators

One row per operator, highest score first. Partial assessments are excluded, because a renormalised score belongs to a different scale and could not be placed in a band honestly.

Sites scoring 10 to 19
RankDomainScorePolicyStack
3981findagrave.comScore 19 out of 100, grade FWalledDeliberateCloudflare
3567amazon.ae
and 5 more domains with the same policy
Score 15 out of 100, grade FSelectiveDeliberateAmazon CloudFront
63tiktok.comScore 15 out of 100, grade FWalledDeliberateunidentified

Showing the first 3 operators. The full list is in the dataset.

crawl 2026-11-22 10:38 UTCprobe 3.0.0rubric 2.0.0registry 1.0.0vantage gha-ubuntu3,656 of 5,006 reachable

Using these figures

Free to reuse in research, journalism or a product under CC BY 4.0, with credit to Fidget Labs BV. Quote the measurement date so the claim stays checkable as the index moves.

CrawlIndex by Fidget Labs BV. "Sites scoring 10 to 19 for AI readiness." https://crawlindex.org (measured 2026-11-22). Licensed CC BY 4.0.