crawlindex

Search the index. A domain that is not here can still be measured live on the check page.

Score band . grade F

Sites scoring 10 to 19

3 of 2,567 fully measured sites land here, 0.1% of the index. Blocks most answer-surface crawlers, or serves almost nothing a crawler can read.

2 operators

One row per operator, highest score first. Partial assessments are excluded, because a renormalised score belongs to a different scale and could not be placed in a band honestly.

Sites scoring 10 to 19
RankDomainScorePolicyStack
849amazon.com.au
and 1 more domain with the same policy
Score 15 out of 100, grade FSelectiveDeliberateAmazon CloudFront
54tiktok.comScore 15 out of 100, grade FWalledDeliberateunidentified

Showing the first 2 operators. The full list is in the dataset.

crawl 2026-09-22 08:34 UTCprobe 3.0.0rubric 2.0.0registry 1.0.0vantage gha-ubuntu3,618 of 5,006 reachable

Using these figures

Free to reuse in research, journalism or a product under CC BY 4.0, with credit to Fidget Labs BV. Quote the measurement date so the claim stays checkable as the index moves.

CrawlIndex by Fidget Labs BV. "Sites scoring 10 to 19 for AI readiness." https://crawlindex.org (measured 2026-09-22). Licensed CC BY 4.0.