Platform
Astro
22 measured sites. 3 of them, 13.6%, block at least one answer-surface AI crawler. Mean readiness score 70.4.
Compare against every other platform
| Rank | Domain | Score | Answer-surface crawlers | Stack |
|---|---|---|---|---|
| 2 | cloudflare.com | Score 85 out of 100, grade B | all allowed | Astro . Cloudflare |
| 80 | workers.dev | Score 67 out of 100, grade C | all allowed | Astro . Cloudflare |
| 230 | pages.dev | Score 70 out of 100, grade C | all allowed | Astro . Cloudflare |
| 383 | calendly.com | Score 79 out of 100, grade B | all allowed | Astro . Cloudflare |
| 635 | ikea.com | Score 71 out of 100, grade C | all allowed | Astro . Cloudflare |
| 745 | bugsnag.com | Score 60 out of 100, grade C | all allowed | Astro . Cloudflare |
| 891 | kleinanzeigen.de | Score 77 out of 100, grade B | all allowed | Astro . Akamai |
| 930 | netlify.app | Score 89 out of 100, grade B | all allowed | Astro . Netlify |
| 1143 | jimdo.com | Score 80 out of 100, grade B | all allowed | Astro . Cloudflare |
| 1167 | aftonbladet.se | Score 47 out of 100, grade D | 6 blocked | Astro . Amazon CloudFront |
| 1209 | vg.no | Score 56 out of 100, grade D | 6 blocked | Astro . Amazon CloudFront |
| 1299 | rustdesk.comrefused GPTBot | Score 74 out of 100, grade C | all allowed | Astro . Cloudflare |
| 1354 | asurascans.comrefused GPTBot | Score 70 out of 100, grade C | all allowed | Astro . Cloudflare |
| 1825 | chatgpt.site | Score 57 out of 100, grade D | all allowed | Astro . Vercel |
| 2018 | getbootstrap.com | Score 66 out of 100, grade C | all allowed | Astro . Cloudflare |
| 2927 | proton.me | Score 79 out of 100, grade B | all allowed | Astro |
| 3386 | adingo.jp | Score 61 out of 100, grade C | all allowed | Astro . Cloudflare |
| 3417 | wireshark.org | Score 60 out of 100, grade C | all allowed | Astro . Cloudflare |
| 4284 | netlify.com | Score 91 out of 100, grade A | all allowed | Astro . Netlify |
| 4716 | zomato.com | Score 52 out of 100, grade D | all allowed | Astro |
| 4902 | nerdwallet.com | Score 74 out of 100, grade C | 1 blocked | Astro . Cloudflare |
| 5047 | clara.net | Score 83 out of 100, grade B | all allowed | Astro |
Using these figures
Free to reuse in research, journalism or a product under CC BY 4.0, with credit to Fidget Labs BV. Quote the measurement date so the claim stays checkable as the index moves.
CrawlIndex by Fidget Labs BV. "Agent readiness on Astro." https://crawlindex.org (measured 2026-09-22). Licensed CC BY 4.0.