Edge network
Varnish
34 measured sites. 10 of them, 29.4%, block at least one answer-surface AI crawler. Mean readiness score 61.6.
Compare against every other edge network
| Rank | Domain | Score | Answer-surface crawlers | Stack |
|---|---|---|---|---|
| 691 | cbsnews.com | Score 74 out of 100, grade C | 1 blocked | Varnish |
| 797 | livejournal.com | Score 61 out of 100, grade C, partial assessment | all allowed | Varnish |
| 1126 | tagesschau.de | Score 52 out of 100, grade D | 5 blocked | Varnish |
| 1175 | postgresql.org | Score 67 out of 100, grade C | all allowed | Varnish |
| 1180 | one.one | Score 80 out of 100, grade B | all allowed | Next.js . Varnish |
| 1247 | riotgames.com | Score 63 out of 100, grade C | all allowed | Varnish |
| 1289 | one.com | Score 80 out of 100, grade B | all allowed | Next.js . Varnish |
| 1423 | filmweb.pl | Score 64 out of 100, grade C | all allowed | Varnish |
| 1496 | psychologytoday.com | Score 67 out of 100, grade C | all allowed | Drupal . Varnish |
| 1700 | escort.club | Score 55 out of 100, grade D | all allowed | Varnish |
| 1760 | staseraintv.com | Score 52 out of 100, grade D | all allowed | Varnish |
| 2196 | redd.itrefused GPTBot | Score 84 out of 100, grade B, partial assessment | all allowed | Varnish |
| 2393 | khanacademy.org | Score 78 out of 100, grade B, partial assessment | all allowed | Varnish |
| 2791 | imageshack.us | Score 53 out of 100, grade D | 5 blocked | Varnish |
| 2889 | rutgers.edu | Score 60 out of 100, grade C | all allowed | Drupal . Varnish |
| 3423 | ndr.de | Score 53 out of 100, grade D | 5 blocked | Varnish |
| 3466 | axis.com | Score 71 out of 100, grade C | all allowed | Drupal . Varnish |
| 3513 | unl.edu | Score 60 out of 100, grade C | all allowed | Drupal . Varnish |
| 3605 | ladepeche.fr | Score 52 out of 100, grade D | 4 blocked | Varnish |
| 3609 | lse.ac.uk | Score 60 out of 100, grade C | all allowed | Varnish |
| 3677 | bayern.de | Score 60 out of 100, grade C | all allowed | WordPress . Varnish |
| 3839 | ilsole24ore.comrefused GPTBot | Score 40 out of 100, grade D | 7 blocked | Varnish |
| 4237 | mdr.de | Score 53 out of 100, grade D | 5 blocked | Varnish |
| 4259 | uni-heidelberg.de | Score 67 out of 100, grade C | all allowed | Drupal . Varnish |
| 4390 | index.hu | Score 62 out of 100, grade C | all allowed | Varnish |
| 4407 | securly.com | Score 77 out of 100, grade B | all allowed | SvelteKit . Varnish |
| 4492 | imageshack.com | Score 53 out of 100, grade D | 5 blocked | Varnish |
| 4562 | serpro.gov.br | Score 58 out of 100, grade D, partial assessment | all allowed | Varnish |
| 4803 | myworkday.com | Score 51 out of 100, grade D | all allowed | Drupal . Varnish |
| 4807 | easybell.de | Score 78 out of 100, grade B | all allowed | TYPO3 . Varnish |
| 4876 | yna.co.kr | Score 51 out of 100, grade D | 8 blocked | Varnish |
| 5013 | windstream.net | Score 31 out of 100, grade F | 5 blocked | Varnish |
| 5044 | cbslocal.com | Score 67 out of 100, grade C | all allowed | Varnish |
| 5053 | correios.com.br | Score 59 out of 100, grade D | all allowed | Varnish |
Using these figures
Free to reuse in research, journalism or a product under CC BY 4.0, with credit to Fidget Labs BV. Quote the measurement date so the claim stays checkable as the index moves.
CrawlIndex by Fidget Labs BV. "Agent readiness on Varnish." https://crawlindex.org (measured 2026-11-22). Licensed CC BY 4.0.