Top-level domain
.gov
71 measured sites. 4 of them, 5.6%, block at least one answer-surface AI crawler. Mean readiness score 65.8.
Compare against every other top-level domain
| Rank | Domain | Score | Answer-surface crawlers | Stack |
|---|---|---|---|---|
| 130 | nih.govrefused GPTBot | Score 78 out of 100, grade B, partial assessment | all allowed | Cloudflare |
| 236 | nist.gov | Score 67 out of 100, grade C | all allowed | Drupal . Cloudflare |
| 368 | cdc.gov | Score 92 out of 100, grade A, partial assessment | all allowed | Akamai |
| 410 | nasa.gov | Score 75 out of 100, grade B | all allowed | WordPress |
| 576 | ca.gov | Score 85 out of 100, grade B | all allowed | Azure Front Door |
| 578 | noaa.gov | Score 60 out of 100, grade C | all allowed | Drupal . Amazon CloudFront |
| 583 | maricopa.govrefused GPTBot | Score 54 out of 100, grade D | all allowed | Cloudflare |
| 656 | loc.govrefused GPTBot | Score 57 out of 100, grade D | all allowed | Cloudflare |
| 863 | usda.gov | Score 78 out of 100, grade B, partial assessment | all allowed | Akamai |
| 899 | epa.gov | Score 63 out of 100, grade C | all allowed | Drupal . Amazon CloudFront |
| 943 | state.govrefused GPTBot | Score 53 out of 100, grade D | all allowed | WordPress . Amazon CloudFront |
| 1031 | whitehouse.gov | Score 80 out of 100, grade B | all allowed | WordPress |
| 1331 | irs.gov | Score 61 out of 100, grade C | all allowed | Drupal . Akamai |
| 1798 | va.gov | Score 76 out of 100, grade B | all allowed | Next.js |
| 1880 | nps.gov | Score 61 out of 100, grade C | all allowed | Amazon CloudFront |
| 1915 | sec.gov | Score 92 out of 100, grade A, partial assessment | all allowed | Akamai |
| 2073 | bls.gov | Score 78 out of 100, grade B, partial assessment | all allowed | Akamai |
| 2149 | ed.govrefused GPTBot | Score 78 out of 100, grade B, partial assessment | all allowed | Azure Front Door |
| 2177 | house.gov | Score 57 out of 100, grade D | all allowed | Drupal . Akamai |
| 2181 | hhs.gov | Score 78 out of 100, grade B, partial assessment | all allowed | unidentified |
| 2201 | census.gov | Score 69 out of 100, grade C | all allowed | Adobe Experience Manager . Cloudflare |
| 2203 | justice.gov | Score 52 out of 100, grade D | 3 blocked | Drupal . Akamai |
| 2348 | ny.gov | Score 92 out of 100, grade A, partial assessment | all allowed | Cloudflare |
| 2371 | weather.gov | Score 55 out of 100, grade D | all allowed | unidentified |
| 2383 | energy.gov | Score 66 out of 100, grade C | all allowed | Drupal . Amazon CloudFront |
| 2427 | congress.govrefused GPTBot | Score 21 out of 100, grade F, partial assessment | 10 blocked | Cloudflare |
| 2451 | faa.gov | Score 57 out of 100, grade D | all allowed | Drupal |
| 2477 | senate.gov | Score 52 out of 100, grade D | all allowed | Akamai |
| 2547 | dhs.govrefused GPTBot | Score 57 out of 100, grade D | all allowed | Drupal . Akamai |
| 2734 | medlineplus.gov | Score 74 out of 100, grade C | all allowed | Amazon CloudFront |
| 2743 | archives.gov | Score 63 out of 100, grade C | all allowed | Amazon CloudFront |
| 2820 | treasury.gov | Score 57 out of 100, grade D | all allowed | Akamai |
| 2832 | texas.gov | Score 77 out of 100, grade B | all allowed | Drupal . Amazon CloudFront |
| 2861 | wa.gov | Score 14 out of 100, grade F, partial assessment | 11 blocked | unidentified |
| 2893 | dot.gov | Score 78 out of 100, grade B, partial assessment | all allowed | Akamai |
| 2964 | fcc.govrefused GPTBot | Score 78 out of 100, grade B, partial assessment | all allowed | Akamai |
| 3018 | uspto.gov | Score 80 out of 100, grade B | all allowed | Drupal . Amazon CloudFront |
| 3086 | nyc.gov | Score 63 out of 100, grade C | all allowed | Adobe Experience Manager . Fastly |
| 3113 | fbi.govrefused GPTBot | Score 78 out of 100, grade B, partial assessment | all allowed | Cloudflare |
| 3117 | usa.gov | Score 74 out of 100, grade C | all allowed | Drupal . Amazon CloudFront |
| 3149 | cancer.gov | Score 64 out of 100, grade C | all allowed | Drupal |
| 3200 | federalregister.gov | Score 62 out of 100, grade C | all allowed | unidentified |
| 3212 | dol.gov | Score 84 out of 100, grade B, partial assessment | all allowed | Akamai |
| 3254 | dataprivacyframework.gov | Score 84 out of 100, grade B, partial assessment | all allowed | unidentified |
| 3302 | cisa.govrefused GPTBot | Score 53 out of 100, grade D | all allowed | Drupal |
| 3518 | osha.gov | Score 54 out of 100, grade D | all allowed | Drupal . Amazon CloudFront |
| 3617 | clinicaltrials.gov | Score 56 out of 100, grade D | all allowed | Google Cloud / GFE |
| 3627 | federalreserve.gov | Score 57 out of 100, grade D | all allowed | Cloudflare |
| 3642 | sba.gov | Score 80 out of 100, grade B | all allowed | WordPress . Amazon CloudFront |
| 3748 | uscourts.gov | Score 63 out of 100, grade C | all allowed | Drupal . Akamai |
| 3910 | uscis.govrefused GPTBot | Score 53 out of 100, grade D | all allowed | Drupal |
| 3922 | fema.govrefused GPTBot | Score 78 out of 100, grade B, partial assessment | 1 blocked | Akamai |
| 3936 | cia.gov | Score 61 out of 100, grade C | all allowed | Gatsby . Akamai |
| 3950 | virginia.gov | Score 59 out of 100, grade D | all allowed | unidentified |
| 3984 | login.gov | Score 64 out of 100, grade C | all allowed | Amazon CloudFront |
| 3994 | eia.gov | Score 64 out of 100, grade C | all allowed | Akamai |
| 4061 | studentaid.gov | Score 45 out of 100, grade D | all allowed | Drupal . Akamai |
| 4192 | cms.gov | Score 64 out of 100, grade C | all allowed | Drupal . Akamai |
| 4338 | govinfo.gov | Score 61 out of 100, grade C | all allowed | Drupal . Cloudflare |
| 4436 | defense.govrefused GPTBot | Score 78 out of 100, grade B, partial assessment | all allowed | Akamai |
| 4462 | nj.gov | Score 57 out of 100, grade D | all allowed | Imperva |
| 4638 | mo.gov | Score 60 out of 100, grade C | all allowed | Drupal . Imperva |
| 4653 | ct.gov | Score 57 out of 100, grade D | all allowed | Sitecore . Azure Front Door |
| 4658 | nsf.gov | Score 67 out of 100, grade C | all allowed | Drupal . Amazon CloudFront |
| 4680 | in.gov | Score 92 out of 100, grade A, partial assessment | all allowed | unidentified |
| 4767 | ecfr.gov | Score 62 out of 100, grade C | all allowed | unidentified |
| 4809 | pa.gov | Score 64 out of 100, grade C | all allowed | Adobe Experience Manager . Fastly |
| 4976 | nhtsa.gov | Score 78 out of 100, grade B, partial assessment | all allowed | Akamai |
| 5017 | cbp.govrefused GPTBot | Score 53 out of 100, grade D | all allowed | Drupal |
| 5065 | medicare.gov | Score 63 out of 100, grade C | all allowed | Drupal . Akamai |
| 5075 | utah.gov | Score 54 out of 100, grade D | all allowed | Amazon CloudFront |
Using these figures
Free to reuse in research, journalism or a product under CC BY 4.0, with credit to Fidget Labs BV. Quote the measurement date so the claim stays checkable as the index moves.
CrawlIndex by Fidget Labs BV. "Agent readiness on .gov." https://crawlindex.org (measured 2026-11-22). Licensed CC BY 4.0.