Top-level domain
.net
182 measured sites. 37 of them, 20.3%, block at least one answer-surface AI crawler. Mean readiness score 60.4.
Compare against every other top-level domain
| Rank | Domain | Score | Answer-surface crawlers | Stack |
|---|---|---|---|---|
| 33 | fastly.net | Score 79 out of 100, grade B | all allowed | Fastly |
| 37 | doubleclick.net | Score 71 out of 100, grade C | all allowed | unidentified |
| 48 | gandi.net | Score 83 out of 100, grade B | all allowed | Fastly |
| 54 | ripn.net | Not scored | all allowed | unidentified |
| 64 | cloudflare.netrefused GPTBot | Score 83 out of 100, grade B, partial assessment | all allowed | Cloudflare |
| 74 | myfritz.net | Score 17 out of 100, grade F, partial assessment | 11 blocked | unidentified |
| 75 | pv-cdn.net | Not scored | all allowed | unidentified |
| 76 | akam.net | Not scored | all allowed | unidentified |
| 78 | gwfb.net | Not scored | all allowed | unidentified |
| 88 | yandex.net | Score 49 out of 100, grade D | all allowed | unidentified |
| 113 | b-cdn.net | Score 60 out of 100, grade C | all allowed | Bunny |
| 131 | trbcdn.net | Not scored | all allowed | unidentified |
| 152 | steamserver.net | Not scored | all allowed | unidentified |
| 153 | azurefd.net | Not scored | all allowed | unidentified |
| 161 | netflix.net | Score 65 out of 100, grade C, partial assessment | 3 blocked | unidentified |
| 165 | spo-msedge.net | Not scored | all allowed | unidentified |
| 167 | ax-msedge.net | Not scored | all allowed | unidentified |
| 170 | nflxso.net | Not scored | all allowed | unidentified |
| 173 | tm-azurefd.net | Not scored | all allowed | unidentified |
| 187 | playstation.net | Not scored | all allowed | unidentified |
| 205 | edgcdn.net | Not scored | all allowed | unidentified |
| 208 | cpanel.net | Score 79 out of 100, grade B | all allowed | WordPress . Cloudflare |
| 219 | wac-msedge.net | Not scored | all allowed | unidentified |
| 221 | researchgate.netrefused GPTBot | Score 89 out of 100, grade B, partial assessment | all allowed | Cloudflare |
| 223 | comcast.net | Score 83 out of 100, grade B, partial assessment | all allowed | unidentified |
| 229 | sourceforge.net | Score 100 out of 100, grade A, partial assessment | all allowed | Cloudflare |
| 246 | telekom.net | Score 59 out of 100, grade D | all allowed | Varnish |
| 257 | omtrdc.net | Not scored | all allowed | unidentified |
| 264 | launchpad.netrefused GPTBot | Score 19 out of 100, grade F | 9 blocked | unidentified |
| 267 | facebook.net | Not scored | all allowed | unidentified |
| 272 | spov-msedge.net | Not scored | all allowed | unidentified |
| 274 | virginm.net | Not scored | all allowed | unidentified |
| 284 | ttvnw.net | Not scored | all allowed | unidentified |
| 288 | byteoversea.net | Not scored | all allowed | unidentified |
| 298 | jsdelivr.net | Not scored | all allowed | unidentified |
| 309 | php.net | Score 59 out of 100, grade D | all allowed | Bunny |
| 334 | imcmdb.net | Not scored | all allowed | unidentified |
| 350 | enacdn.net | Not scored | all allowed | unidentified |
| 353 | openx.net | Not scored | all allowed | unidentified |
| 357 | dotaplabs.net | Not scored | all allowed | unidentified |
| 367 | trueconf.net | Score 72 out of 100, grade C | all allowed | WordPress |
| 379 | demdex.net | Not scored | all allowed | unidentified |
| 384 | cdnbuild.net | Not scored | all allowed | unidentified |
| 387 | live-video.net | Not scored | all allowed | unidentified |
| 405 | vkuser.net | Not scored | all allowed | unidentified |
| 424 | avcdn.net | Not scored | all allowed | unidentified |
| 430 | nflxvideo.net | Score 65 out of 100, grade C, partial assessment | 3 blocked | unidentified |
| 433 | online-metrix.net | Not scored | all allowed | unidentified |
| 435 | dnspod.net | Not scored | all allowed | unidentified |
| 445 | dual-s-msedge.net | Not scored | all allowed | unidentified |
| 449 | ngenix.net | Not scored | all allowed | unidentified |
| 461 | cloudns.net | Score 70 out of 100, grade C | all allowed | unidentified |
| 473 | kwai.net | Not scored | all allowed | unidentified |
| 478 | adobe.net | Not scored | all allowed | unidentified |
| 480 | mynetname.net | Not scored | all allowed | unidentified |
| 489 | speedtest.net | Score 59 out of 100, grade D | all allowed | Cloudflare |
| 497 | behance.net | Score 66 out of 100, grade C, partial assessment | 5 blocked | Fastly |
| 498 | atlassian.net | Score 78 out of 100, grade B | all allowed | Amazon CloudFront |
| 504 | tencent-cloud.net | Not scored | all allowed | unidentified |
| 508 | nease.net | Score 45 out of 100, grade D | all allowed | unidentified |
| 512 | slideshare.net | Score 49 out of 100, grade D | all allowed | Fastly |
| 532 | impervadns.net | Not scored | all allowed | unidentified |
| 550 | aiv-delivery.net | Not scored | all allowed | unidentified |
| 583 | xiaomi.net | Score 63 out of 100, grade C | all allowed | Akamai |
| 586 | adobedc.net | Not scored | all allowed | unidentified |
| 588 | yandexcloud.net | Not scored | all allowed | unidentified |
| 593 | t-msedge.net | Not scored | all allowed | unidentified |
| 596 | yahoodns.net | Not scored | all allowed | unidentified |
| 613 | bidswitch.net | Not scored | all allowed | unidentified |
| 618 | akamaitech.net | Not scored | all allowed | unidentified |
| 627 | googlezip.net | Not scored | all allowed | unidentified |
| 635 | att.netrefused GPTBot | Score 52 out of 100, grade D | all allowed | Next.js |
| 646 | bx-msedge.net | Not scored | all allowed | unidentified |
| 671 | ovh.net | Score 49 out of 100, grade D | all allowed | unidentified |
| 694 | typekit.net | Not scored | all allowed | unidentified |
| 698 | crwdcntrl.net | Not scored | all allowed | unidentified |
| 737 | smaato.net | Not scored | all allowed | unidentified |
| 743 | pvp.net | Not scored | all allowed | unidentified |
| 766 | adform.net | Score 7 out of 100, grade F, partial assessment | 11 blocked | unidentified |
| 773 | singular.net | Score 95 out of 100, grade A | all allowed | HubSpot CMS . Cloudflare |
| 786 | bunnyinfra.net | Not scored | all allowed | unidentified |
| 799 | a-mo.net | Score 45 out of 100, grade D | all allowed | Amazon CloudFront |
| 803 | b-msedge.net | Not scored | all allowed | unidentified |
| 810 | daum.net | Score 7 out of 100, grade F, partial assessment | 11 blocked | unidentified |
| 822 | ln-msedge.net | Not scored | all allowed | unidentified |
| 830 | sc-cdn.net | Not scored | all allowed | unidentified |
| 840 | msftauth.net | Not scored | all allowed | unidentified |
| 842 | recaptcha.net | Not scored | all allowed | unidentified |
| 868 | sentinelone.net | Not scored | all allowed | unidentified |
| 874 | azure-devices.net | Not scored | all allowed | unidentified |
| 881 | hstgr.net | Score 7 out of 100, grade F, partial assessment | 11 blocked | unidentified |
| 882 | fwmrm.netrefused GPTBot | Score 65 out of 100, grade C | all allowed | HubSpot CMS . Cloudflare |
| 884 | usgovcloudapi.net | Not scored | all allowed | unidentified |
| 900 | go-mpulse.net | Not scored | all allowed | unidentified |
| 907 | nintendo.net | Not scored | all allowed | unidentified |
| 916 | cloudsink.net | Not scored | all allowed | unidentified |
| 924 | akahost.net | Not scored | all allowed | unidentified |
| 934 | ci-servers.net | Not scored | all allowed | unidentified |
| 953 | internetwarriors.net | Score 52 out of 100, grade D | all allowed | unidentified |
| 958 | t-s1-msedge.net | Not scored | all allowed | unidentified |
| 980 | themeforest.net | Score 74 out of 100, grade C | all allowed | Cloudflare |
| 989 | pixiv.net | Score 55 out of 100, grade D, partial assessment | 5 blocked | Cloudflare |
| 995 | mozilla.net | Not scored | all allowed | unidentified |
| 1000 | zenecn.net | Not scored | all allowed | unidentified |
| 1016 | ddns.net | Score 56 out of 100, grade D | all allowed | unidentified |
| 1018 | samsungcloudsolution.net | Not scored | all allowed | unidentified |
| 1051 | webhostbox.net | Not scored | all allowed | unidentified |
| 1072 | zpath.net | Not scored | all allowed | unidentified |
| 1105 | ovscdns.net | Not scored | all allowed | unidentified |
| 1107 | yastatic.net | Score 55 out of 100, grade D | all allowed | unidentified |
| 1115 | contentsquare.net | Not scored | all allowed | unidentified |
| 1117 | incapdns.net | Not scored | all allowed | unidentified |
| 1137 | he.net | Score 61 out of 100, grade C | all allowed | unidentified |
| 1145 | bitdefender.net | Score 75 out of 100, grade B | all allowed | Adobe Experience Manager . Cloudflare |
| 1159 | cspserver.net | Not scored | all allowed | unidentified |
| 1169 | msauth.net | Not scored | all allowed | unidentified |
| 1201 | vnexpress.net | Score 64 out of 100, grade C | 4 blocked | unidentified |
| 1219 | vscode-cdn.net | Not scored | all allowed | unidentified |
| 1228 | furaffinity.netrefused GPTBot | Score 7 out of 100, grade F, partial assessment | 11 blocked | Cloudflare |
| 1229 | nsone.net | Score 45 out of 100, grade D | all allowed | Fastly |
| 1232 | px-cloud.net | Not scored | all allowed | unidentified |
| 1233 | fanfiction.net | Not scored | all allowed | unidentified |
| 1253 | wordwall.netrefused GPTBot | Score 83 out of 100, grade B, partial assessment | all allowed | Azure Front Door |
| 1308 | blackberry.net | Score 53 out of 100, grade D | all allowed | unidentified |
| 1317 | e621.net | Score 54 out of 100, grade D | 4 blocked | Cloudflare |
| 1322 | rackspace.net | Not scored | all allowed | unidentified |
| 1332 | calculator.net | Score 64 out of 100, grade C | all allowed | unidentified |
| 1345 | hollywoodbets.netrefused GPTBot | Score 83 out of 100, grade B, partial assessment | all allowed | Cloudflare |
| 1348 | azure.net | Not scored | all allowed | unidentified |
| 1350 | jalan.net | Score 64 out of 100, grade C | all allowed | unidentified |
| 1373 | fdown.netrefused GPTBot | Score 100 out of 100, grade A, partial assessment | all allowed | Cloudflare |
| 1425 | zedge.net | Score 64 out of 100, grade C | 1 blocked | Next.js . Cloudflare |
| 1433 | carsensor.net | Score 71 out of 100, grade C | all allowed | unidentified |
| 1455 | everesttech.net | Not scored | all allowed | unidentified |
| 1473 | eenadu.netrefused GPTBot | Score 48 out of 100, grade D | 9 blocked | Amazon CloudFront |
| 1481 | ficbook.netrefused GPTBot | Score 83 out of 100, grade B, partial assessment | all allowed | Cloudflare |
| 1485 | cityheaven.net | Score 83 out of 100, grade B, partial assessment | all allowed | unidentified |
| 1502 | apigee.net | Not scored | all allowed | unidentified |
| 1503 | dogdrip.netrefused GPTBot | Score 33 out of 100, grade F | 5 blocked | Cloudflare |
| 1505 | iporntv.net | Score 56 out of 100, grade D | all allowed | Cloudflare |
| 1518 | programme-tv.net | Score 81 out of 100, grade B | all allowed | unidentified |
| 1527 | theqoo.net | Score 59 out of 100, grade D | all allowed | Cloudflare |
| 1529 | tokyomotion.net | Score 56 out of 100, grade D | all allowed | unidentified |
| 1556 | therapservices.net | Score 91 out of 100, grade A | all allowed | WordPress . Cloudflare |
| 1559 | girlschannel.net | Score 64 out of 100, grade C | all allowed | unidentified |
| 1593 | pussyboy.net | Score 56 out of 100, grade D | all allowed | Cloudflare |
| 1622 | czbooks.netrefused GPTBot | Score 83 out of 100, grade B, partial assessment | all allowed | Cloudflare |
| 1633 | savefrom.net | Score 71 out of 100, grade C | all allowed | Cloudflare |
| 1656 | xpaja.net | Score 71 out of 100, grade C | all allowed | unidentified |
| 1674 | desiviral.netrefused GPTBot | Score 66 out of 100, grade C, partial assessment | 5 blocked | Cloudflare |
| 1684 | eroterest.net | Not scored | all allowed | unidentified |
| 1717 | kinnser.net | Score 52 out of 100, grade D | all allowed | unidentified |
| 1729 | gree-apps.net | Not scored | all allowed | unidentified |
| 1764 | gree-pf.net | Not scored | all allowed | unidentified |
| 1784 | threads.net | Score 17 out of 100, grade F, partial assessment | 11 blocked | unidentified |
| 1788 | inleed.netrefused GPTBot | Score 56 out of 100, grade D | all allowed | unidentified |
| 1812 | sendgrid.net | Not scored | all allowed | unidentified |
| 1813 | secureserver.net | Score 7 out of 100, grade F, partial assessment | 11 blocked | unidentified |
| 1815 | nelreports.net | Not scored | all allowed | unidentified |
| 1821 | edgecastdns.net | Not scored | all allowed | unidentified |
| 1837 | ns1p.net | Not scored | all allowed | unidentified |
| 1840 | liquipedia.netrefused GPTBot | Score 72 out of 100, grade C, partial assessment | 4 blocked | unidentified |
| 1846 | cloudfunctions.net | Not scored | all allowed | unidentified |
| 1866 | battle.net | Not scored | all allowed | unidentified |
| 1869 | footmercato.net | Score 83 out of 100, grade B | all allowed | Varnish |
| 1884 | artfight.netrefused GPTBot | Score 39 out of 100, grade F, partial assessment | 7 blocked | Cloudflare |
| 1907 | azure-api.net | Not scored | all allowed | unidentified |
| 1921 | taktube.net | Score 80 out of 100, grade B | all allowed | WordPress |
| 1926 | restream-media.net | Not scored | all allowed | unidentified |
| 1947 | ad-delivery.net | Score 49 out of 100, grade D | all allowed | Cloudflare |
| 1956 | sexmupxinh.netrefused GPTBot | Score 100 out of 100, grade A, partial assessment | all allowed | Cloudflare |
| 1965 | dkitrxmdwoqruvsi.net | Not scored | all allowed | unidentified |
| 1999 | nezakr.netrefused GPTBot | Score 89 out of 100, grade B, partial assessment | all allowed | Cloudflare |
| 2007 | appier.net | Score 67 out of 100, grade C | all allowed | HubSpot CMS . Cloudflare |
| 2008 | lectormangass.netrefused GPTBot | Score 58 out of 100, grade D | 6 blocked | Cloudflare |
| 2040 | zenlogic.net | Not scored | all allowed | unidentified |
| 2091 | iponweb.net | Score 48 out of 100, grade D | all allowed | unidentified |
| 2095 | virtualearth.net | Score 48 out of 100, grade D | all allowed | unidentified |
| 2129 | ak-is2.net | Not scored | all allowed | unidentified |
| 2130 | bing.net | Not scored | all allowed | unidentified |
| 2141 | in.net | Not scored | all allowed | unidentified |
| 2147 | fb-t-msedge.net | Not scored | all allowed | unidentified |
| 2169 | usgovtrafficmanager.net | Not scored | all allowed | unidentified |
| 2180 | av380.net | Score 48 out of 100, grade D | all allowed | unidentified |
| 2233 | edu-servers.net | Not scored | all allowed | unidentified |
| 2234 | chartbeat.net | Score 83 out of 100, grade B | all allowed | WordPress . Fastly |
| 2236 | algolia.net | Not scored | all allowed | unidentified |
| 2239 | gmoregistry.net | Score 59 out of 100, grade D | all allowed | Cloudflare |
| 2248 | savvis.net | Score 63 out of 100, grade C | all allowed | Adobe Experience Manager . Fastly |
| 2256 | mradx.net | Not scored | all allowed | unidentified |
| 2264 | im-apps.net | Score 49 out of 100, grade D | all allowed | Google Cloud / GFE |
| 2277 | e-msedge.net | Not scored | all allowed | unidentified |
| 2288 | msappproxy.net | Not scored | all allowed | unidentified |
| 2297 | mintegral.net | Score 56 out of 100, grade D | all allowed | Nuxt . Amazon CloudFront |
| 2303 | secu100.net | Not scored | all allowed | unidentified |
| 2311 | smi2.net | Score 59 out of 100, grade D | all allowed | Next.js |
| 2333 | semasio.net | Not scored | all allowed | unidentified |
| 2338 | earthlink.netrefused GPTBot | Score 83 out of 100, grade B, partial assessment | all allowed | Cloudflare |
| 2339 | stratoserver.net | Not scored | all allowed | unidentified |
| 2340 | mozgcp.net | Not scored | all allowed | unidentified |
Showing the 200 most-visited.
Using these figures
Free to reuse in research, journalism or a product under CC BY 4.0, with credit to Fidget Labs BV. Quote the measurement date so the claim stays checkable as the index moves.
CrawlIndex by Fidget Labs BV. "Agent readiness on .net." https://crawlindex.org (measured 2026-08-09). Licensed CC BY 4.0.