Leaderboard
Who is ready for agents, and who is not
Ranked by the CrawlIndex Score across 2,567 fully measured sites. One row per operator, because a company publishing the same policy on twenty country domains is one fact rather than twenty.
| Score band | Sites |
|---|---|
| 0 to 9 | 0 |
| 10 to 19 | 3 |
| 20 to 29 | 18 |
| 30 to 39 | 33 |
| 40 to 49 | 251 |
| 50 to 59 | 755 |
| 60 to 69 | 775 |
| 70 to 79 | 451 |
| 80 to 89 | 266 |
| 90 to 99 | 15 |
448 sites score 75 or above and qualify for the Agent Friendly mark or better. The rest of the distribution sits in the middle: not hostile to agents, just never set up for them.
Only fully measured sites appear here. are renormalised over fewer points, so putting one in the same column would compare two different scales. Sites served a Partial assessments
Some checks could not be observed, usually because a bot wall answered instead of the site, so those points were removed from the total rather than failed. The remaining points are renormalised to one hundred. A partial score is not comparable with a complete one, which is why partial sites are kept out of ranked lists. More are partial by definition, which is why some very large names are absent.stub response
A homepage that answered with under 5,000 bytes and no readable text. That is an anti-automation placeholder served to our crawler, not the site. Everything derived from it is discarded rather than counted against the operator. More
Looking for one domain rather than a ranking? Press / or use search.
Most agent-ready
Open to the crawlers that answer questions, publishing something machine-readable, and serving content a crawler can read without running JavaScript.
| Rank | Domain | Score | Policy | Stack |
|---|---|---|---|---|
| -- | crawlindex.org | Score 95 out of 100, grade A | OpenInherited | Next.js . Vercel |
| 2079 | yotpo.com | Score 93 out of 100, grade A | OpenDeliberate | WordPress . Amazon CloudFront |
| 2551 | railway.app | Score 92 out of 100, grade A | OpenInherited | unidentified |
| 1414 | protothema.gr | Score 91 out of 100, grade A | OpenInherited | unidentified |
| 2649 | woocommerce.com | Score 91 out of 100, grade A | OpenInherited | WooCommerce |
| 2666 | cookieyes.com | Score 91 out of 100, grade A | OpenDeliberate | Drupal . Cloudflare |
| 2688 | crazyegg.com | Score 91 out of 100, grade A | OpenDeliberate | Cloudflare |
| 3167 | duosecurity.com | Score 91 out of 100, grade A | OpenInherited | Amazon CloudFront |
| 3201 | mountain.com | Score 91 out of 100, grade A | OpenInherited | WordPress . Cloudflare |
| 3836 | elevenlabs.io | Score 91 out of 100, grade A | OpenInherited | Next.js . Google Cloud / GFE |
| 4076 | helpshift.com | Score 91 out of 100, grade A | OpenInherited | WordPress . Cloudflare |
| 4284 | netlify.comand 1 more domain with the same policy | Score 91 out of 100, grade A | OpenDeliberate | Astro . Netlify |
| 4568 | adspower.net | Score 91 out of 100, grade A | OpenInherited | Amazon CloudFront |
| 1562 | therapservices.net | Score 90 out of 100, grade A | OpenDeliberate | WordPress . Cloudflare |
| 2797 | redis.io | Score 90 out of 100, grade A | OpenDeliberate | Sanity . Cloudflare |
| 48 | wordpress.organd 1 more domain with the same policy | Score 89 out of 100, grade B | OpenDeliberate | WordPress |
| 334 | hostinger.com | Score 89 out of 100, grade B | OpenDeliberate | Nuxt . Cloudflare |
| 368 | zendesk.com | Score 89 out of 100, grade B | OpenInherited | Next.js . Cloudflare |
| 501 | dynatrace.com | Score 89 out of 100, grade B | OpenInherited | Nuxt . Amazon CloudFront |
| 515 | foxnews.com | Score 89 out of 100, grade B | OpenInherited | Fastly |
| 625 | atlassian.comand 1 more domain with the same policy | Score 89 out of 100, grade B | OpenInherited | Amazon CloudFront |
| 638 | branch.io | Score 89 out of 100, grade B | OpenDeliberate | WordPress . Cloudflare |
| 669 | stackadapt.com | Score 89 out of 100, grade B | OpenInherited | WordPress |
| 785 | singular.net | Score 89 out of 100, grade B | OpenDeliberate | HubSpot CMS . Cloudflare |
| 1031 | cloudinary.com | Score 89 out of 100, grade B | OpenInherited | WordPress . Cloudflare |
| 1259 | edna.ru | Score 89 out of 100, grade B | OpenInherited | WordPress |
| 1532 | musicdel.ir | Score 89 out of 100, grade B | OpenInherited | WordPress |
| 1924 | iubenda.com | Score 89 out of 100, grade B | OpenInherited | WordPress . Bunny |
| 2284 | brightspace.com | Score 89 out of 100, grade B | OpenDeliberate | WordPress . Cloudflare |
| 2462 | pubnative.net | Score 89 out of 100, grade B | OpenInherited | WordPress . Cloudflare |
| 2837 | protectmyapp.com | Score 89 out of 100, grade B | OpenInherited | WordPress |
| 3133 | vercel.com | Score 89 out of 100, grade B | OpenInherited | Next.js . Vercel |
| 3367 | iterable.com | Score 89 out of 100, grade B | OpenInherited | WordPress . Fastly |
| 3564 | sardine.ai | Score 89 out of 100, grade B | OpenInherited | Sanity . Vercel |
| 3678 | demandbase.com | Score 89 out of 100, grade B | OpenInherited | WordPress . Cloudflare |
| 4065 | tum.de | Score 89 out of 100, grade B | OpenInherited | TYPO3 |
| 4090 | ably.io | Score 89 out of 100, grade B | OpenInherited | Gatsby . Cloudflare |
| 4127 | signifyd.com | Score 89 out of 100, grade B | OpenInherited | WordPress . Cloudflare |
| 4644 | salesmartly.com | Score 89 out of 100, grade B | OpenInherited | Next.js . Amazon CloudFront |
| 4662 | popsci.com | Score 89 out of 100, grade B | OpenInherited | WordPress |
| 4852 | cyberfolks.pl | Score 89 out of 100, grade B | OpenInherited | WordPress |
| 4990 | magnite.com | Score 89 out of 100, grade B | OpenInherited | WordPress . Cloudflare |
| 662 | intercom.ioand 1 more domain with the same policy | Score 88 out of 100, grade B | OpenInherited | Next.js . Amazon CloudFront |
| 1174 | auth0.com | Score 88 out of 100, grade B | OpenInherited | Next.js . Cloudflare |
| 1423 | utorrent.com | Score 88 out of 100, grade B | OpenDeliberate | Gatsby . Amazon CloudFront |
| 1521 | wpastra.com | Score 88 out of 100, grade B | OpenInherited | HubSpot CMS . Cloudflare |
| 1857 | livechatinc.com | Score 88 out of 100, grade B | OpenInherited | HubSpot CMS . Akamai |
| 1918 | mindbox.ru | Score 88 out of 100, grade B | OpenDeliberate | unidentified |
| 2199 | cookiebot.com | Score 88 out of 100, grade B | OpenInherited | WordPress . Cloudflare |
| 2957 | zapier.com | Score 88 out of 100, grade B | OpenDeliberate | Contentful . Amazon CloudFront |
| 3065 | dnsimple.com | Score 88 out of 100, grade B | OpenInherited | unidentified |
| 3080 | intercomcdn.com | Score 88 out of 100, grade B | OpenInherited | Next.js . Amazon CloudFront |
| 3298 | walkme.com | Score 88 out of 100, grade B | OpenInherited | WordPress |
| 3589 | domaintools.com | Score 88 out of 100, grade B | OpenInherited | Cloudflare |
| 3658 | colorlib.com | Score 88 out of 100, grade B | OpenInherited | WordPress . Cloudflare |
| 4128 | elespanol.com | Score 88 out of 100, grade B | OpenInherited | unidentified |
| 4411 | livechat.com | Score 88 out of 100, grade B | OpenInherited | HubSpot CMS . Akamai |
| 4546 | tanium.com | Score 88 out of 100, grade B | OpenDeliberate | Sanity . Cloudflare |
| 271 | forter.com | Score 87 out of 100, grade B | No trainingDeliberate | HubSpot CMS . Cloudflare |
| 1927 | moengage.com | Score 87 out of 100, grade B | OpenInherited | WordPress . Cloudflare |
| 3391 | razorpay.com | Score 87 out of 100, grade B | OpenDeliberate | Framer . Amazon CloudFront |
| 3884 | adsbynimbus.com | Score 87 out of 100, grade B | OpenInherited | Cloudflare |
| 3901 | openrouter.ai | Score 87 out of 100, grade B | OpenInherited | Next.js . Cloudflare |
| 3929 | complianz.io | Score 87 out of 100, grade B | OpenInherited | HubSpot CMS . Cloudflare |
| 95 | samsung.com | Score 86 out of 100, grade B | OpenDeliberate | Adobe Experience Manager . Akamai |
| 595 | klaviyo.com | Score 86 out of 100, grade B | OpenDeliberate | HubSpot CMS . Cloudflare |
| 624 | onetrust.com | Score 86 out of 100, grade B | OpenInherited | Adobe Experience Manager . Cloudflare |
| 763 | gumgum.com | Score 86 out of 100, grade B | OpenDeliberate | Cloudflare |
| 1378 | haberler.com | Score 86 out of 100, grade B | OpenDeliberate | Cloudflare |
| 1510 | sondakika.com | Score 86 out of 100, grade B | OpenDeliberate | Cloudflare |
| 2036 | datto.com | Score 86 out of 100, grade B | OpenInherited | WordPress . Cloudflare |
| 2059 | primis.tech | Score 86 out of 100, grade B | OpenInherited | HubSpot CMS . Amazon CloudFront |
| 2192 | useinsider.com | Score 86 out of 100, grade B | OpenInherited | HubSpot CMS . Cloudflare |
| 2436 | urbanairship.com | Score 86 out of 100, grade B | OpenInherited | WordPress . Fastly |
| 2697 | nsw.gov.au | Score 86 out of 100, grade B | OpenInherited | Drupal . Amazon CloudFront |
| 2799 | cutt.ly | Score 86 out of 100, grade B | OpenInherited | Cloudflare |
| 3056 | libsyn.com | Score 86 out of 100, grade B | OpenInherited | WordPress . Cloudflare |
| 3112 | egnyte.com | Score 86 out of 100, grade B | OpenInherited | Drupal . Akamai |
| 3173 | malwarebytes.com | Score 86 out of 100, grade B | OpenDeliberate | WordPress |
| 3337 | cldin.eu | Score 86 out of 100, grade B | OpenInherited | HubSpot CMS |
| 3387 | ip.sb | Score 86 out of 100, grade B | OpenInherited | Cloudflare |
| 3419 | giantpanda.com | Score 86 out of 100, grade B | OpenDeliberate | Next.js . Vercel |
| 3579 | drpc.org | Score 86 out of 100, grade B | OpenDeliberate | Next.js . Cloudflare |
| 3599 | dinahosting.com | Score 86 out of 100, grade B | OpenDeliberate | unidentified |
| 3644 | fox.com | Score 86 out of 100, grade B | OpenInherited | Next.js . Fastly |
| 3800 | jumpcloud.com | Score 86 out of 100, grade B | OpenInherited | WordPress . Amazon CloudFront |
| 3993 | razer.com | Score 86 out of 100, grade B | OpenDeliberate | Cloudflare |
| 3995 | xe.com | Score 86 out of 100, grade B | OpenInherited | Contentful . Amazon CloudFront |
| 4229 | similarweb.com | Score 86 out of 100, grade B | OpenInherited | WordPress . Amazon CloudFront |
| 4277 | termly.io | Score 86 out of 100, grade B | OpenDeliberate | WordPress . Cloudflare |
| 4382 | livemint.com | Score 86 out of 100, grade B | OpenDeliberate | Next.js . Akamai |
| 4486 | rtbhouse.com | Score 86 out of 100, grade B | OpenInherited | Next.js . Google Cloud / GFE |
| 4705 | kayak.com | Score 86 out of 100, grade B | OpenDeliberate | Fastly |
| 2 | cloudflare.com | Score 85 out of 100, grade B | OpenDeliberate | Astro . Cloudflare |
| 92 | opera.com | Score 85 out of 100, grade B | OpenInherited | unidentified |
| 1014 | onesignal.com | Score 85 out of 100, grade B | OpenInherited | Cloudflare |
| 1088 | supabase.co | Score 85 out of 100, grade B | OpenDeliberate | Next.js . Vercel |
| 1756 | sambad.com | Score 85 out of 100, grade B | OpenInherited | Cloudflare |
| 1765 | xvideo.vlog.br | Score 85 out of 100, grade B | OpenInherited | WordPress . Cloudflare |
| 1813 | rapid7.com | Score 85 out of 100, grade B | OpenInherited | Next.js . Cloudflare |
Least agent-ready
A low score here is not an accusation of bad faith. Most of these sites blocked nothing deliberately. Someone else usually decided.
| Rank | Domain | Score | Policy | Stack |
|---|---|---|---|---|
| 54 | tiktok.com | Score 15 out of 100, grade F | WalledDeliberate | unidentified |
| 849 | amazon.com.auand 4 more domains with the same policy | Score 15 out of 100, grade F | SelectiveDeliberate | Amazon CloudFront |
| 277 | launchpad.net | Score 20 out of 100, grade F | SelectiveDeliberate | unidentified |
| 586 | usatoday.com | Score 24 out of 100, grade F | WalledDeliberate | unidentified |
| 1287 | themoviedb.org | Score 24 out of 100, grade F | WalledDeliberate | Amazon CloudFront |
| 1404 | dw.com | Score 24 out of 100, grade F | SelectiveDeliberate | Akamai |
| 2635 | tmdb.org | Score 24 out of 100, grade F | WalledDeliberate | Amazon CloudFront |
| 3688 | politico.eu | Score 24 out of 100, grade F | WalledDeliberate | WordPress . Cloudflare |
| 692 | dailymail.co.ukand 1 more domain with the same policy | Score 26 out of 100, grade F | WalledDeliberate | Akamai |
| 1113 | theconversation.com | Score 26 out of 100, grade F | WalledDeliberate | Next.js . Fastly |
| 1410 | iltalehti.fi | Score 26 out of 100, grade F | WalledDeliberate | Amazon CloudFront |
| 2902 | faz.net | Score 26 out of 100, grade F | SelectiveDeliberate | Nuxt |
| 1315 | f95zone.to | Score 27 out of 100, grade F | SelectiveDeliberate | Cloudflare |
| 1939 | franceinfo.fr | Score 27 out of 100, grade F | WalledDeliberate | unidentified |
| 3668 | stuff.co.nz | Score 27 out of 100, grade F | SelectiveDeliberate | Fastly |
| 2001 | nrk.no | Score 28 out of 100, grade F | SelectiveDeliberate | SvelteKit |
| 485 | cnbc.com | Score 30 out of 100, grade F | SelectiveDeliberate | Akamai |
| 890 | nbcnews.com | Score 30 out of 100, grade F | WalledDeliberate | Next.js . Akamai |
| 2781 | xnhau.xxx | Score 30 out of 100, grade F | SelectiveDeliberate | Cloudflare |
| 3357 | infojobs.net | Score 30 out of 100, grade F | WalledDeliberate | Amazon CloudFront |
| 204 | cnn.com | Score 31 out of 100, grade F | SelectiveDeliberate | Fastly |
| 1896 | mercadolibre.comand 2 more domains with the same policy | Score 31 out of 100, grade F | SelectiveDeliberate | Amazon CloudFront |
| 1905 | wikihow.com | Score 31 out of 100, grade F | SelectiveDeliberate | unidentified |
| 4865 | channel4.com | Score 31 out of 100, grade F | SelectiveDeliberate | Akamai |
| 4956 | dr.dk | Score 31 out of 100, grade F | WalledDeliberate | Next.js |
| 5002 | tds.net | Score 31 out of 100, grade F | SelectiveDeliberate | Varnish |
| 1171 | pimpbunny.com | Score 32 out of 100, grade F | SelectiveDeliberate | Cloudflare |
| 3149 | today.com | Score 32 out of 100, grade F | WalledDeliberate | Next.js . Akamai |
| 3300 | metro.co.uk | Score 32 out of 100, grade F | WalledDeliberate | WordPress |
| 2021 | ign.com | Score 33 out of 100, grade F | SelectiveDeliberate | unidentified |
| 218 | bbc.com | Score 34 out of 100, grade F | SelectiveDeliberate | Next.js . Fastly |
| 4179 | thestar.com | Score 34 out of 100, grade F | WalledDeliberate | unidentified |
| 1083 | bfmtv.com | Score 35 out of 100, grade F | WalledDeliberate | Amazon CloudFront |
| 2068 | mashable.com | Score 35 out of 100, grade F | SelectiveDeliberate | Cloudflare |
| 2368 | mparticle.com | Score 35 out of 100, grade F | SelectiveDeliberate | Next.js . Vercel |
| 3007 | asahi.com | Score 35 out of 100, grade F | WalledDeliberate | unidentified |
| 3540 | lifehacker.com | Score 35 out of 100, grade F | SelectiveDeliberate | Cloudflare |
| 4501 | 20minutes.fr | Score 35 out of 100, grade F | SelectiveDeliberate | Cloudflare |
| 2922 | chicagotribune.com | Score 36 out of 100, grade F | WalledDeliberate | WordPress |
| 3028 | thehindu.com | Score 36 out of 100, grade F | SelectiveDeliberate | Cloudflare |
| 3785 | nydailynews.com | Score 36 out of 100, grade F | WalledDeliberate | WordPress |
| 122 | amazonvideo.com | Score 37 out of 100, grade F | SelectiveDeliberate | Amazon CloudFront |
| 236 | bbc.co.uk | Score 37 out of 100, grade F | SelectiveDeliberate | Fastly |
| 621 | telegraph.co.uk | Score 37 out of 100, grade F | SelectiveDeliberate | Adobe Experience Manager . Fastly |
| 673 | primevideo.com | Score 37 out of 100, grade F | SelectiveDeliberate | Amazon CloudFront |
| 3856 | toyota.com | Score 37 out of 100, grade F | Assistant onlyDeliberate | Adobe Experience Manager . Amazon CloudFront |
| 2044 | yr.no | Score 38 out of 100, grade F | SelectiveDeliberate | unidentified |
| 2479 | vidylee.clickpolicy gap | Score 38 out of 100, grade F | UndeclaredAbsent | Cloudflare |
| 4444 | radiofrance.fr | Score 39 out of 100, grade F | SelectiveDeliberate | SvelteKit . Akamai |
| 942 | spiegel.de | Score 40 out of 100, grade D | SelectiveDeliberate | Google Cloud / GFE |
| 1220 | pandora.com | Score 40 out of 100, grade D | No trainingDeliberate | unidentified |
| 3573 | ebsco.com | Score 40 out of 100, grade D | No trainingDeliberate | Next.js . Amazon CloudFront |
| 3927 | yomiuri.co.jp | Score 40 out of 100, grade D | WalledDeliberate | WordPress . Fastly |
| 4495 | ilsole24ore.com | Score 40 out of 100, grade D | SelectiveDeliberate | Varnish |
| 161 | tumblr.compolicy gap | Score 41 out of 100, grade D | No trainingDeliberate | WordPress |
| 648 | shopee.com.brpolicy gapand 8 more domains with the same policy | Score 41 out of 100, grade D | OpenInherited | unidentified |
| 1135 | cookpad.com | Score 41 out of 100, grade D | SelectiveDeliberate | Fastly |
| 1552 | buzzfeed.com | Score 41 out of 100, grade D | SelectiveDeliberate | Fastly |
| 2195 | 1688.com | Score 41 out of 100, grade D | OpenInherited | Alibaba Cloud CDN |
| 2741 | vymanga.compolicy gap | Score 41 out of 100, grade D | OpenInherited | Cloudflare |
| 4320 | derstandard.at | Score 41 out of 100, grade D | SelectiveDeliberate | unidentified |
| 651 | withgoogle.com | Score 42 out of 100, grade D | UndeclaredAbsent | Google Cloud / GFE |
| 892 | mercadolivre.com.br | Score 42 out of 100, grade D | SelectiveDeliberate | Amazon CloudFront |
| 1047 | zhihu.compolicy gap | Score 42 out of 100, grade D | UndeclaredAbsent | unidentified |
| 1124 | gsmarena.com | Score 42 out of 100, grade D | SelectiveDeliberate | unidentified |
| 1305 | actu.fr | Score 42 out of 100, grade D | SelectiveDeliberate | Cloudflare |
| 1481 | eenadu.net | Score 42 out of 100, grade D | WalledDeliberate | Amazon CloudFront |
| 2699 | meb.gov.tr | Score 42 out of 100, grade D | SelectiveDeliberate | unidentified |
| 2755 | blacktoon417.compolicy gap | Score 42 out of 100, grade D | UndeclaredAbsent | Cloudflare |
| 2783 | blacktoon416.compolicy gap | Score 42 out of 100, grade D | UndeclaredAbsent | Cloudflare |
| 3449 | videeyss.shoppolicy gap | Score 42 out of 100, grade D | UndeclaredAbsent | Cloudflare |
| 3490 | blacktoon418.compolicy gap | Score 42 out of 100, grade D | UndeclaredAbsent | Cloudflare |
| 4742 | foreignpolicy.com | Score 42 out of 100, grade D | SelectiveDeliberate | WordPress . Cloudflare |
| 487 | statista.com | Score 43 out of 100, grade D | SelectiveDeliberate | Amazon CloudFront |
| 1613 | arabx.cam | Score 43 out of 100, grade D | No trainingDeliberate | Cloudflare |
| 3274 | thingiverse.compolicy gap | Score 43 out of 100, grade D | OpenInherited | Next.js . Cloudflare |
| 3547 | orf.at | Score 43 out of 100, grade D | Assistant onlyDeliberate | unidentified |
| 3622 | abc.es | Score 43 out of 100, grade D | SelectiveDeliberate | WordPress |
| 467 | aol.com | Score 44 out of 100, grade D | SelectiveDeliberate | Next.js . Amazon CloudFront |
| 732 | cnet.com | Score 44 out of 100, grade D | SelectiveDeliberate | WordPress |
| 853 | theverge.com | Score 44 out of 100, grade D | SelectiveDeliberate | WordPress . Fastly |
| 1858 | zdnet.com | Score 44 out of 100, grade D | SelectiveDeliberate | WordPress |
| 2232 | vox.com | Score 44 out of 100, grade D | SelectiveDeliberate | WordPress . Fastly |
| 2554 | smh.com.au | Score 44 out of 100, grade D | SelectiveDeliberate | Fastly |
| 3504 | nymag.com | Score 44 out of 100, grade D | SelectiveDeliberate | Fastly |
| 3618 | nos.nl | Score 44 out of 100, grade D | SelectiveDeliberate | Next.js . Amazon CloudFront |
| 4515 | aol.de | Score 44 out of 100, grade D | SelectiveDeliberate | Next.js . Amazon CloudFront |
| 5118 | deccanherald.com | Score 44 out of 100, grade D | SelectiveDeliberate | Cloudflare |
| 111 | nic.ru | Score 45 out of 100, grade D | UndeclaredAbsent | unidentified |
| 120 | outlook.com | Score 45 out of 100, grade D | UndeclaredAbsent | unidentified |
| 136 | reg.ru | Score 45 out of 100, grade D | UndeclaredAbsent | unidentified |
| 360 | un.orgpolicy gap | Score 45 out of 100, grade D | UndeclaredAbsent | Drupal . Amazon CloudFront |
| 822 | teads.tv | Score 45 out of 100, grade D | UndeclaredAbsent | unidentified |
| 841 | me.com | Score 45 out of 100, grade D | UndeclaredAbsent | unidentified |
| 1146 | nypost.com | Score 45 out of 100, grade D | SelectiveDeliberate | WordPress |
| 1204 | dcinside.com | Score 45 out of 100, grade D | Assistant onlyDeliberate | unidentified |
| 1290 | naukri.com | Score 45 out of 100, grade D | UndeclaredAbsent | unidentified |
| 1343 | charter.netpolicy gap | Score 45 out of 100, grade D | OpenInherited | Amazon CloudFront |
| 1494 | ioh.co.id | Score 45 out of 100, grade D | UndeclaredAbsent | Nuxt . Google Cloud / GFE |
| 1614 | colliderporn.com | Score 45 out of 100, grade D | No trainingDeliberate | unidentified |
crawl 2026-09-22 08:34 UTCprobe 3.0.0rubric 2.0.0registry 1.0.0vantage gha-ubuntu3,618 of 5,006 reachable
Using these figures
Free to reuse in research, journalism or a product under CC BY 4.0, with credit to Fidget Labs BV. Quote the measurement date so the claim stays checkable as the index moves.
CrawlIndex by Fidget Labs BV. "Agent readiness leaderboard." https://crawlindex.org (measured 2026-09-22). Licensed CC BY 4.0.