Live check
Measure any domain
Runs the same requests the nightly crawler makes and scores the result with the same rubric. Nothing is stored, and adding a domain to the nightly index is a separate, deliberate step.
Measured
thales-salata.dev
Allows all 11 answer-surface AI crawlers.
Deliberate policy . Open . Cloudflare
Ahead of 68% of the fully measured sites in the index.
| Score band | Sites |
|---|---|
| 0 to 9 | 0 |
| 10 to 19 | 4 |
| 20 to 29 | 20 |
| 30 to 39 | 33 |
| 40 to 49 | 261 |
| 50 to 59 | 745 |
| 60 to 69 | 777 |
| 70 to 79 | 469 |
| 80 to 89 | 298 |
| 90 to 99 | 17 |
| Band | Earned | Available | Nominal maximum |
|---|---|---|---|
| Agent access | 43.7 | 45 | 45 |
| Machine-readable surface | 9 | 25 | 25 |
| Content structure | 15 | 30 | 30 |
What would move this score
Observable checks that did not earn full marks, heaviest first.
- +9llms.txt published. No /llms.txt.
- +7Organization schema. No Organization JSON-LD. Agents cannot reliably attribute this site to an entity.
- +4agents.md published. No /agents.md.
- +3WebSite schema. No WebSite JSON-LD.
- +3Dateline declared. No machine-readable date. An agent cannot tell how current this page is.
- +2Licence terms declared. No RSL License directive and no licence link relation. Reuse terms are undeclared.
Every check
- Answer-surface crawlers allowed. All 11 answer-surface crawlers are allowed.
- Secondary crawlers allowed. 2 of 12 blocked: CCBot, Bytespider.
- Serves crawlers the same content. A crawler and a browser receive comparable responses.
- robots.txt published. robots.txt is present and parseable.
- Sitemap declared in robots.txt. robots.txt points crawlers at a sitemap.
- llms.txt published. No /llms.txt.
- agents.md published. No /agents.md.
- Licence terms declared. No RSL License directive and no licence link relation. Reuse terms are undeclared.
- Granular usage preferences declared. robots.txt carries Content-Signal: ai-train=no, search=yes, ai-input=yes. Preferences are stated per use rather than as a single allow or deny.
- Agent card published. No agent card at /.well-known/agent-card.json.
- Organization schema. No Organization JSON-LD. Agents cannot reliably attribute this site to an entity.
- WebSite schema. No WebSite JSON-LD.
- Additional structured data. Also declares: ProfilePage.
- Readable without JavaScript. 10,151 characters of text in the server response. Most crawlers do not execute JavaScript.
- Single top-level heading. 1 h1 element found.
- Semantic landmarks. Uses nav, header, footer, article, aside.
- Dateline declared. No machine-readable date. An agent cannot tell how current this page is.
- Authorship declared. No declared author. An agent quoting this page has nobody to credit.
Want this measured every night?
This result is not stored. The index is a defined population, the most-visited domains plus anything explicitly submitted, and it has to stay that way for any percentage on the rest of the site to mean something. Quietly adding every domain anybody typed would let one person reshape the denominator of every published figure. So adding one is a deliberate act with a public audit trail, and it takes a single click.
Add thales-salata.dev to the indexOpens a prefilled GitHub issue. Measured on tonight's crawl, then it gets a permanent page and a change history.
Measured just now, live. See the methodology for how each line is awarded, or the glossary for what the terms mean.