crawlindex

Search the index. A domain that is not here can still be measured live on the check page.

Tranco rank 5,110

michelin.com

michelin.com scores 58 out of 100 for agent readiness. It allows every answer-surface AI crawler.

Score 58 out of 100, grade D, partial assessment

Measured

Last measured
2026-10-11 09:28 UTC
First seen
2026-10-05
Rubric / probe
v2.0.0 / v3.0.0
VantageWhere the request came from. Origins serve differently by geography and IP reputation, so an observation is only comparable with another taken from the same place. Everything here is measured from GitHub runners in the US and EU. More
gha-ubuntu

Policy postureWhether anyone actually decided. Deliberate means robots.txt names AI crawlers by token. Inherited means it names none, so whatever AI policy exists is a side effect of generic rules. Blanket means one rule for everyone. Absent means no robots.txt at all. More

Absent

No robots.txt. Crawler policy is undeclared, so every crawler applies its own default.

Access archetypeThe shape of the policy rather than its size. Open, no training, assistant only, selective, walled, metered, or undeclared. More

Undeclared

No robots.txt, so nothing is stated either way.

Built on Astro, served through Azure Front Door. Compare against everything else on the same stack.

How this score is made up

Points earned in each score band
BandEarnedAvailableNominal maximum
Agent access383845
Machine-readable surface02525
Content structure163030

Agent access38 / 38

  • Answer-surface crawlers allowed. All 11 answer-surface crawlers are allowed.
  • Secondary crawlers allowed. All 12 secondary crawlers are allowed.
  • Serves crawlers the same content. Comparison did not complete.

Machine-readable surface0 / 25

  • robots.txt published. No robots.txt. Crawler policy is undeclared.
  • Sitemap declared in robots.txt. robots.txt does not declare a sitemap.
  • llms.txt published. No /llms.txt.
  • agents.md published. No /agents.md.
  • Licence terms declared. No RSL License directive and no licence link relation. Reuse terms are undeclared.
  • Granular usage preferences declared. No Content-Signal directive. Policy is expressed only as allow or deny.
  • Agent card published. No agent card at /.well-known/agent-card.json.

Content structure16 / 30

  • Organization schema. Organization JSON-LD lets an agent resolve who publishes this site.
  • WebSite schema. No WebSite JSON-LD.
  • Additional structured data. No further JSON-LD types on the homepage.
  • Readable without JavaScript. 5,049 characters of text in the server response. Most crawlers do not execute JavaScript.
  • Single top-level heading. 0 h1 elements found.
  • Semantic landmarks. Uses main, nav, header, footer, aside.
  • Dateline declared. No machine-readable date. An agent cannot tell how current this page is.
  • Authorship declared. No declared author. An agent quoting this page has nobody to credit.

What would move this score

The observable checks that did not earn full marks, heaviest first. Only these; a check we could not observe is not on the list, because it is not a fact about the site.

  1. +9llms.txt published. No /llms.txt.
  2. +4Sitemap declared in robots.txt. robots.txt does not declare a sitemap.
  3. +4agents.md published. No /agents.md.
  4. +3robots.txt published. No robots.txt. Crawler policy is undeclared.
  5. +3WebSite schema. No WebSite JSON-LD.
  6. +3Additional structured data. No further JSON-LD types on the homepage.
  7. +3Single top-level heading. 0 h1 elements found.
  8. +3Dateline declared. No machine-readable date. An agent cannot tell how current this page is.

Extraction profile

How cheap this page is for a retrieval pipeline to chunk. Recorded and published, deliberately not scored: it describes a shape rather than a pass or a fail, and compressing it into the grade would destroy the useful part.

Server text
5,049 chars
Text density
1%
Subheadings
6
Lists
24
Tables
0
Feed
no

Crawler policy

Read from michelin.com/robots.txt. A crawler is listed as blocked when the rules deny it the site root. This operator names no AI crawler explicitly.

AI crawler access policy for michelin.com
CrawlerOperatorTierNamedStatus
GPTBotOpenAI1noAllowed
OAI-SearchBotOpenAI1noAllowed
ChatGPT-UserOpenAI1noAllowed
ClaudeBotAnthropic1noAllowed
Claude-UserAnthropic1noAllowed
Claude-SearchBotAnthropic1noAllowed
PerplexityBotPerplexity1noAllowed
Perplexity-UserPerplexity1noAllowed
Google-ExtendedGoogle1noAllowed
Applebot-ExtendedApple1noAllowed
meta-externalagentMeta1noAllowed
CCBotCommon Crawl2noAllowed
AmazonbotAmazon2noAllowed
BytespiderByteDance2noAllowed
cohere-aiCohere2noAllowed
MistralAI-UserMistral2noAllowed
YouBotYou.com2noAllowed
DuckAssistBotDuckDuckGo2noAllowed
kagi-fetcherKagi2noAllowed
DiffbotDiffbot2noAllowed
Google-NotebookLMGoogle2noAllowed
TavilyBotTavily2noAllowed
FirecrawlAgentFirecrawl2noAllowed

Recorded changes

No mark at this score

The embeddable mark starts at grade B, because offering a graphic nobody would put on their own site is a pretence rather than a feature. The list above is the useful version: for most sites the points are concentrated in two or three changes. How the mark works.

CrawlIndex mark for michelin.com, score 58

The neutral mark above exists and is free to use if you want to show that the site is independently measured whatever the number says.

This measurement as JSON

crawl 2026-10-11 09:44 UTCprobe 3.0.0rubric 2.0.0registry 1.0.0vantage gha-ubuntu3,660 of 5,006 reachable

Using these figures

Free to reuse in research, journalism or a product under CC BY 4.0, with credit to Fidget Labs BV. Quote the measurement date so the claim stays checkable as the index moves.

CrawlIndex by Fidget Labs BV. "michelin.com agent readiness." https://crawlindex.org (measured 2026-10-11). Licensed CC BY 4.0.