crawlindex

Search the index. A domain that is not here can still be measured live on the check page.

Tranco rank 4,837

amazon.ie

amazon.ie scores 16 out of 100 for agent readiness. It blocks 10 of 11 answer-surface AI crawlers.

Score 16 out of 100, grade F, partial assessment

Measured

Last measured
2026-11-07 09:05 UTC
First seen
2026-11-02
Rubric / probe
v2.0.0 / v3.0.0
VantageWhere the request came from. Origins serve differently by geography and IP reputation, so an observation is only comparable with another taken from the same place. Everything here is measured from GitHub runners in the US and EU. More
gha-ubuntu

Policy postureWhether anyone actually decided. Deliberate means robots.txt names AI crawlers by token. Inherited means it names none, so whatever AI policy exists is a side effect of generic rules. Blanket means one rule for everyone. Absent means no robots.txt at all. More

Deliberate

robots.txt names AI crawlers by token. Somebody at this organisation decided what AI systems may do with the site.

Access archetypeThe shape of the policy rather than its size. Open, no training, assistant only, selective, walled, metered, or undeclared. More

Selective

Some answer-surface crawlers are blocked and others are not.

Served through Akamai. Compare against everything else on the same stack.

We were served a wall, not the siteA homepage that answered with under 5,000 bytes and no readable text. That is an anti-automation placeholder served to our crawler, not the site. Everything derived from it is discarded rather than counted against the operator. More

The homepage answered HTTP 200 with 2,161 bytes and no extractable text. That is a stub served to our crawler, not a page, so nothing derived from it is charged to the site. Everything that would be read from that response describes an anti-automation placeholder rather than anything amazon.ie publishes, so those checks were excluded and the score renormalised over what remained. Charging them to the site would be a claim about a page it never served us.

How this score is made up

Points earned in each score band
BandEarnedAvailableNominal maximum
Agent access4.73845
Machine-readable surface31125
Content structure0030

Agent access4.7 / 38

  • Answer-surface crawlers allowed. 10 of 11 blocked: GPTBot, OAI-SearchBot, ChatGPT-User, ClaudeBot, Claude-User, Claude-SearchBot, PerplexityBot, Perplexity-User, Google-Extended, meta-externalagent.
  • Secondary crawlers allowed. 9 of 12 blocked: CCBot, Bytespider, cohere-ai, MistralAI-User, YouBot, DuckAssistBot, Diffbot, Google-NotebookLM, TavilyBot.
  • Serves crawlers the same content. Not assessed. There is no clean baseline to compare against, because the homepage answered with 2,161 bytes and no extractable text, which is a stub served to our crawler rather than the site.

Machine-readable surface3 / 11

  • robots.txt published. robots.txt is present and parseable.
  • Sitemap declared in robots.txt. robots.txt does not declare a sitemap.
  • llms.txt published. Not assessed. /llms.txt could not be read cleanly, because the homepage answered with 2,161 bytes and no extractable text, which is a stub served to our crawler rather than the site.
  • agents.md published. Not assessed. /agents.md could not be read cleanly, because the homepage answered with 2,161 bytes and no extractable text, which is a stub served to our crawler rather than the site.
  • Licence terms declared. No RSL License directive and no licence link relation. Reuse terms are undeclared.
  • Granular usage preferences declared. No Content-Signal directive. Policy is expressed only as allow or deny.
  • Agent card published. Not assessed. /.well-known/agent-card.json could not be read cleanly, because the homepage answered with 2,161 bytes and no extractable text, which is a stub served to our crawler rather than the site.

Content structurenot assessed

  • Organization schema. Not assessed, because the homepage answered with 2,161 bytes and no extractable text, which is a stub served to our crawler rather than the site.
  • WebSite schema. Not assessed, because the homepage answered with 2,161 bytes and no extractable text, which is a stub served to our crawler rather than the site.
  • Additional structured data. Not assessed, because the homepage answered with 2,161 bytes and no extractable text, which is a stub served to our crawler rather than the site.
  • Readable without JavaScript. Not assessed, because the homepage answered with 2,161 bytes and no extractable text, which is a stub served to our crawler rather than the site.
  • Single top-level heading. Not assessed, because the homepage answered with 2,161 bytes and no extractable text, which is a stub served to our crawler rather than the site.
  • Semantic landmarks. Not assessed, because the homepage answered with 2,161 bytes and no extractable text, which is a stub served to our crawler rather than the site.
  • Dateline declared. Not assessed, because the homepage answered with 2,161 bytes and no extractable text, which is a stub served to our crawler rather than the site.
  • Authorship declared. Not assessed, because the homepage answered with 2,161 bytes and no extractable text, which is a stub served to our crawler rather than the site.

What would move this score

The observable checks that did not earn full marks, heaviest first. Only these; a check we could not observe is not on the list, because it is not a fact about the site.

  1. +27.3Answer-surface crawlers allowed. 10 of 11 blocked: GPTBot, OAI-SearchBot, ChatGPT-User, ClaudeBot, Claude-User, Claude-SearchBot, PerplexityBot, Perplexity-User, Google-Extended, meta-externalagent.
  2. +6Secondary crawlers allowed. 9 of 12 blocked: CCBot, Bytespider, cohere-ai, MistralAI-User, YouBot, DuckAssistBot, Diffbot, Google-NotebookLM, TavilyBot.
  3. +4Sitemap declared in robots.txt. robots.txt does not declare a sitemap.
  4. +2Licence terms declared. No RSL License directive and no licence link relation. Reuse terms are undeclared.
  5. +2Granular usage preferences declared. No Content-Signal directive. Policy is expressed only as allow or deny.

Extraction profile

How cheap this page is for a retrieval pipeline to chunk. Recorded and published, deliberately not scored: it describes a shape rather than a pass or a fail, and compressing it into the grade would destroy the useful part.

Server text
0 chars
Text density
0%
Subheadings
0
Lists
0
Tables
0
Feed
no

Crawler policy

Read from amazon.ie/robots.txt. A crawler is listed as blocked when the rules deny it the site root. This operator names 19 AI crawlers explicitly, which means the policy is deliberate rather than inherited from a wildcard rule.

AI crawler access policy for amazon.ie
CrawlerOperatorTierNamedStatus
GPTBotOpenAI1yesBlocked
OAI-SearchBotOpenAI1yesBlocked
ChatGPT-UserOpenAI1yesBlocked
ClaudeBotAnthropic1yesBlocked
Claude-UserAnthropic1yesBlocked
Claude-SearchBotAnthropic1yesBlocked
PerplexityBotPerplexity1yesBlocked
Perplexity-UserPerplexity1yesBlocked
Google-ExtendedGoogle1yesBlocked
Applebot-ExtendedApple1noAllowed
meta-externalagentMeta1yesBlocked
CCBotCommon Crawl2yesBlocked
AmazonbotAmazon2noAllowed
BytespiderByteDance2yesBlocked
cohere-aiCohere2yesBlocked
MistralAI-UserMistral2yesBlocked
YouBotYou.com2yesBlocked
DuckAssistBotDuckDuckGo2yesBlocked
kagi-fetcherKagi2noAllowed
DiffbotDiffbot2yesBlocked
Google-NotebookLMGoogle2yesBlocked
TavilyBotTavily2yesBlocked
FirecrawlAgentFirecrawl2noAllowed

No mark at this score

The embeddable mark starts at grade B, because offering a graphic nobody would put on their own site is a pretence rather than a feature. The list above is the useful version: for most sites the points are concentrated in two or three changes. How the mark works.

CrawlIndex mark for amazon.ie, score 16

The neutral mark above exists and is free to use if you want to show that the site is independently measured whatever the number says.

This measurement as JSON

crawl 2026-11-07 09:39 UTCprobe 3.0.0rubric 2.0.0registry 1.0.0vantage gha-ubuntu3,642 of 5,006 reachable

Using these figures

Free to reuse in research, journalism or a product under CC BY 4.0, with credit to Fidget Labs BV. Quote the measurement date so the claim stays checkable as the index moves.

CrawlIndex by Fidget Labs BV. "amazon.ie agent readiness." https://crawlindex.org (measured 2026-11-07). Licensed CC BY 4.0.