crawlindex

Search the index. A domain that is not here can still be measured live on the check page.

Tranco rank 2,784

xnhau.bio

xnhau.bio could not be measured on its last crawl.

Not scored
Last measured
2026-09-22 08:32 UTC
First seen
2026-08-24
Rubric / probe
v2.0.0 / v3.0.0
VantageWhere the request came from. Origins serve differently by geography and IP reputation, so an observation is only comparable with another taken from the same place. Everything here is measured from GitHub runners in the US and EU. More
gha-ubuntu

Policy postureWhether anyone actually decided. Deliberate means robots.txt names AI crawlers by token. Inherited means it names none, so whatever AI policy exists is a side effect of generic rules. Blanket means one rule for everyone. Absent means no robots.txt at all. More

Deliberate

robots.txt names AI crawlers by token. Somebody at this organisation decided what AI systems may do with the site.

Access archetypeThe shape of the policy rather than its size. Open, no training, assistant only, selective, walled, metered, or undeclared. More

Open

Every answer-surface crawler is allowed. An agent asked about this site can read it.

This domain did not respond on its last crawl, so it has no score. timeout An unreachable site is recorded as unmeasured, never as a zero.

Extraction profile

How cheap this page is for a retrieval pipeline to chunk. Recorded and published, deliberately not scored: it describes a shape rather than a pass or a fail, and compressing it into the grade would destroy the useful part.

Server text
0 chars
Text density
0%
Subheadings
0
Lists
0
Tables
0
Feed
no

Crawler policy

Read from xnhau.bio/robots.txt. A crawler is listed as blocked when the rules deny it the site root. This operator names 16 AI crawlers explicitly, which means the policy is deliberate rather than inherited from a wildcard rule.

AI crawler access policy for xnhau.bio
CrawlerOperatorTierNamedStatus
GPTBotOpenAI1yesAllowed
OAI-SearchBotOpenAI1noAllowed
ChatGPT-UserOpenAI1yesAllowed
ClaudeBotAnthropic1yesAllowed
Claude-UserAnthropic1yesAllowed
Claude-SearchBotAnthropic1noAllowed
PerplexityBotPerplexity1noAllowed
Perplexity-UserPerplexity1yesAllowed
Google-ExtendedGoogle1yesAllowed
Applebot-ExtendedApple1yesAllowed
meta-externalagentMeta1yesAllowed
CCBotCommon Crawl2yesAllowed
AmazonbotAmazon2yesAllowed
BytespiderByteDance2yesAllowed
cohere-aiCohere2yesAllowed
MistralAI-UserMistral2yesAllowed
YouBotYou.com2noAllowed
DuckAssistBotDuckDuckGo2noAllowed
kagi-fetcherKagi2noAllowed
DiffbotDiffbot2yesAllowed
Google-NotebookLMGoogle2yesAllowed
TavilyBotTavily2noAllowed
FirecrawlAgentFirecrawl2yesAllowed

Recorded changes

No mark at this score

The embeddable mark starts at grade B, because offering a graphic nobody would put on their own site is a pretence rather than a feature. The list above is the useful version: for most sites the points are concentrated in two or three changes. How the mark works.

CrawlIndex mark for xnhau.bio, score unavailable

The neutral mark above exists and is free to use if you want to show that the site is independently measured whatever the number says.

This measurement as JSON

crawl 2026-09-22 08:34 UTCprobe 3.0.0rubric 2.0.0registry 1.0.0vantage gha-ubuntu3,618 of 5,006 reachable

Using these figures

Free to reuse in research, journalism or a product under CC BY 4.0, with credit to Fidget Labs BV. Quote the measurement date so the claim stays checkable as the index moves.

CrawlIndex by Fidget Labs BV. "xnhau.bio agent readiness." https://crawlindex.org (measured 2026-09-22). Licensed CC BY 4.0.