Tranco rank 2,938
botinok.porn
botinok.porn scores 47 out of 100 for agent readiness. It blocks 1 of 11 answer-surface AI crawlers. That is ahead of 7% of measured sites.
Measured
| Score band | Sites |
|---|---|
| 0 to 9 | 0 |
| 10 to 19 | 3 |
| 20 to 29 | 18 |
| 30 to 39 | 33 |
| 40 to 49 | 251 |
| 50 to 59 | 755 |
| 60 to 69 | 775 |
| 70 to 79 | 451 |
| 80 to 89 | 266 |
| 90 to 99 | 15 |
- Last measured
- 2026-09-22 07:57 UTC
- First seen
- 2026-09-14
- Rubric / probe
- v2.0.0 / v3.0.0
Vantage
Where the request came from. Origins serve differently by geography and IP reputation, so an observation is only comparable with another taken from the same place. Everything here is measured from GitHub runners in the US and EU. More- gha-ubuntu
Policy posture
Whether anyone actually decided. Deliberate means robots.txt names AI crawlers by token. Inherited means it names none, so whatever AI policy exists is a side effect of generic rules. Blanket means one rule for everyone. Absent means no robots.txt at all. More
Policy posture
Whether anyone actually decided. Deliberate means robots.txt names AI crawlers by token. Inherited means it names none, so whatever AI policy exists is a side effect of generic rules. Blanket means one rule for everyone. Absent means no robots.txt at all. MoreDeliberate
robots.txt names AI crawlers by token. Somebody at this organisation decided what AI systems may do with the site.
Access archetype
The shape of the policy rather than its size. Open, no training, assistant only, selective, walled, metered, or undeclared. More
Access archetype
The shape of the policy rather than its size. Open, no training, assistant only, selective, walled, metered, or undeclared. MoreNo training
Training crawlers are blocked and the crawlers that answer live questions are not. This site wants to be cited without being absorbed.
How this score is made up
| Band | Earned | Available | Nominal maximum |
|---|---|---|---|
| Agent access | 35.3 | 45 | 45 |
| Machine-readable surface | 3 | 25 | 25 |
| Content structure | 9 | 30 | 30 |
Agent access35.3 / 45
- Answer-surface crawlers allowed. 1 of 11 blocked: GPTBot.
- Secondary crawlers allowed. All 12 secondary crawlers are allowed.
- Serves crawlers the same content. Requesting as GPTBot returned HTTP 403 and 13 bytes, against 69,259 bytes for a browser.
Machine-readable surface3 / 25
- robots.txt published. robots.txt is present and parseable.
- Sitemap declared in robots.txt. robots.txt does not declare a sitemap.
- llms.txt published. No /llms.txt.
- agents.md published. No /agents.md.
- Licence terms declared. No RSL License directive and no licence link relation. Reuse terms are undeclared.
- Granular usage preferences declared. No Content-Signal directive. Policy is expressed only as allow or deny.
- Agent card published. No agent card at /.well-known/agent-card.json.
Content structure9 / 30
- Organization schema. No Organization JSON-LD. Agents cannot reliably attribute this site to an entity.
- WebSite schema. No WebSite JSON-LD.
- Additional structured data. No further JSON-LD types on the homepage.
- Readable without JavaScript. 2,921 characters of text in the server response. Most crawlers do not execute JavaScript.
- Single top-level heading. 0 h1 elements found.
- Semantic landmarks. Uses nav, header, footer.
- Dateline declared. No machine-readable date. An agent cannot tell how current this page is.
- Authorship declared. No declared author. An agent quoting this page has nobody to credit.
How this compares to its peers
A score out of 100 is not information on its own. Against the sites running the same platform and sitting behind the same edge network, it is: this site is behind at least one of its own cohorts, which usually means the gap is its own to close. Cohorts under 25 measured sites are never published, so every comparison here is against a real group.
| Group | Median score | Sites in group | Difference |
|---|---|---|---|
| This site | 47 | 1 | 0 |
| The whole index | 61 | 2567 | -14.0 |
What would move this score
The observable checks that did not earn full marks, heaviest first. Only these; a check we could not observe is not on the list, because it is not a fact about the site.
- +9llms.txt published. No /llms.txt.
- +7Serves crawlers the same content. Requesting as GPTBot returned HTTP 403 and 13 bytes, against 69,259 bytes for a browser.
- +7Organization schema. No Organization JSON-LD. Agents cannot reliably attribute this site to an entity.
- +4Sitemap declared in robots.txt. robots.txt does not declare a sitemap.
- +4agents.md published. No /agents.md.
- +3WebSite schema. No WebSite JSON-LD.
- +3Additional structured data. No further JSON-LD types on the homepage.
- +3Single top-level heading. 0 h1 elements found.
Extraction profile
How cheap this page is for a retrieval pipeline to chunk. Recorded and published, deliberately not scored: it describes a shape rather than a pass or a fail, and compressing it into the grade would destroy the useful part.
- Server text
- 2,921 chars
- Text density
- 4%
- Subheadings
- 0
- Lists
- 3
- Tables
- 0
- Feed
- no
Crawler policy
Read from botinok.porn/robots.txt. A crawler is listed as blocked when the rules deny it the site root. This operator names 1 AI crawler explicitly, which means the policy is deliberate rather than inherited from a wildcard rule.
| Crawler | Operator | Tier | Named | Status |
|---|---|---|---|---|
| GPTBot | OpenAI | 1 | yes | Blocked |
| OAI-SearchBot | OpenAI | 1 | no | Allowed |
| ChatGPT-User | OpenAI | 1 | no | Allowed |
| ClaudeBot | Anthropic | 1 | no | Allowed |
| Claude-User | Anthropic | 1 | no | Allowed |
| Claude-SearchBot | Anthropic | 1 | no | Allowed |
| PerplexityBot | Perplexity | 1 | no | Allowed |
| Perplexity-User | Perplexity | 1 | no | Allowed |
| Google-Extended | 1 | no | Allowed | |
| Applebot-Extended | Apple | 1 | no | Allowed |
| meta-externalagent | Meta | 1 | no | Allowed |
| CCBot | Common Crawl | 2 | no | Allowed |
| Amazonbot | Amazon | 2 | no | Allowed |
| Bytespider | ByteDance | 2 | no | Allowed |
| cohere-ai | Cohere | 2 | no | Allowed |
| MistralAI-User | Mistral | 2 | no | Allowed |
| YouBot | You.com | 2 | no | Allowed |
| DuckAssistBot | DuckDuckGo | 2 | no | Allowed |
| kagi-fetcher | Kagi | 2 | no | Allowed |
| Diffbot | Diffbot | 2 | no | Allowed |
| Google-NotebookLM | 2 | no | Allowed | |
| TavilyBot | Tavily | 2 | no | Allowed |
| FirecrawlAgent | Firecrawl | 2 | no | Allowed |
No mark at this score
The embeddable mark starts at grade B, because offering a graphic nobody would put on their own site is a pretence rather than a feature. The list above is the useful version: for most sites the points are concentrated in two or three changes. How the mark works.
The neutral mark above exists and is free to use if you want to show that the site is independently measured whatever the number says.
crawl 2026-09-22 08:34 UTCprobe 3.0.0rubric 2.0.0registry 1.0.0vantage gha-ubuntu3,618 of 5,006 reachable
Using these figures
Free to reuse in research, journalism or a product under CC BY 4.0, with credit to Fidget Labs BV. Quote the measurement date so the claim stays checkable as the index moves.
CrawlIndex by Fidget Labs BV. "botinok.porn agent readiness." https://crawlindex.org (measured 2026-09-22). Licensed CC BY 4.0.