Tranco rank 4,997
infobip.com
infobip.com scores 84 out of 100 for agent readiness. It blocks 1 of 11 answer-surface AI crawlers. That is ahead of 95% of measured sites.
Agent Friendly
| Score band | Sites |
|---|---|
| 0 to 9 | 0 |
| 10 to 19 | 4 |
| 20 to 29 | 20 |
| 30 to 39 | 33 |
| 40 to 49 | 261 |
| 50 to 59 | 745 |
| 60 to 69 | 777 |
| 70 to 79 | 469 |
| 80 to 89 | 298 |
| 90 to 99 | 17 |
- Last measured
- 2026-10-11 09:24 UTC
- First seen
- 2026-09-28
- Rubric / probe
- v2.0.0 / v3.0.0
Vantage
Where the request came from. Origins serve differently by geography and IP reputation, so an observation is only comparable with another taken from the same place. Everything here is measured from GitHub runners in the US and EU. More- gha-ubuntu
Policy posture
Whether anyone actually decided. Deliberate means robots.txt names AI crawlers by token. Inherited means it names none, so whatever AI policy exists is a side effect of generic rules. Blanket means one rule for everyone. Absent means no robots.txt at all. More
Policy posture
Whether anyone actually decided. Deliberate means robots.txt names AI crawlers by token. Inherited means it names none, so whatever AI policy exists is a side effect of generic rules. Blanket means one rule for everyone. Absent means no robots.txt at all. MoreDeliberate
robots.txt names AI crawlers by token. Somebody at this organisation decided what AI systems may do with the site.
Access archetype
The shape of the policy rather than its size. Open, no training, assistant only, selective, walled, metered, or undeclared. More
Access archetype
The shape of the policy rather than its size. Open, no training, assistant only, selective, walled, metered, or undeclared. MoreNo training
Training crawlers are blocked and the crawlers that answer live questions are not. This site wants to be cited without being absorbed.
Built on WordPress, served through Cloudflare. Compare against everything else on the same stack.
How this score is made up
| Band | Earned | Available | Nominal maximum |
|---|---|---|---|
| Agent access | 41 | 45 | 45 |
| Machine-readable surface | 15 | 25 | 25 |
| Content structure | 28 | 30 | 30 |
Agent access41 / 45
- Answer-surface crawlers allowed. 1 of 11 blocked: meta-externalagent.
- Secondary crawlers allowed. 2 of 12 blocked: Bytespider, Diffbot.
- Serves crawlers the same content. A crawler and a browser receive comparable responses.
Machine-readable surface15 / 25
- robots.txt published. robots.txt is present and parseable.
- Sitemap declared in robots.txt. robots.txt points crawlers at a sitemap.
- llms.txt published. /llms.txt is served but is off-spec: no blockquote summary.
- agents.md published. No /agents.md.
- Licence terms declared. No RSL License directive and no licence link relation. Reuse terms are undeclared.
- Granular usage preferences declared. robots.txt carries Content-Signal: ai-train=yes, search=yes, ai-input=yes. Preferences are stated per use rather than as a single allow or deny.
- Agent card published. No agent card at /.well-known/agent-card.json.
Content structure28 / 30
- Organization schema. Organization JSON-LD lets an agent resolve who publishes this site.
- WebSite schema. WebSite JSON-LD present.
- Additional structured data. Also declares: WebPage.
- Readable without JavaScript. 25,248 characters of text in the server response. Most crawlers do not execute JavaScript.
- Single top-level heading. 1 h1 element found.
- Semantic landmarks. Uses main, nav, header, footer.
- Dateline declared. Declares a modification date in machine-readable form.
- Authorship declared. No declared author. An agent quoting this page has nobody to credit.
How this compares to its peers
A score out of 100 is not information on its own. Against the sites running the same platform and sitting behind the same edge network, it is: this site is at or ahead of every cohort it belongs to, which usually means the ceiling is the platform rather than the site. Cohorts under 25 measured sites are never published, so every comparison here is against a real group.
| Group | Median score | Sites in group | Difference |
|---|---|---|---|
| This site | 84 | 1 | 0 |
| Sites on WordPress | 73 | 310 | 11.0 |
| Sites behind Cloudflare | 66 | 1108 | 18.0 |
| The whole index | 62 | 2624 | 22.0 |
What would move this score
The observable checks that did not earn full marks, heaviest first. Only these; a check we could not observe is not on the list, because it is not a fact about the site.
- +4agents.md published. No /agents.md.
- +3llms.txt published. /llms.txt is served but is off-spec: no blockquote summary.
- +2.7Answer-surface crawlers allowed. 1 of 11 blocked: meta-externalagent.
- +2Licence terms declared. No RSL License directive and no licence link relation. Reuse terms are undeclared.
- +2Authorship declared. No declared author. An agent quoting this page has nobody to credit.
- +1.3Secondary crawlers allowed. 2 of 12 blocked: Bytespider, Diffbot.
- +1Agent card published. No agent card at /.well-known/agent-card.json.
Extraction profile
How cheap this page is for a retrieval pipeline to chunk. Recorded and published, deliberately not scored: it describes a shape rather than a pass or a fail, and compressing it into the grade would destroy the useful part.
- Server text
- 25,248 chars
- Text density
- 2%
- Subheadings
- 38
- Lists
- 105
- Tables
- 0
- Feed
- no
- :
Content-Signal
A robots.txt directive expressing granular preferences, for example search=yes, ai-train=no, use=reference. Cloudflare writes it into managed robots.txt, so its spread is partly a measure of Cloudflare rather than of publisher intent. Moreai-train=yes, search=yes, ai-input=yes
Crawler policy
Read from infobip.com/robots.txt. A crawler is listed as blocked when the rules deny it the site root. This operator names 15 AI crawlers explicitly, which means the policy is deliberate rather than inherited from a wildcard rule.
| Crawler | Operator | Tier | Named | Status |
|---|---|---|---|---|
| GPTBot | OpenAI | 1 | yes | Allowed |
| OAI-SearchBot | OpenAI | 1 | yes | Allowed |
| ChatGPT-User | OpenAI | 1 | yes | Allowed |
| ClaudeBot | Anthropic | 1 | yes | Allowed |
| Claude-User | Anthropic | 1 | yes | Allowed |
| Claude-SearchBot | Anthropic | 1 | yes | Allowed |
| PerplexityBot | Perplexity | 1 | yes | Allowed |
| Perplexity-User | Perplexity | 1 | yes | Allowed |
| Google-Extended | 1 | yes | Allowed | |
| Applebot-Extended | Apple | 1 | yes | Allowed |
| meta-externalagent | Meta | 1 | yes | Blocked |
| CCBot | Common Crawl | 2 | yes | Allowed |
| Amazonbot | Amazon | 2 | yes | Allowed |
| Bytespider | ByteDance | 2 | yes | Blocked |
| cohere-ai | Cohere | 2 | no | Allowed |
| MistralAI-User | Mistral | 2 | no | Allowed |
| YouBot | You.com | 2 | no | Allowed |
| DuckAssistBot | DuckDuckGo | 2 | no | Allowed |
| kagi-fetcher | Kagi | 2 | no | Allowed |
| Diffbot | Diffbot | 2 | yes | Blocked |
| Google-NotebookLM | 2 | no | Allowed | |
| TavilyBot | Tavily | 2 | no | Allowed |
| FirecrawlAgent | Firecrawl | 2 | no | Allowed |
Recorded changes
- Score rose 6 points to 84.
- Score rose 13 points to 78.
- infobip.com now allows GPTBot, ClaudeBot, Google-Extended, Applebot-Extended.
infobip.com has earned the Agent Friendly mark
Free to embed, no account and no fee. It regenerates from the nightly crawl, so it stays true, and it links back to this page so anyone can check the working in one click. What the mark means.
On a light pageOn a dark pageThe mark links back to this site's page for your domain, so anyone can check the claim in one click. It regenerates nightly, which means it stays true and it can change.
crawl 2026-10-11 09:44 UTCprobe 3.0.0rubric 2.0.0registry 1.0.0vantage gha-ubuntu3,660 of 5,006 reachable
Using these figures
Free to reuse in research, journalism or a product under CC BY 4.0, with credit to Fidget Labs BV. Quote the measurement date so the claim stays checkable as the index moves.
CrawlIndex by Fidget Labs BV. "infobip.com agent readiness." https://crawlindex.org (measured 2026-10-11). Licensed CC BY 4.0.