MCP servercom.lumnika/ai-crawler-readiness

Can AI crawlers read this site?

Can AI crawlers read this site? GPTBot/ClaudeBot verdicts, robots vs edge blocking, 47k-domain index

UNRATEDActivestreamable-httpshop.lumnika.com

Overview

Score?

UNRATED 0.143

of what a free look can see, on 1 looks

Looks

last 2 days ago

Tools

More info

URL

shop.lumnika.com/ai-readiness/mcp

streamable-http

Says it is

agent-web-index 1.0.0

protocol 2025-06-18

In the record since

14 days ago

Among servers18,413 with a card

0median 0.606 · this server 0.143 · highest on record 0.8561

Toolsfrom sha256:c079bdb3ce…d7a648

The tools this server lists, read out of the definition it returned
Tool	Schema
domain_readiness Can AI assistants actually read this domain? Returns the measured readiness score, the per-crawler verdict (served / blocked in robots.txt / refused by the edge despite robots.txt	input · no output
edge_blocking Who is actually doing the blocking: for each CDN/WAF vendor, the share of (domain x crawler) pairs that robots.txt ALLOWS and the server refuses anyway — i.e. how much of the block	input · no output
measure_domain Measure a domain RIGHT NOW instead of reading the archive: 9 real HTTP requests, one from a browser user-agent and one per AI crawler user-agent, plus robots.txt / llms.txt / sitem	input · no output
recent_changes What CHANGED: the domains that recently started or stopped blocking a specific AI crawler, with the day the flip was observed and whether it happened in robots.txt or at the edge.	input · no output
web_openness How much of the most-visited web is readable by AI assistants right now: the share of measured domains that block at least one AI crawler, and the served / robots-blocked / edge-bl	input · no output

Verify it yourselfnpx teppi-check https://shop.lumnika.com/ai-readiness/mcpcurl -s https://api.teppi.xyz/v1/trust/mcp/mcs_01M2Z19V6QYVPCAATGX7MHA413