Endpoint · extractionPOSTx402.forgemesh.io/robots-txt-ai-check

Fetches a domain's robots.txt and parses its Content-Signal and AI-preference directives (search, ai-input, ai-train) into structured JSON plus a plain-English summary of what's…

Fetches a domain's robots.txt and parses its Content-Signal and AI-preference directives (search, ai-input, ai-train) into structured JSON plus a plain-English summary of what's allowed — the "can this domain be crawled by an AI agent" check. Run before scraping content or building a RAG index, ahead of the industry's move toward stricter bot-gating defaults later this year.

UNRATEDDelisted

Overview

Grade?

UNRATED

0 of 30 paid calls toward a letter

Price

$0.005 per call

Paid calls

none yet

delivery unknown until someone pays

More info

Seller?

0x84a1827f…a4a57a08

URL

https://x402.forgemesh.io/robots-txt-ai-check

Seen

first 35 days ago · last 35 days ago

13 free handshakes

Payment

Pays through

x402 · MPP evm

Offered on?

Base USDC

Listed on?

Base

Score, from free handshakes onlyweights 2026.08.1

UN
RATED

0.784 liveness verified, no letter

To a letter · 30 paid calls

0 of 30

Held back by sample size, not by the seller · gap to 1.000 is 0.216: 0.138 uncertain ? + 0.079 short ? · 0.016 to B

How the composite of 0.784 is made up, part by part
Component	Weight	Measured	Lower bound ?		Adds	Short ?	Uncertain ?
livenesscosts the most it answered at all	0.60	1.00	0.771		0.462	0	−0.138
latency p95 it answered as fast as its class	0.20	0.61	0.606		0.121	−0.079	0
price stability the price stayed where it was listed	0.20	1.00	1.000		0.200	0	0
Composite	1.00		0.784	gap to 1.000 = 0.216 · 0.079 short · 0.138 uncertain	0.784	−0.079	−0.138

Not measured: correctness · nobody paid; honesty · nobody paid; schema conformance · no answer had a published shape to check

The multiplication, written out

  0.600 × 0.771   liveness       
+ 0.200 × 0.606   latency p95    
+ 0.200 × 1.000   price stability
= 0.784           → UNRATED: 13 of 30 paid calls      weights 2026.08.1 · 13 samples · seed cap_01M1A5Q9KEYCEBYHK9S8QVJ8AG|2026-08-07T23:06:19.821Z|2026.08.1

Verify it yourselfnpx teppi-check https://x402.forgemesh.io/robots-txt-ai-checkcurl -s https://api.teppi.xyz/v1/trust/cap_01M1A5Q9KEYCEBYHK9S8QVJ8AG