Endpoint · extractionGETtoolvend.dev /parse/robots ?url=https%3A%2F%2Fexample.com
Fetch and parse robots.txt (+ llms.txt if present) into structured JSON, including which AI crawlers are blocked.
Overview
Grade?
UNRATED
0 of 30 paid calls toward a letter
Price
$0.005 per call
Paid calls
none yet
delivery unknown until someone pays
More info
Seller?
URL
https://toolvend.dev/parse/robots?url=https%3A%2F%2Fexample.com
MCP server on this host: dev.toolvend/dns-whois-domain-tools
Seen
first 26 days ago · last 13 hr ago
48 free handshakes
Payment
Pays through
x402
Offered on?
Base, Solana USDC
Listed on?
Base, Solana
Score, from free handshakes onlyweights 2026.09.6
UN
RATED
RATED
0.730 liveness verified, no letter
To a letter · 30 paid calls
0 of 30
Held down by latency p95 · gap to 1.000 is 0.270: 0.103 uncertain ? + 0.167 short ? · 0.070 to B
| Component | Weight | Measured | Lower bound ? | Adds | Short ? | Uncertain ? | |
|---|---|---|---|---|---|---|---|
| latency p95costs the most it answered as fast as its class |
0.20 | 0.16 | 0.041 | 0.008 | −0.167 | −0.025 | |
| liveness it answered at all |
0.60 | 1.00 | 0.869 | 0.522 | 0 | −0.078 | |
| price stability the price stayed where it was listed |
0.20 | 1.00 | 1.000 | 0.200 | 0 | 0 | |
| Composite | 1.00 | 0.730 | gap to 1.000 = 0.270 · 0.167 short · 0.103 uncertain | 0.730 | −0.167 | −0.103 |
Not measured: correctness · nobody paid; honesty · nobody paid; schema conformance · no answer had a published shape to check
The multiplication, written out
0.200 × 0.041 latency p95
+ 0.600 × 0.869 liveness
+ 0.200 × 1.000 price stability
= 0.730 → UNRATED: 47 of 30 paid calls weights 2026.09.6 · 47 samples · seed cap_01M1ZRPQWWV926J5BS6ERRWDFM|2026-09-03T13:19:27.755Z|2026.09.6
Verify it yourself
npx teppi-check https://toolvend.dev/parse/robots?url=https%3A%2F%2Fexample.comcurl -s https://api.teppi.xyz/v1/trust/cap_01M1ZRPQWWV926J5BS6ERRWDFM