Endpoint · extractionGETtoolvend.dev /parse/robots ?url=https%3A%2F%2Fexample.com
Fetch and parse robots.txt (+ llms.txt if present) into structured JSON, including which AI crawlers are blocked.
Overview
Grade?
UNRATED
0 of 30 paid calls toward a letter
Price
$0.005 per call
Paid calls
none yet
delivery unknown until someone pays
More info
Seller?
URL
https://toolvend.dev/parse/robots?url=https%3A%2F%2Fexample.com
MCP server on this host: dev.toolvend/dns-whois-domain-tools
Seen
first 26 days ago · last 19 hr ago
48 free handshakes
Payment
Pays through
x402
Offered on?
Base, Solana USDC
Listed on?
Base, Solana
Handshakescomputed 1 day ago
0.730 from 47 free handshakes over 30 days · UNRATED ?
| Component | Weight | Measured | Lower bound ? | Adds | Short ? | Uncertain ? | |
|---|---|---|---|---|---|---|---|
| latency p95costs the most it answered as fast as its class |
0.20 | 0.16 | 0.041 | 0.008 | −0.167 | −0.025 | |
| liveness it answered at all |
0.60 | 1.00 | 0.869 | 0.522 | 0 | −0.078 | |
| price stability the price stayed where it was listed |
0.20 | 1.00 | 1.000 | 0.200 | 0 | 0 | |
| Composite | 1.00 | 0.730 | gap to 1.000 = 0.270 · 0.167 short · 0.103 uncertain | 0.730 | −0.167 | −0.103 |
Not measured: correctness · nobody paid; honesty · nobody paid; schema conformance · no answer had a published shape to check
BURN_INFREE_TIER_ONLY
Verify it yourself
npx teppi-check https://toolvend.dev/parse/robots?url=https%3A%2F%2Fexample.comcurl -s https://api.teppi.xyz/v1/trust/cap_01M1ZRPQWWV926J5BS6ERRWDFM