Endpoint · extractionGETapi.strale.io /x402/robots-txt-parse
Fetch and parse a website's robots.txt.
Read more
Fetch and parse a website's robots.txt. Returns rules per user-agent, sitemaps, crawl delays, and whether all crawlers are blocked.Overview
Grade?
UNRATED
0 of 30 paid calls toward a letter
Price
$0.0216 per call
Paid calls
none yet
delivery unknown until someone pays
More info
Seller?
Seen
first 34 days ago · last 2 days ago
63 free handshakes
Payment
Pays through
x402
Offered on?
Base USDC
Listed on?
Base
Handshakescomputed 4 days ago
0.693 from 57 free handshakes over 30 days · UNRATED ?
| Component | Weight | Measured | Lower bound ? | Adds | Short ? | Uncertain ? | |
|---|---|---|---|---|---|---|---|
| latency p95costs the most it answered as fast as its class |
0.20 | 0.68 | 0.000 | 0.000 | −0.064 | −0.136 | |
| liveness it answered at all |
0.60 | 0.98 | 0.822 | 0.493 | −0.011 | −0.096 | |
| price stability the price stayed where it was listed |
0.20 | 1.00 | 1.000 | 0.200 | 0 | 0 | |
| Composite | 1.00 | 0.693 | gap to 1.000 = 0.307 · 0.075 short · 0.232 uncertain | 0.693 | −0.075 | −0.232 |
Not measured: correctness · nobody paid; honesty · nobody paid; schema conformance · no answer had a published shape to check
BURN_INFREE_TIER_ONLY
Verify it yourself
npx teppi-check https://api.strale.io/x402/robots-txt-parsecurl -s https://api.teppi.xyz/v1/trust/cap_01M1A5Q7PQRBQGFXPN8K3KTWD5