Endpoint · extractionGETtoolvend.dev /parse/robots ?url=https%3A%2F%2Fexample.com
Fetch and parse robots.txt (+ llms.txt if present) into structured JSON, including which AI crawlers are blocked.
Overview
Grade?
UNRATED
0 of 30 paid calls toward a letter
Price
$0.005 per call
Paid calls
none yet
delivery unknown until someone pays
More info
Seller?
URL
https://toolvend.dev/parse/robots?url=https%3A%2F%2Fexample.com
MCP server on this host: dev.toolvend/dns-whois-domain-tools
Seen
first 2 months ago · last 9 days ago
101 free handshakes
Payment
Pays through
x402
Offered on?
Base, Solana USDC
Listed on?
Base, Solana
Paid calls
No paid calls yet.
Delivery is unknown until someone pays. A handshake only shows it asks for payment.
Paid for on the same host1 of 10 endpoints at toolvend.dev
| Endpoint | Grade | Paid calls | Last result | Last seen |
|---|---|---|---|---|
| GET /vat?amount=100&country=DE&direction=net_to_gross | UNRATED | 3 | answered, not checked | 23 hr ago |
Verify it yourself
npx teppi-check https://toolvend.dev/parse/robots?url=https%3A%2F%2Fexample.comcurl -s https://api.teppi.xyz/v1/trust/cap_01M1ZRPQWWV926J5BS6ERRWDFM