Endpoint · searchPOSTtanod.dev /v1/robots
Check whether robots.txt permits a crawler to fetch a URL under RFC 9309; includes matching rule and crawl delay.
Read more
Check whether robots.txt permits a crawler to fetch a URL under RFC 9309; includes matching rule and crawl delay. Use when an agent must know whether a crawler may fetch a URL under the site's robots.txt before scraping it.Overview
Grade?
UNRATED
0 of 30 paid calls toward a letter
Price
$0.001 per call
Paid calls
none yet
delivery unknown until someone pays
More info
Seller?
Seen
first 41 days ago · last 4 days ago
46 free handshakes
Payment
Pays through
x402 · MPP tempo
Offered on?
Polygon, Arbitrum, eip155:56, Base USDC, Solana, Tempo USDC.e
Listed on?
Polygon, Arbitrum, eip155:56, Base, Solana
Paid calls
No paid calls yet.
Delivery is unknown until someone pays. A handshake only shows it asks for payment.
Verify it yourself
npx teppi-check https://tanod.dev/v1/robotscurl -s https://api.teppi.xyz/v1/trust/cap_01M4D0S0H4YZFAX8X19YAET81G