Endpoints: 76,849MCP servers: 32,730Payout addresses: 3,825Paid calls: 6,166Letters: 84Defects: 3,898counted 3 min ago
teppi

Endpoint · extractionPOSTweb.openverbs.com/v1/robots

Fetch a site's robots.txt and evaluate crawl permissions: given a URL (plus optional extra paths) and a user-agent, return whether each path is allowed or disallowed, the rule…
Read moreFetch a site's robots.txt and evaluate crawl permissions: given a URL (plus optional extra paths) and a user-agent, return whether each path is allowed or disallowed, the rule that matched, the user-agent group, the crawl-delay and any declared sitemaps. Implements the Robots Exclusion Protocol (RFC 9309) with longest-match-wins, Allow-over-Disallow tie-breaking and * / $ wildcards.
UNRATEDListed

Overview

Grade?
UNRATED
0 of 30 paid calls toward a letter
Price
$0.006 per call
Paid calls
none yet
delivery unknown until someone pays

More info

URL
https://web.openverbs.com/v1/robots
Seen
first 44 days ago · last 4 days ago
49 free handshakes

Payment

Pays through
x402 · MPP evm, tempo
Offered on?
Base USDC, Tempo 0x8335…2913
Listed on?
Base

Paid calls

No paid calls yet.
Delivery is unknown until someone pays. A handshake only shows it asks for payment.
Verify it yourselfnpx teppi-check https://web.openverbs.com/v1/robotscurl -s https://api.teppi.xyz/v1/trust/cap_01M459KP0KBJNP56F2NX67A97W