Endpoints: 43,494MCP servers: 23,938Payout addresses: 2,662Paid calls: 3,687Letters: 64Defects: 1,887counted 3 min ago
teppi

Endpoint · searchGETapi.sitecheck-api.workers.dev/api/robots?url=https%3A%2F%2Fwww.google.com%2Fsearch%3Fq%3Dx

Checks whether a URL's path may be crawled under robots.txt (RFC 9309): the verdict for a user agent (default: *, Googlebot, Bingbot, GPTBot, ClaudeBot, PerplexityBot…
Read moreChecks whether a URL's path may be crawled under robots.txt (RFC 9309): the verdict for a user agent (default: *, Googlebot, Bingbot, GPTBot, ClaudeBot, PerplexityBot, Google-Extended and CCBot), the rule that decided it and its line, crawl-delay, sitemaps and the matching group's lines. Longest rule wins, allow wins a tie, * and $ work. No robots.txt means everything is allowed; a server error is a 503, not charged.
UNRATEDListed

Overview

Grade?
UNRATED
0 of 30 paid calls toward a letter
Price
$0.001 per call
Paid calls
none yet
delivery unknown until someone pays

More info

Seller?
0xaca92e43…7a2435da
URL
https://api.sitecheck-api.workers.dev/api/robots?url=https%3A%2F%2Fwww.google.com%2Fsearch%3Fq%3Dx
MCP server on this host: io.github.bck-stack/sitecheck
Seen
first 7 days ago · last 18 hr ago
7 free handshakes

Payment

Pays through
x402
Offered on?
Arc, Base USDC, Solana, xrpl:0
Listed on?
Base, Solana

Buy it through Teppi

?Pay on delivery
0.003000 USDC (0.001000 to the seller, 0.002000 fee)
Where
https://api.teppi.xyz/v1/via/cap_01M51M0ERDXA3HCA8SK8A8QFP8
?Ask the price
curl -si https://api.teppi.xyz/v1/via/cap_01M51M0ERDXA3HCA8SK8A8QFP8

About

?Description
Checks whether a URL's path may be crawled under robots.txt (RFC 9309): the verdict for a user agent (default: *, Googlebot, Bingbot, GPTBot, ClaudeBot, PerplexityBot, Google-Extended and CCBot), the rule that decided it and its line, crawl-delay, sitemaps and the matching group's lines. Longest rule wins, allow wins a tie, * and $ work. No robots.txt means everything is allowed; a server error is a 503, not charged.
URL
https://api.sitecheck-api.workers.dev/api/robots?url=https%3A%2F%2Fwww.google.com%2Fsearch%3Fq%3Dx
Method
GET
Class
search
?Checkable to
L1
Endpoint id
cap_01M51M0ERDXA3HCA8SK8A8QFP8
?Badge

Reads live. UNRATED until paid calls earn a letter.

Markdown
[![Teppi](https://api.teppi.xyz/badge/cap_01M51M0ERDXA3HCA8SK8A8QFP8.svg)](https://teppi.xyz/endpoint/cap_01M51M0ERDXA3HCA8SK8A8QFP8)
HTML
<a href="https://teppi.xyz/endpoint/cap_01M51M0ERDXA3HCA8SK8A8QFP8"><img src="https://api.teppi.xyz/badge/cap_01M51M0ERDXA3HCA8SK8A8QFP8.svg" alt="Teppi delivery record"></a>
Image
https://api.teppi.xyz/badge/cap_01M51M0ERDXA3HCA8SK8A8QFP8.svg
Verify it yourselfnpx teppi-check https://api.sitecheck-api.workers.dev/api/robots?url=https%3A%2F%2Fwww.google.com%2Fsearch%3Fq%3Dxcurl -s https://api.teppi.xyz/v1/trust/cap_01M51M0ERDXA3HCA8SK8A8QFP8