robots?url=https%3A%2F%2Fwww.google.com%2Fsearch%3Fq%3Dx

Checks whether a URL's path may be crawled under robots.txt (RFC 9309): the verdict for a user agent (default: *, Googlebot, Bingbot, GPTBot, ClaudeBot, PerplexityBot…

Checks whether a URL's path may be crawled under robots.txt (RFC 9309): the verdict for a user agent (default: *, Googlebot, Bingbot, GPTBot, ClaudeBot, PerplexityBot, Google-Extended and CCBot), the rule that decided it and its line, crawl-delay, sitemaps and the matching group's lines. Longest rule wins, allow wins a tie, * and $ work. No robots.txt means everything is allowed; a server error is a 503, not charged.

UNRATEDListed

Overview

Grade?

UNRATED

0 of 30 paid calls toward a letter

Price

$0.001 per call

Paid calls

none yet

delivery unknown until someone pays

More info

Seller?

0xaca92e43…7a2435da

URL

https://api.sitecheck-api.workers.dev/api/robots?url=https%3A%2F%2Fwww.google.com%2Fsearch%3Fq%3Dx

MCP server on this host: io.github.bck-stack/sitecheck

Seen

first 7 days ago · last 17 hr ago

7 free handshakes

Payment

Pays through

x402

Offered on?

Arc, Base USDC, Solana, xrpl:0

Listed on?

Base, Solana

Paid calls

No paid calls yet.

Delivery is unknown until someone pays. A handshake only shows it asks for payment.

Paid for on the same host1 of 225 endpoints at api.sitecheck-api.workers.dev

Other endpoints on api.sitecheck-api.workers.dev that were paid for
Endpoint	Grade	Paid calls	Last result	Last seen
GET /api/contacts?url=plausible.io	UNRATED	1	delivered	17 hr ago

All 225 endpoints on this host

Verify it yourselfnpx teppi-check https://api.sitecheck-api.workers.dev/api/robots?url=https%3A%2F%2Fwww.google.com%2Fsearch%3Fq%3Dxcurl -s https://api.teppi.xyz/v1/trust/cap_01M51M0ERDXA3HCA8SK8A8QFP8