robots?target=https%3A%2F%2Fexample.com%2Fprivate%2Fpage&user_agent=GPTBot

Check robots.txt before crawling or scraping a page.

Check robots.txt before crawling or scraping a page. Decide whether GPTBot, ClaudeBot, Googlebot, or another crawler may fetch the exact URL and return ALLOW/DENY, winning rule, crawl-delay, sitemap URLs, and live provenance.

UNRATEDListed

Overview

Grade?

UNRATED

0 of 30 paid calls toward a letter

Price

$0.001 per call

Paid calls

none yet

delivery unknown until someone pays

More info

Seller?

0x5deaebaf…1c42ef0a

URL

https://pennyregwatch.com/v1/robots?target=https%3A%2F%2Fexample.com%2Fprivate%2Fpage&user_agent=GPTBot

Seen

first 27 days ago · last 9 hr ago

50 free handshakes

Payment

Pays through

x402

Offered on?

Base USDC

Listed on?

Base

Paid calls

No paid calls yet.

Delivery is unknown until someone pays. A handshake only shows it asks for payment.

Verify it yourselfnpx teppi-check https://pennyregwatch.com/v1/robots?target=https%3A%2F%2Fexample.com%2Fprivate%2Fpage&user_agent=GPTBotcurl -s https://api.teppi.xyz/v1/trust/cap_01M1WSJRJN09P0YW6HGCXDC8VR