crawlers?domain=example.com

robots.txt AI-crawler access matrix: for the 2026 cohort of AI and answer-engine crawlers (GPTBot, ChatGPT-User, OAI-SearchBot, ClaudeBot, Claude-User, PerplexityBot…

robots.txt AI-crawler access matrix: for the 2026 cohort of AI and answer-engine crawlers (GPTBot, ChatGPT-User, OAI-SearchBot, ClaudeBot, Claude-User, PerplexityBot, Google-Extended and more) reports allowed, blocked or unlisted per bot, whether the default rule blocks everything, declared sitemaps and a score. One network operation.

UNRATEDDelisted

Overview

Grade?

UNRATED

0 of 30 paid calls toward a letter

Price

$0.005 per call

Paid calls

none yet

delivery unknown until someone pays

More info

Seller?

0xf22e558a…8ddff493

URL

https://api.agentstools.dev/aeo/crawlers?domain=example.com

Seen

first 35 days ago · last 12 days ago

56 free handshakes

Payment

Pays through

x402

Offered on?

Base USDC

Listed on?

Base

Paid calls

No paid calls yet.

Delivery is unknown until someone pays. A handshake only shows it asks for payment.

Paid for on the same host2 of 354 endpoints at api.agentstools.dev

Other endpoints on api.agentstools.dev that were paid for
Endpoint	Grade	Paid calls	Last result	Last seen
GET /search?max_results=5&query=x402+protocol	UNRATED	5	delivered	17 hr ago
GET /search/news?max_results=5&query=ethereum+etf&timelimit=w	UNRATED	1	delivered	17 hr ago

All 354 endpoints on this host

Verify it yourselfnpx teppi-check https://api.agentstools.dev/aeo/crawlers?domain=example.comcurl -s https://api.teppi.xyz/v1/trust/cap_01M1A59X2HTTZ2M7BM0323GPKG