Endpoints: 76,849MCP servers: 32,725Payout addresses: 3,825Paid calls: 6,128Letters: 84Defects: 3,888counted 1 min ago
teppi

Endpoint · lookupGETx402.agentharbor.agency/ai-crawlers?domain=agentharbor.agency

Given a website domain, reports which AI crawlers may fetch its home page under its robots.txt (RFC 9309): GPTBot, OAI-SearchBot, ChatGPT-User, ClaudeBot, Claude-SearchBot…
Read moreGiven a website domain, reports which AI crawlers may fetch its home page under its robots.txt (RFC 9309): GPTBot, OAI-SearchBot, ChatGPT-User, ClaudeBot, Claude-SearchBot, PerplexityBot, Google-Extended, Applebot-Extended, CCBot and more, each allowed or blocked, plus Googlebot, listed sitemaps, whether /llms.txt is published and page-level noindex/nosnippet, with fixes. Static check, no browser. Not charged if robots.txt cannot be read (no response, or a bot block).
UNRATEDListed

Overview

Grade?
UNRATED
0 of 30 paid calls toward a letter
Price
$0.01 per call
Paid calls
none yet
delivery unknown until someone pays

More info

URL
https://x402.agentharbor.agency/ai-crawlers?domain=agentharbor.agency
MCP server on this host: io.github.yandyman/agent-harbor-x402
Seen
first 34 days ago · last 17 hr ago
38 free handshakes

Payment

Pays through
x402 · MPP tempo
Offered on?
Base USDC, Tempo USDC.e
Listed on?
Base

Buy it through Teppi

?Pay on delivery
0.012000 USDC (0.010000 to the seller, 0.002000 fee)
Where
https://api.teppi.xyz/v1/via/cap_01M4Z1HNEEKQFR86GP0ETM2VCN
?Ask the price
curl -si https://api.teppi.xyz/v1/via/cap_01M4Z1HNEEKQFR86GP0ETM2VCN

About

?Description
Given a website domain, reports which AI crawlers may fetch its home page under its robots.txt (RFC 9309): GPTBot, OAI-SearchBot, ChatGPT-User, ClaudeBot, Claude-SearchBot, PerplexityBot, Google-Extended, Applebot-Extended, CCBot and more, each allowed or blocked, plus Googlebot, listed sitemaps, whether /llms.txt is published and page-level noindex/nosnippet, with fixes. Static check, no browser. Not charged if robots.txt cannot be read (no response, or a bot block).
URL
https://x402.agentharbor.agency/ai-crawlers?domain=agentharbor.agency
Method
GET
Class
lookup
?Checkable to
L1
Endpoint id
cap_01M4Z1HNEEKQFR86GP0ETM2VCN

?Badge

Reads live. UNRATED until paid calls earn a letter.

Markdown
[![Teppi](https://api.teppi.xyz/badge/cap_01M4Z1HNEEKQFR86GP0ETM2VCN.svg)](https://teppi.xyz/endpoint/cap_01M4Z1HNEEKQFR86GP0ETM2VCN)
HTML
<a href="https://teppi.xyz/endpoint/cap_01M4Z1HNEEKQFR86GP0ETM2VCN"><img src="https://api.teppi.xyz/badge/cap_01M4Z1HNEEKQFR86GP0ETM2VCN.svg" alt="Teppi delivery record"></a>
Image
https://api.teppi.xyz/badge/cap_01M4Z1HNEEKQFR86GP0ETM2VCN.svg
Verify it yourselfnpx teppi-check https://x402.agentharbor.agency/ai-crawlers?domain=agentharbor.agencycurl -s https://api.teppi.xyz/v1/trust/cap_01M4Z1HNEEKQFR86GP0ETM2VCN