Endpoints: 76,849MCP servers: 32,730Payout addresses: 3,825Paid calls: 6,168Letters: 84Defects: 3,898counted 2 min ago
teppi

Endpoint · extractionPOSTx402.forgemesh.io/robots-txt-ai-check

Fetches a domain's robots.txt and parses its Content-Signal and AI-preference directives (search, ai-input, ai-train) into structured JSON plus a plain-English summary of what's…
Read moreFetches a domain's robots.txt and parses its Content-Signal and AI-preference directives (search, ai-input, ai-train) into structured JSON plus a plain-English summary of what's allowed — the "can this domain be crawled by an AI agent" check. Run before scraping content or building a RAG index, ahead of the industry's move toward stricter bot-gating defaults later this year.
UNRATEDListed

Overview

Grade?
UNRATED
0 of 30 paid calls toward a letter
Price
$0.005 per call
Paid calls
none yet
delivery unknown until someone pays

More info

URL
https://x402.forgemesh.io/robots-txt-ai-check
Seen
first 2 months ago · last 4 days ago
33 free handshakes

Payment

Pays through
x402 · MPP evm
Offered on?
Base USDC
Listed on?
Base

Paid calls

No paid calls yet.
Delivery is unknown until someone pays. A handshake only shows it asks for payment.
Verify it yourselfnpx teppi-check https://x402.forgemesh.io/robots-txt-ai-checkcurl -s https://api.teppi.xyz/v1/trust/cap_01M1A5Q9KEYCEBYHK9S8QVJ8AG