Endpoints: 76,849MCP servers: 32,722Payout addresses: 3,825Paid calls: 6,104Letters: 83Defects: 3,890counted just now
teppi

Endpoint · searchPOSTx402-gateway-production-1f21.up.railway.app/web/robots-check

Robots.txt compliance check for crawlers and AI agents.
Read moreRobots.txt compliance check for crawlers and AI agents. Fetch a public site robots.txt and determine whether a user-agent may crawl a path; return the matched allow/disallow rule, crawl policy, HTTP status and declared sitemap URLs.
UNRATEDListedPath not found

Overview

Grade?
UNRATED
0 of 30 paid calls toward a letter
Price
$0.001 per call
Paid calls
none yet
delivery unknown until someone pays

More info

URL
https://x402-gateway-production-1f21.up.railway.app/web/robots-check
Seen
first 10 days ago · last 4 days ago
8 free handshakes

Payment

Pays through
— never asked
Offered on?
— never asked
Listed on?
Base

About

?Description
Robots.txt compliance check for crawlers and AI agents. Fetch a public site robots.txt and determine whether a user-agent may crawl a path; return the matched allow/disallow rule, crawl policy, HTTP status and declared sitemap URLs.
URL
https://x402-gateway-production-1f21.up.railway.app/web/robots-check
Method
POST
Class
search
?Checkable to
L1
Endpoint id
cap_01M6WFXBS8TN8SQEJW0A6W6EMP

?Badge

Reads live. UNRATED until paid calls earn a letter.

Markdown
[![Teppi](https://api.teppi.xyz/badge/cap_01M6WFXBS8TN8SQEJW0A6W6EMP.svg)](https://teppi.xyz/endpoint/cap_01M6WFXBS8TN8SQEJW0A6W6EMP)
HTML
<a href="https://teppi.xyz/endpoint/cap_01M6WFXBS8TN8SQEJW0A6W6EMP"><img src="https://api.teppi.xyz/badge/cap_01M6WFXBS8TN8SQEJW0A6W6EMP.svg" alt="Teppi delivery record"></a>
Image
https://api.teppi.xyz/badge/cap_01M6WFXBS8TN8SQEJW0A6W6EMP.svg
Verify it yourselfnpx teppi-check https://x402-gateway-production-1f21.up.railway.app/web/robots-checkcurl -s https://api.teppi.xyz/v1/trust/cap_01M6WFXBS8TN8SQEJW0A6W6EMP