Endpoints: 76,849MCP servers: 32,724Payout addresses: 3,825Paid calls: 6,116Letters: 83Defects: 3,887counted 3 min ago
teppi

Endpoint · extractionGETapexfaucet.xyz/api/x402/robots-check?agent=GPTBot&path=%2Fw%2F&url=https%3A%2F%2Fen.wikipedia.org%2Fwiki%2FWeb_crawler

Pass ?url= (any page of a site), optional ?agent= (default *, e.g.
Read morePass ?url= (any page of a site), optional ?agent= (default *, e.g. GPTBot or Googlebot) and ?path=. We fetch the origin's /robots.txt, parse its groups (User-agent, Allow, Disallow, Crawl-delay, Sitemap) and say whether the path is allowed for that agent by the longest-match rule, which rule decided it, and the sitemaps listed. A missing robots.txt (HTTP 4xx) means allowed; a 5xx, 429 or no answer is reported as unknown (allowed: null). Reads the first 600 KB.
UNRATEDListed

Overview

Grade?
UNRATED
0 of 30 paid calls toward a letter
Price
$0.001 per call
Paid calls
none yet
delivery unknown until someone pays

More info

URL
https://apexfaucet.xyz/api/x402/robots-check?agent=GPTBot&path=%2Fw%2F&url=https%3A%2F%2Fen.wikipedia.org%2Fwiki%2FWeb_crawler
MCP server on this host: xyz.apexfaucet/apex-x1
Seen
first 12 days ago · last 4 days ago
20 free handshakes

Payment

Pays through
x402
Offered on?
Robinhood Chain, Arc, eip155:56, Base USDC, Solana
Listed on?
Base, Solana

Buy it through Teppi

?Pay on delivery
0.003000 USDC (0.001000 to the seller, 0.002000 fee)
Where
https://api.teppi.xyz/v1/via/cap_01M6RBYV0DYCNMSR8A9SWJ0TAR
?Ask the price
curl -si https://api.teppi.xyz/v1/via/cap_01M6RBYV0DYCNMSR8A9SWJ0TAR

About

?Description
Pass ?url= (any page of a site), optional ?agent= (default *, e.g. GPTBot or Googlebot) and ?path=. We fetch the origin's /robots.txt, parse its groups (User-agent, Allow, Disallow, Crawl-delay, Sitemap) and say whether the path is allowed for that agent by the longest-match rule, which rule decided it, and the sitemaps listed. A missing robots.txt (HTTP 4xx) means allowed; a 5xx, 429 or no answer is reported as unknown (allowed: null). Reads the first 600 KB.
URL
https://apexfaucet.xyz/api/x402/robots-check?agent=GPTBot&path=%2Fw%2F&url=https%3A%2F%2Fen.wikipedia.org%2Fwiki%2FWeb_crawler
Method
GET
Class
extraction
?Checkable to
L1
Endpoint id
cap_01M6RBYV0DYCNMSR8A9SWJ0TAR

?Badge

Reads live. UNRATED until paid calls earn a letter.

Markdown
[![Teppi](https://api.teppi.xyz/badge/cap_01M6RBYV0DYCNMSR8A9SWJ0TAR.svg)](https://teppi.xyz/endpoint/cap_01M6RBYV0DYCNMSR8A9SWJ0TAR)
HTML
<a href="https://teppi.xyz/endpoint/cap_01M6RBYV0DYCNMSR8A9SWJ0TAR"><img src="https://api.teppi.xyz/badge/cap_01M6RBYV0DYCNMSR8A9SWJ0TAR.svg" alt="Teppi delivery record"></a>
Image
https://api.teppi.xyz/badge/cap_01M6RBYV0DYCNMSR8A9SWJ0TAR.svg
Verify it yourselfnpx teppi-check https://apexfaucet.xyz/api/x402/robots-check?agent=GPTBot&path=%2Fw%2F&url=https%3A%2F%2Fen.wikipedia.org%2Fwiki%2FWeb_crawlercurl -s https://api.teppi.xyz/v1/trust/cap_01M6RBYV0DYCNMSR8A9SWJ0TAR