crawl-map

Discover all URLs reachable from a domain within a link depth limit.

Discover all URLs reachable from a domain within a link depth limit. Returns a flat list of absolute URLs, respects robots.txt crawl delays. Use it to map a site's structure before crawling.

UNRATEDDelisted

Overview

Grade?

UNRATED

0 of 30 paid calls toward a letter

Price

$0.05 per call

Paid calls

none yet

delivery unknown until someone pays

More info

Seller?

0x23fc725e…a6dfc75d

URL

https://api.agishub.com/v1/crawl-map

MCP server on this host: com.agishub/agent-memory

Seen

first 25 days ago · last 13 days ago

33 free handshakes

Payment

Pays through

x402

Offered on?

Base USDC

Listed on?

Base

About

?Description

Discover all URLs reachable from a domain within a link depth limit. Returns a flat list of absolute URLs, respects robots.txt crawl delays. Use it to map a site's structure before crawling.

URL

https://api.agishub.com/v1/crawl-map

Method

POST

Class

lookup

?Checkable to

Endpoint id

cap_01M22B3GV5RCER6VFEWFDNVQW3

?Badge

Reads live. UNRATED until paid calls earn a letter.

Markdown: [![Teppi](https://api.teppi.xyz/badge/cap_01M22B3GV5RCER6VFEWFDNVQW3.svg)](https://teppi.xyz/endpoint/cap_01M22B3GV5RCER6VFEWFDNVQW3)
HTML: <a href="https://teppi.xyz/endpoint/cap_01M22B3GV5RCER6VFEWFDNVQW3"><img src="https://api.teppi.xyz/badge/cap_01M22B3GV5RCER6VFEWFDNVQW3.svg" alt="Teppi delivery record"></a>
Image: https://api.teppi.xyz/badge/cap_01M22B3GV5RCER6VFEWFDNVQW3.svg

Verify it yourselfnpx teppi-check https://api.agishub.com/v1/crawl-mapcurl -s https://api.teppi.xyz/v1/trust/cap_01M22B3GV5RCER6VFEWFDNVQW3