Endpoint · searchPOSTagent402.tools /api/site-crawl
Crawl a website from a starting URL and return each page as clean markdown: breadth-first over internal links, bounded by page count and depth, honouring robots.txt, with per-page…
Read more
Crawl a website from a starting URL and return each page as clean markdown: breadth-first over internal links, bounded by page count and depth, honouring robots.txt, with per-page title, status, depth and outbound links. Use it when an agent needs a whole section of a site rather than one known page.Overview
Grade?
UNRATED
0 of 30 paid calls toward a letter
Price
$0.02 per call
Paid calls
none yet
delivery unknown until someone pays
More info
Seller?
Seen
first 29 days ago · last 14 hr ago
54 free handshakes
Payment
Pays through
x402 · MPP evm, tempo
Offered on?
algorand:wGHE2Pwdvd7S12BL5FaOP20EGYesN73ktiC1qzkkit8=, eip155:10, eip155:1329, Polygon, eip155:143, Arbitrum, eip155:42220, Avalanche, Robinhood Chain, Base USDC, Solana, stellar:pubnet, Tempo USDC.e
Listed on?
Polygon, Arbitrum, Avalanche, Base, Solana
Buy it through Teppi
- ?Pay on delivery
- 0.022000 USDC (0.020000 to the seller, 0.002000 fee)
- Where
- https://api.teppi.xyz/v1/via/cap_01M1RD9FNH0CRVMYZCQPF44PN4
- ?Ask the price
curl -si -X POST https://api.teppi.xyz/v1/via/cap_01M1RD9FNH0CRVMYZCQPF44PN4 -H 'content-type: application/json' -d '{}'
About
- ?Description
- Crawl a website from a starting URL and return each page as clean markdown: breadth-first over internal links, bounded by page count and depth, honouring robots.txt, with per-page title, status, depth and outbound links. Use it when an agent needs a whole section of a site rather than one known page.
- URL
- https://agent402.tools/api/site-crawl
- Method
- POST
- Class
- search
- ?Checkable to
- L1
- Endpoint id
- cap_01M1RD9FNH0CRVMYZCQPF44PN4
- ?Badge
Reads live. UNRATED until paid calls earn a letter.
- Markdown
- [](https://teppi.xyz/endpoint/cap_01M1RD9FNH0CRVMYZCQPF44PN4)
- HTML
- <a href="https://teppi.xyz/endpoint/cap_01M1RD9FNH0CRVMYZCQPF44PN4"><img src="https://api.teppi.xyz/badge/cap_01M1RD9FNH0CRVMYZCQPF44PN4.svg" alt="Teppi delivery record"></a>
- Image
- https://api.teppi.xyz/badge/cap_01M1RD9FNH0CRVMYZCQPF44PN4.svg
Verify it yourself
npx teppi-check https://agent402.tools/api/site-crawlcurl -s https://api.teppi.xyz/v1/trust/cap_01M1RD9FNH0CRVMYZCQPF44PN4