analyze?domain=example.com

Fetch and parse a domain's robots.txt file — returns all crawl rules by user-agent, sitemap URLs, crawl delay settings, and checks whether a specific path is allowed or blocked…

Fetch and parse a domain's robots.txt file — returns all crawl rules by user-agent, sitemap URLs, crawl delay settings, and checks whether a specific path is allowed or blocked for any bot — so agents can respect crawl policies and locate sitemaps before scraping.

UNRATEDListed

Overview

Grade?

UNRATED

0 of 30 paid calls toward a letter

Price

$0.01 per call

Paid calls

none yet

delivery unknown until someone pays

More info

Seller?

0xdadc3354…fcbeb9df

URL

https://netintel.dev/robots-txt/analyze?domain=example.com

Seen

first 34 days ago · last 11 hr ago

64 free handshakes

Payment

Pays through

x402

Offered on?

Base USDC, Solana

Listed on?

Base, Solana

Paid calls

No paid calls yet.

Delivery is unknown until someone pays. A handshake only shows it asks for payment.

Paid for on the same host2 of 124 endpoints at netintel.dev

Other endpoints on netintel.dev that were paid for
Endpoint	Grade	Paid calls	Last result	Last seen
POST /exa/search	UNRATED	4	delivered	11 hr ago
GET /web/extract?url=https%3A%2F%2Fwww.sitemaps.org%2Fprotocol.html	UNRATED	1	delivered	11 hr ago

All 124 endpoints on this host

Verify it yourselfnpx teppi-check https://netintel.dev/robots-txt/analyze?domain=example.comcurl -s https://api.teppi.xyz/v1/trust/cap_01M1A59M5GWWXMXJK609Y01EHD