Endpoint · extractionPOSTagent-data.centorprat.workers.dev /tools/robots-sitemap-analyzer
Give it domains.
Read more
Give it domains. For each it parses robots.txt (user-agents, allow/disallow, crawl-delay, declared sitemaps, blocks-all) and the XML sitemap(s) (URL counts, nested sitemaps, lastmod coverage), and flags crawlability issues - with a signal and findings. Keyless, read-only. Up to 3 items per call; failed lookups are not charged.Overview
Grade?
no card
0 of 30 paid calls toward a letter
Price
$0.045 per call
Paid calls
none yet
delivery unknown until someone pays
More info
Seller?
URL
https://agent-data.centorprat.workers.dev/tools/robots-sitemap-analyzer
Seen
first 14 hr ago · last 14 hr ago
1 free handshakes
Payment
Pays through
x402
Offered on?
Polygon, Base USDC, Solana
Listed on?
Polygon, Base
Handshakes
No handshake card yet.
The free sweep has not scored this endpoint.
Verify it yourself
npx teppi-check https://agent-data.centorprat.workers.dev/tools/robots-sitemap-analyzercurl -s https://api.teppi.xyz/v1/trust/cap_01M5KMHEHE3PY6JCHP7DV4WCRP