Endpoint · extractionPOSTagent-data.centorprat.workers.dev /tools/robots-sitemap-analyzer
Give it domains.
Read more
Give it domains. For each it parses robots.txt (user-agents, allow/disallow, crawl-delay, declared sitemaps, blocks-all) and the XML sitemap(s) (URL counts, nested sitemaps, lastmod coverage), and flags crawlability issues - with a signal and findings. Keyless, read-only. Up to 3 items per call; failed lookups are not charged.Overview
Grade?
no card
0 of 30 paid calls toward a letter
Price
$0.045 per call
Paid calls
none yet
delivery unknown until someone pays
More info
Seller?
URL
https://agent-data.centorprat.workers.dev/tools/robots-sitemap-analyzer
Seen
first 14 hr ago · last 14 hr ago
1 free handshakes
Payment
Pays through
x402
Offered on?
Polygon, Base USDC, Solana
Listed on?
Polygon, Base
Buy it through Teppi
- ?Pay on delivery
- 0.049500 USDC (0.045000 to the seller, 0.004500 fee)
- Where
- https://api.teppi.xyz/v1/via/cap_01M5KMHEHE3PY6JCHP7DV4WCRP
- ?Ask the price
curl -si -X POST https://api.teppi.xyz/v1/via/cap_01M5KMHEHE3PY6JCHP7DV4WCRP -H 'content-type: application/json' -d '{}'
About
- ?Description
- Give it domains. For each it parses robots.txt (user-agents, allow/disallow, crawl-delay, declared sitemaps, blocks-all) and the XML sitemap(s) (URL counts, nested sitemaps, lastmod coverage), and flags crawlability issues - with a signal and findings. Keyless, read-only. Up to 3 items per call; failed lookups are not charged.
- URL
- https://agent-data.centorprat.workers.dev/tools/robots-sitemap-analyzer
- Method
- POST
- Class
- extraction
- ?Checkable to
- L1
- Endpoint id
- cap_01M5KMHEHE3PY6JCHP7DV4WCRP
- ?Badge
Reads live. UNRATED until paid calls earn a letter.
- Markdown
- [](https://teppi.xyz/endpoint/cap_01M5KMHEHE3PY6JCHP7DV4WCRP)
- HTML
- <a href="https://teppi.xyz/endpoint/cap_01M5KMHEHE3PY6JCHP7DV4WCRP"><img src="https://api.teppi.xyz/badge/cap_01M5KMHEHE3PY6JCHP7DV4WCRP.svg" alt="Teppi delivery record"></a>
- Image
- https://api.teppi.xyz/badge/cap_01M5KMHEHE3PY6JCHP7DV4WCRP.svg
Verify it yourself
npx teppi-check https://agent-data.centorprat.workers.dev/tools/robots-sitemap-analyzercurl -s https://api.teppi.xyz/v1/trust/cap_01M5KMHEHE3PY6JCHP7DV4WCRP