Endpoint · searchGETapi.webintel-api.workers.dev /api/security/robots-security-txt ?domain=github.com
Reads a site's public robots.txt (crawl rules, sitemaps, AI-crawler rules) and security.txt (RFC 9116: contact, expiry, policy), and says whether security.txt is present, current…
Read more
Reads a site's public robots.txt (crawl rules, sitemaps, AI-crawler rules) and security.txt (RFC 9116: contact, expiry, policy), and says whether security.txt is present, current or expired. Missing files are reported as absent, not as errors. Usually answers in a few seconds, up to 23 s on slower calls; allow a 45 s timeout.Overview
Grade?
UNRATED
0 of 30 paid calls toward a letter
Price
$0.002 per call
Paid calls
none yet
delivery unknown until someone pays
More info
Seller?
URL
https://api.webintel-api.workers.dev/api/security/robots-security-txt?domain=github.com
MCP server on this host: io.github.bck-stack/sitecheck-web-intel
Seen
first 25 days ago · last 20 hr ago
54 free handshakes
Payment
Pays through
x402
Offered on?
eip155:10, Polygon, Arbitrum, eip155:42220, eip155:480, Arc, Base USDC, Solana, stellar:pubnet, xrpl:0
Listed on?
Polygon, Arbitrum, Base, Solana
Buy it through Teppi
- ?Pay on delivery
- 0.004000 USDC (0.002000 to the seller, 0.002000 fee)
- Where
- https://api.teppi.xyz/v1/via/cap_01M5P6ZJG7FM8XFXFQD5CP6TWQ
- ?Ask the price
curl -si https://api.teppi.xyz/v1/via/cap_01M5P6ZJG7FM8XFXFQD5CP6TWQ
About
- ?Description
- Reads a site's public robots.txt (crawl rules, sitemaps, AI-crawler rules) and security.txt (RFC 9116: contact, expiry, policy), and says whether security.txt is present, current or expired. Missing files are reported as absent, not as errors. Usually answers in a few seconds, up to 23 s on slower calls; allow a 45 s timeout.
- URL
- https://api.webintel-api.workers.dev/api/security/robots-security-txt?domain=github.com
- Method
- GET
- Class
- search
- ?Checkable to
- L1
- Endpoint id
- cap_01M5P6ZJG7FM8XFXFQD5CP6TWQ
- ?Badge
Reads live. UNRATED until paid calls earn a letter.
- Markdown
- [](https://teppi.xyz/endpoint/cap_01M5P6ZJG7FM8XFXFQD5CP6TWQ)
- HTML
- <a href="https://teppi.xyz/endpoint/cap_01M5P6ZJG7FM8XFXFQD5CP6TWQ"><img src="https://api.teppi.xyz/badge/cap_01M5P6ZJG7FM8XFXFQD5CP6TWQ.svg" alt="Teppi delivery record"></a>
- Image
- https://api.teppi.xyz/badge/cap_01M5P6ZJG7FM8XFXFQD5CP6TWQ.svg
Verify it yourself
npx teppi-check https://api.webintel-api.workers.dev/api/security/robots-security-txt?domain=github.comcurl -s https://api.teppi.xyz/v1/trust/cap_01M5P6ZJG7FM8XFXFQD5CP6TWQ