Endpoint · researchGETapi.webbersites.com /api/seo/robots-check ?url=https%3A%2F%2Fexample.com
robots.txt + llms.txt checker: crawler access verdicts for major search AND AI bots (Googlebot, Bingbot, GPTBot, ClaudeBot, PerplexityBot, CCBot, Google-Extended and more)…
Read more
robots.txt + llms.txt checker: crawler access verdicts for major search AND AI bots (Googlebot, Bingbot, GPTBot, ClaudeBot, PerplexityBot, CCBot, Google-Extended and more), declared sitemaps, syntax warnings, and llms.txt / llms-full.txt presence with structure summary. ?url=any page on the siteOverview
Grade?
UNRATED
0 of 30 paid calls toward a letter
Price
$0.001 per call
Paid calls
none yet
delivery unknown until someone pays
More info
Seller?
URL
https://api.webbersites.com/api/seo/robots-check?url=https%3A%2F%2Fexample.com
MCP server on this host: io.github.webberdesign/webbersites-x402-data-api
Seen
first 35 days ago · last 14 days ago
55 free handshakes
Payment
Pays through
x402 · MPP evm
Offered on?
Base USDC
Listed on?
Base
About
- ?Description
- robots.txt + llms.txt checker: crawler access verdicts for major search AND AI bots (Googlebot, Bingbot, GPTBot, ClaudeBot, PerplexityBot, CCBot, Google-Extended and more), declared sitemaps, syntax warnings, and llms.txt / llms-full.txt presence with structure summary. ?url=any page on the site
- URL
- https://api.webbersites.com/api/seo/robots-check?url=https%3A%2F%2Fexample.com
- Method
- GET
- Class
- research
- ?Checkable to
- L1
- Endpoint id
- cap_01M1A59KD9KWK2ZYHKF6EDGERP
- ?Badge
Reads live. UNRATED until paid calls earn a letter.
- Markdown
- [](https://teppi.xyz/endpoint/cap_01M1A59KD9KWK2ZYHKF6EDGERP)
- HTML
- <a href="https://teppi.xyz/endpoint/cap_01M1A59KD9KWK2ZYHKF6EDGERP"><img src="https://api.teppi.xyz/badge/cap_01M1A59KD9KWK2ZYHKF6EDGERP.svg" alt="Teppi delivery record"></a>
- Image
- https://api.teppi.xyz/badge/cap_01M1A59KD9KWK2ZYHKF6EDGERP.svg
Verify it yourself
npx teppi-check https://api.webbersites.com/api/seo/robots-check?url=https%3A%2F%2Fexample.comcurl -s https://api.teppi.xyz/v1/trust/cap_01M1A59KD9KWK2ZYHKF6EDGERP