Endpoint · searchGETapi.aiskills402.com /v1/skills/robots-txt-policy/file
Robots.txt Policy Writer — Turns a crawler policy written in words into a correct robots.txt, answered as the file only.
Read more
Robots.txt Policy Writer — Turns a crawler policy written in words into a correct robots.txt, answered as the file only. Knows the mistakes that make a file do the opposite of what was meant - a crawler obeys only the one group that names it, so a GPTBot group silently drops every rule written for the star group and the private paths must be repeated; longest match wins and Allow wins a tie; Google ignores Crawl-delay; Host is a Yandex-only line; Sitemap must be an absolute address; Google-Exte…Overview
Grade?
UNRATED
0 of 30 paid calls toward a letter
Price
$0.03 per call
Paid calls
none yet
delivery unknown until someone pays
More info
Seller?
URL
https://api.aiskills402.com/v1/skills/robots-txt-policy/file
Seen
first 33 days ago · last 4 days ago
70 free handshakes
Payment
Pays through
x402
Offered on?
Base USDC
Listed on?
Base
Buy it through Teppi
- ?Pay on delivery
- 0.033000 USDC (0.030000 to the seller, 0.003000 fee)
- Where
- https://api.teppi.xyz/v1/via/cap_01M51M0V6GWZ6H2BRC8BNGWDC5
- ?Ask the price
curl -si https://api.teppi.xyz/v1/via/cap_01M51M0V6GWZ6H2BRC8BNGWDC5
About
- ?Description
- Robots.txt Policy Writer — Turns a crawler policy written in words into a correct robots.txt, answered as the file only. Knows the mistakes that make a file do the opposite of what was meant - a crawler obeys only the one group that names it, so a GPTBot group silently drops every rule written for the star group and the private paths must be repeated; longest match wins and Allow wins a tie; Google ignores Crawl-delay; Host is a Yandex-only line; Sitemap must be an absolute address; Google-Exte…
- URL
- https://api.aiskills402.com/v1/skills/robots-txt-policy/file
- Method
- GET
- Class
- search
- ?Checkable to
- L1
- Endpoint id
- cap_01M51M0V6GWZ6H2BRC8BNGWDC5
- ?Badge
Reads live. UNRATED until paid calls earn a letter.
- Markdown
- [](https://teppi.xyz/endpoint/cap_01M51M0V6GWZ6H2BRC8BNGWDC5)
- HTML
- <a href="https://teppi.xyz/endpoint/cap_01M51M0V6GWZ6H2BRC8BNGWDC5"><img src="https://api.teppi.xyz/badge/cap_01M51M0V6GWZ6H2BRC8BNGWDC5.svg" alt="Teppi delivery record"></a>
- Image
- https://api.teppi.xyz/badge/cap_01M51M0V6GWZ6H2BRC8BNGWDC5.svg
Verify it yourself
npx teppi-check https://api.aiskills402.com/v1/skills/robots-txt-policy/filecurl -s https://api.teppi.xyz/v1/trust/cap_01M51M0V6GWZ6H2BRC8BNGWDC5