Endpoint · extractionPOSTintel.rallylive.ca /site/robots
robots.txt fetched and parsed: every user-agent group with its allow/disallow rules and crawl-delay, declared sitemaps, and whether the file exists at all.
Read more
robots.txt fetched and parsed: every user-agent group with its allow/disallow rules and crawl-delay, declared sitemaps, and whether the file exists at all. Understand a site's crawl policy before fetching it. $0.01 per site.Overview
Grade?
UNRATED
0 of 30 paid calls toward a letter
Price
$0.01 per call
Paid calls
none yet
delivery unknown until someone pays
More info
Seller?
URL
https://intel.rallylive.ca/site/robots
Seen
first 22 days ago · last 17 hr ago
41 free handshakes
Payment
Pays through
x402
Offered on?
Base USDC, Base Sepolia
Listed on?
Base, Base Sepolia
Buy it through Teppi
- ?Pay on delivery
- 0.012000 USDC (0.010000 to the seller, 0.002000 fee)
- Where
- https://api.teppi.xyz/v1/via/cap_01M2A2971C5S7RKQV4TTNHS4CM
- ?Ask the price
curl -si -X POST https://api.teppi.xyz/v1/via/cap_01M2A2971C5S7RKQV4TTNHS4CM -H 'content-type: application/json' -d '{}'
About
- ?Description
- robots.txt fetched and parsed: every user-agent group with its allow/disallow rules and crawl-delay, declared sitemaps, and whether the file exists at all. Understand a site's crawl policy before fetching it. $0.01 per site.
- URL
- https://intel.rallylive.ca/site/robots
- Method
- POST
- Class
- extraction
- ?Checkable to
- L1
- Endpoint id
- cap_01M2A2971C5S7RKQV4TTNHS4CM
- ?Badge
Reads live. UNRATED until paid calls earn a letter.
- Markdown
- [](https://teppi.xyz/endpoint/cap_01M2A2971C5S7RKQV4TTNHS4CM)
- HTML
- <a href="https://teppi.xyz/endpoint/cap_01M2A2971C5S7RKQV4TTNHS4CM"><img src="https://api.teppi.xyz/badge/cap_01M2A2971C5S7RKQV4TTNHS4CM.svg" alt="Teppi delivery record"></a>
- Image
- https://api.teppi.xyz/badge/cap_01M2A2971C5S7RKQV4TTNHS4CM.svg
Verify it yourself
npx teppi-check https://intel.rallylive.ca/site/robotscurl -s https://api.teppi.xyz/v1/trust/cap_01M2A2971C5S7RKQV4TTNHS4CM