robots-allowed

Is a URL crawlable?

Is a URL crawlable? Fetches the site's robots.txt and evaluates the given path for a specific user-agent (Googlebot, GPTBot, ClaudeBot, Bingbot or any token; default *), returning allowed/disallowed, the matching rule, the group used, crawl-delay and declared sitemaps. Pre-flight for crawlers and SEO checks. $0.01 per check.

UNRATEDListed

Overview

Grade?

UNRATED

0 of 30 paid calls toward a letter

Price

$0.01 per call

Paid calls

none yet

delivery unknown until someone pays

More info

Seller?

0x91d56859…dbaf0abd

URL

https://intel.rallylive.ca/monitor/robots-allowed

Seen

first 22 days ago · last 10 hr ago

40 free handshakes

Payment

Pays through

x402

Offered on?

Base USDC, Base Sepolia

Listed on?

Base, Base Sepolia

Buy it through Teppi

?Pay on delivery: 0.012000 USDC (0.010000 to the seller, 0.002000 fee)
Where: https://api.teppi.xyz/v1/via/cap_01M2A294G96XDEK18X232ZEGBC
?Ask the price: curl -si -X POST https://api.teppi.xyz/v1/via/cap_01M2A294G96XDEK18X232ZEGBC -H 'content-type: application/json' -d '{}'

About

?Description

URL

https://intel.rallylive.ca/monitor/robots-allowed

Method

POST

Class

?Checkable to

Endpoint id

cap_01M2A294G96XDEK18X232ZEGBC

?Badge

Reads live. UNRATED until paid calls earn a letter.

Markdown: [![Teppi](https://api.teppi.xyz/badge/cap_01M2A294G96XDEK18X232ZEGBC.svg)](https://teppi.xyz/endpoint/cap_01M2A294G96XDEK18X232ZEGBC)
HTML: <a href="https://teppi.xyz/endpoint/cap_01M2A294G96XDEK18X232ZEGBC"><img src="https://api.teppi.xyz/badge/cap_01M2A294G96XDEK18X232ZEGBC.svg" alt="Teppi delivery record"></a>
Image: https://api.teppi.xyz/badge/cap_01M2A294G96XDEK18X232ZEGBC.svg

Verify it yourselfnpx teppi-check https://intel.rallylive.ca/monitor/robots-allowedcurl -s https://api.teppi.xyz/v1/trust/cap_01M2A294G96XDEK18X232ZEGBC