Endpoint · lookupGETcrawl-preflight.postnov01.workers.dev /crawl-check/sitepoint.com
Crawl pre-flight for a domain: will you be blocked, is content behind a paywall, and how much is actually there.
Read more
Crawl pre-flight for a domain: will you be blocked, is content behind a paywall, and how much is actually there. Returns per-bot robots.txt verdicts for 16 AI crawlers, crawlable page count from sitemaps, detected CDN and paid-access signals (x402, TollBit), plus a fetch/skip recommendation. Call before spending requests on an unknown domain.Overview
Grade?
UNRATED
0 of 30 paid calls toward a letter
Price
$0.02 per call
Paid calls
none yet
delivery unknown until someone pays
More info
Seller?
URL
https://crawl-preflight.postnov01.workers.dev/crawl-check/sitepoint.com
Seen
first 35 days ago · last 4 days ago
65 free handshakes
Payment
Pays through
x402
Offered on?
Polygon, Arbitrum, Base USDC
Listed on?
Polygon, Arbitrum, Base
Buy it through Teppi
- ?Pay on delivery
- 0.022000 USDC (0.020000 to the seller, 0.002000 fee)
- Where
- https://api.teppi.xyz/v1/via/cap_01M1A59N966K1SJMG1Q4GPRQB1
- ?Ask the price
curl -si https://api.teppi.xyz/v1/via/cap_01M1A59N966K1SJMG1Q4GPRQB1
About
- ?Description
- Crawl pre-flight for a domain: will you be blocked, is content behind a paywall, and how much is actually there. Returns per-bot robots.txt verdicts for 16 AI crawlers, crawlable page count from sitemaps, detected CDN and paid-access signals (x402, TollBit), plus a fetch/skip recommendation. Call before spending requests on an unknown domain.
- URL
- https://crawl-preflight.postnov01.workers.dev/crawl-check/sitepoint.com
- Method
- GET
- Class
- lookup
- ?Checkable to
- L1
- Endpoint id
- cap_01M1A59N966K1SJMG1Q4GPRQB1
- ?Badge
Reads live. UNRATED until paid calls earn a letter.
- Markdown
- [](https://teppi.xyz/endpoint/cap_01M1A59N966K1SJMG1Q4GPRQB1)
- HTML
- <a href="https://teppi.xyz/endpoint/cap_01M1A59N966K1SJMG1Q4GPRQB1"><img src="https://api.teppi.xyz/badge/cap_01M1A59N966K1SJMG1Q4GPRQB1.svg" alt="Teppi delivery record"></a>
- Image
- https://api.teppi.xyz/badge/cap_01M1A59N966K1SJMG1Q4GPRQB1.svg
Verify it yourself
npx teppi-check https://crawl-preflight.postnov01.workers.dev/crawl-check/sitepoint.comcurl -s https://api.teppi.xyz/v1/trust/cap_01M1A59N966K1SJMG1Q4GPRQB1