https://api.agentstools.dev/aeo/crawlersGET /aeo/crawlers · x402 API by agentstools
robots.txt AI-crawler access matrix: for the 2026 cohort of AI and answer-engine crawlers (GPTBot, ChatGPT-User, OAI-SearchBot, ClaudeBot, Claude-User, PerplexityBot, Google-Extended and more) reports allowed, blocked or unlisted per bot, whether the default rule blocks everything, declared sitemaps and a score. One network operation.
What does this x402 API do?
https://api.agentstools.dev/aeo/crawlers. This is an x402-gated GET API resource from agentstools. TOLL·402 confirmed a protocol-valid HTTP 402 quote on 2026-08-05. No normalized USD price is recorded; the listing names Base. No settled paid call has been verified.
- Published price
- No normalized USD price is recorded
- Networks
- Base
- Latest evidence
- TOLL·402 confirmed a protocol-valid HTTP 402 quote on 2026-08-05
- Resource ID
- 501d7c4e115f48a66ae9c3f3
Start with a quote-only recipe. Payment signing stays in your project.
const response = await fetch("https://api.agentstools.dev/aeo/crawlers", {
method: "GET",
});
console.log(response.status);
console.log(Object.fromEntries(response.headers));
console.log((await response.text()).slice(0, 1000));
// A valid 402 is a quote, not a completed paid call.This sends no payment. Inspect the 402 response before adding a wallet-enabled client.
- Observed in cdp-bazaar
The registry record was observed and retained with provenance.
- Observed in 402-index
Discovered through bazaar.
- Live 402 quote confirmed
GET returned a protocol-valid 402 quote (402). No payment was made.
- Registry record checked
Registry health: healthy.
- Origin reachable
OPTIONS https://api.agentstools.dev/ returned 405.
What evidence supports this listing?
Each record has an exact-route quote outcome. Unresolved templates and potentially mutating methods are labeled instead of being invoked without provider-specific test input. A quote is still separate from a settled paid call. Read the discovery and verification methodology →
Which networks and payment options does it accept?
The normalized listing price is No normalized USD price is recorded. Raw protocol requirements remain visible below for implementation and audit use.