crawl4ai_web_crawl $0.093938 per call

Crawl a whole site as a background job. Crawls one site level by level from a start URL, inside the site, through include and exclude filters, cut at max_pages; runs only as a job. Poll it with crawl4ai.web.scrape.job.status and read the pages (url, level, title, status, links, markdown or html) with crawl4ai.web.scrape.job.results. (Crawl4AI · Open web & SEO data) Async task: answers 202 with a job id; poll GET /v1/jobs/<id>. Price depends on the options (up to $0.093938); refunded if the task fails. Prepaid credits only.

For AI agents: call crawl4ai_web_crawl
POST https://toll402.dev/v1/p/crawl4ai.web.crawl
{
 "url": "https://example.com/",
 "depth": 1,
 "max_pages": 3
}
Answers 402 with x402 payment requirements; pay with any x402 client (@x402/fetch, x402 for Python, toll402-client, toll402-mcp) or send a prepaid-credits key as x-toll402-key (https://toll402.dev/credits). Paid per call via x402 (USDC on Base) or with a prepaid-credits key (x-toll402-key, card at /credits); charged only on success. Start at /llms.txt or connect the MCP server: npx -y toll402-mcp · remote https://toll402.dev/mcp.

Input schema

{
 "type": "object",
 "properties": {
  "url": {
   "type": "string",
   "description": "the start page, an http(s) URL",
   "examples": [
    "https://docs.crawl4ai.com/"
   ]
  },
  "depth": {
   "type": "integer",
   "default": 2
  },
  "max_pages": {
   "type": "integer",
   "default": 100
  },
  "include": {
   "type": "string",
   "description": "follow only matching URLs: a path prefix or a glob with *"
  },
  "exclude": {
   "type": "string",
   "description": "never follow matching URLs, same form as include"
  },
  "include_subdomains": {
   "type": "boolean",
   "default": false
  },
  "content": {
   "type": "string",
   "default": "md",
   "enum": [
    "md",
    "html",
    "none"
   ]
  }
 },
 "additionalProperties": true,
 "required": [
  "url"
 ]
}

MCP

{"mcpServers":{"toll402":{"command":"npx","args":["-y","toll402-mcp"],"env":{"TOLL402_WALLET_KEY":"0x..."}}}}

All tools · OpenAPI