dataforseo_x_on-page-non-indexable $0.001 per call

Non-indexable pages. This endpoint returns a list of pages that are blocked from being indexed by Google and other search engines through robots.txt, HTTP headers, or meta tags settings. (DataForSEO · Open web & SEO data)

For AI agents: call dataforseo_x_on-page-non-indexable
POST https://toll402.dev/v1/p/dataforseo.x.on-page-non-indexable
{
 "id": "07281559-0695-0216-0000-c269be8b7592",
 "limit": 10,
 "filters": [
  [
   "reason",
   "=",
   "robots_txt"
  ],
  "and",
  [
   "url",
   "like",
   "%go%"
  ]
 ]
}
Answers 402 with x402 payment requirements; pay with any x402 client (@x402/fetch, x402 for Python, toll402-client, toll402-mcp) or send a prepaid-credits key as x-toll402-key (https://toll402.dev/credits). Paid per call via x402 (USDC on Base) or with a prepaid-credits key (x-toll402-key, card at /credits); charged only on success. Start at /llms.txt or connect the MCP server: npx -y toll402-mcp · remote https://toll402.dev/mcp.

Input schema

{
 "type": "object",
 "properties": {
  "id": {
   "type": "string",
   "description": "ID of the task required field you can get this ID in the response of the Task POST endpoint example: “07131248-1535-0216-1000-17384017ad04”",
   "examples": [
    "07281559-0695-0216-0000-c269be8b7592"
   ]
  },
  "limit": {
   "type": "integer",
   "description": "the maximum number of returned pages optional field default value: 100 maximum value: 1000",
   "examples": [
    10
   ]
  },
  "offset": {
   "type": "integer",
   "description": "offset in the results array of returned pages optional field default value: 0 maximum value: 2000000 if you specify the 10 value, the first ten pages in the results array will be omitted and the data will be provided for the successive page"
  },
  "filters": {
   "type": "array",
   "description": "array of results filtering parameters optional field you can add several filters at once (8 filters maximum) you should set a logical operator and, or between the conditions the following operators are supported: regex, not_regex, , >=, =, ",
   "examples": [
    [
     [
      "reason",
      "=",
      "robots_txt"
     ],
     "and",
     [
      "url",
      "like",
      "%go%"
     ]
    ]
   ]
  }
 },
 "additionalProperties": true,
 "description": "the POST body is a JSON array holding exactly one task object with these fields"
}

MCP

{"mcpServers":{"toll402":{"command":"npx","args":["-y","toll402-mcp"],"env":{"TOLL402_WALLET_KEY":"0x..."}}}}

All tools · OpenAPI