What tools does the robots-txt-checker MCP server provide?

robots-txt-checker exposes 1 tools: robots_txt_checker. This list was returned by the running server when we connected to it.

Does robots-txt-checker require an API key?

No. robots-txt-checker answered a tools/list request without credentials.

How do I install robots-txt-checker?

Run: claude mcp add --transport http robots-txt-checker https://faceted-napped-debtless.ngrok-free.dev/robots-txt-checker/mcp. One-click install links for Cursor and VS Code are also available on the server's page.

Connection check verified live · 27h ago

robots-txt-checker

Checks if a URL path is allowed by robots.txt. x402 payment required (testnet USDC).

Finance & crypto

Install

Remote (HTTP)

claude mcp add --transport http robots-txt-checker https://faceted-napped-debtless.ngrok-free.dev/robots-txt-checker/mcp

Tools 1

GitHub stars —

Installs / wk —

Licence —

Transport streamable-http

Last checked 27h ago

Tools & capabilities

1 tool

Read from the running server on 27h ago.

robots_txt_checker checks*payment

Checks if a URL path is allowed by robots.txt. x402 payment required (testnet USDC).

Context cost

Light

Connecting this server adds 1 tool definitions to every request — roughly 90 tokens before you ask anything.

Adds little to your context. Safe to keep connected.

Estimated at ~90 tokens per tool. Actual size varies with schema complexity — treat this as an order of magnitude, not a measurement.

both mention “allowed” · 29 tools

refund-decide verified live · 27h ago

both mention “allowed” · 1 tools

email-extractor verified live · 27h ago

both mention “testnet” · 1 tools

email-validator-2 verified live · 27h ago

both mention “testnet” · 1 tools

url-normalizer verified live · 27h ago

both mention “testnet” · 1 tools

blockstream-info verified live · 27h ago

both mention “testnet” · 39 tools

Ranked by shared tools where both expose an inventory, otherwise by shared wording.

Source & links

Registry: io.github.ryuamarines/robots-txt-checker
Endpoint: https://faceted-napped-debtless.ngrok-free.dev/robots-txt-checker/mcp
Sources: registry