Skip to main content
ClaudeWave
Official MCP RegistryHosted serverfaceted-napped-debtless.ngrok-free.devv1.0.93057
io.github.ryuamarines/robots-txt-checker logo

io.github.ryuamarines/robots-txt-checker

Checks if a URL path is allowed by robots.txt. x402 payment required (testnet USDC).

Connect to Claude Code
Copy
claude mcp add --transport http io-github-ryuamarines-robots-txt-checker https://faceted-napped-debtless.ngrok-free.dev/robots-txt-checker/mcp
Vendor-hosted remote server: nothing to install locally. If it uses OAuth, Claude opens the vendor login on first use.
Endpoints
  • https://faceted-napped-debtless.ngrok-free.dev/robots-txt-checker/mcpstreamable-http

Published in the official MCP registry as “io.github.ryuamarines/robots-txt-checker”. Verified through the vendor namespace.

Browse all official hosted MCP servers