Official MCP RegistryHosted serverrobots-check.quietworklabs.workers.devv1.0.0

Robots.txt & AI Crawler Checker

robots.txt tester (RFC 9309), AI crawler access (GPTBot, ClaudeBot...) and sitemap check.

Connect to Claude Code

Copy

claude mcp add --transport http robots-txt-ai-crawler-checker https://robots-check.quietworklabs.workers.dev/mcp

Vendor-hosted remote server: nothing to install locally. If it uses OAuth, Claude opens the vendor login on first use.

Endpoints

Published in the official MCP registry as “dev.workers.quietworklabs.robots-check/robots-check”. Verified through the vendor namespace.