Crawler IP Verifier - real Googlebot or fake
{"jsonrpc":"2.0","id":1,"method":"tools/call","params":{"name":"whoami","arguments":{}}} free no key
Open the source (opens pathwren.workers.dev) https://pathwren.workers.dev/c/mcp-registry-official/mcp-netcheck.html
Before you use it
- Runs on someone else's server: what you send it leaves your machine.
What it is
MCP servers from dev.workers.pathwren.www.
The problem it solves and who it suits haven't been reviewed by InnerVault. The description above is the source's own.
How to get it
Remote endpoint (streamable-http)
https://www.pathwren.workers.dev/c/mcp-registry-official/mcp/netcheck
From the server's entry in the official MCP Registry
Related
-
doc-scraper
MCP serversGo web crawler to scrape documentation sites and convert content to clean Markdown for LLM ingestion (RAG, training data)
git clone https://github.com/Sriram-PR/doc-scraper.git -
ai-crawler-policy
MCP serversCloudflare Workers MCP server: ai-crawler-policy
-
Open SEO Crawler
MCP serversSelf-hosted SEO crawler: run site audits and AI crawler checks, then read the issues and pages.
https://github.com/puneetindersingh/open-seo-crawler/releases/download/mcp-v1.0.0/open-seo-crawler-mcp.mcpb@1.0.0 -
graphlit-mcp-server
MCP serversModel Context Protocol (MCP) Server for Graphlit Platform
git clone https://github.com/graphlit/graphlit-mcp-server.git -
polite-crawler
MCP serversA polite crawler for agents: obeys robots.txt, fetches each page once, finds and verifies quotes.
polite-crawler-mcp@0.7.6 -
Atalaya AI crawler check
MCP serversWhich AI crawlers (GPTBot, OAI-SearchBot, ClaudeBot, PerplexityBot) a website allows, and why.