AI Crawler Index
{"jsonrpc":"2.0","id":1,"method":"tools/call","params":{"name":"whoami","arguments":{}}} free no key
Open the source (opens pathwren.workers.dev) https://pathwren.workers.dev/c/mcp-registry-official/mcp.html
Before you use it
- Runs on someone else's server: what you send it leaves your machine.
What it is
MCP servers from dev.workers.pathwren.www.
The problem it solves and who it suits haven't been reviewed by InnerVault. The description above is the source's own.
How to get it
Remote endpoint (streamable-http)
https://www.pathwren.workers.dev/c/mcp-registry-official/mcp
From the server's entry in the official MCP Registry
Related
-
IndexLinks
MCP serversCheck how crawlers see a site, send new pages to search engines and AI crawlers, see crawl receipts.
-
ai-crawler-readiness
MCP serversCan AI crawlers read this site? GPTBot/ClaudeBot verdicts, robots vs edge blocking, 47k-domain index
-
IndexPulse
MCP serversBing Webmaster, IndexNow and Google Search Console for AI: rankings, indexing gaps, AI crawlers.
-
mcp-my-site
MCP serversSearch and fetch tools for one website, served from an index you build with the mcpmysite crawler.
ghcr.io/pournasserian/mcp-my-site:0.4.0 -
Apify MCP Server
MCP serversExtract data from any website with thousands of scrapers, crawlers, and automations on Apify Store ⚡
-
doc-scraper
MCP serversGo web crawler to scrape documentation sites and convert content to clean Markdown for LLM ingestion (RAG, training data)
git clone https://github.com/Sriram-PR/doc-scraper.git