Library
85,762 resources from 11 public sources. 54 checked by hand; the rest are unreviewed.
Results
Looks like a goal we have a starting path for: I want to research potential clients
-
rankparse-mcp
MCP serversSEO MCP server — backlinks, domain authority, tech stack, and 18+ tools via Common Crawl.
-
SearXNG MCP Server
MCP serversSelf-hosted SearXNG metasearch for MCP clients: 13 tools, citation refs, deep search and crawling.
searxng-mcp-server@1.0.1 -
rasterly
MCP serversWeb toolkit for AI agents: read any URL as Markdown, screenshot, extract data, or crawl a site.
rasterly-mcp@0.2.0 -
Crawlgraph
MCP serversCrawlGraph MCP — backlink intelligence on the public Common Crawl webgraph (4.4B edges, 120M…
@pipeworx/mcp-crawlgraph@0.2.1 -
crawlgraph-mcp
MCP serversBacklink lookups and competitor gap analysis on Common Crawl's open web graph (4.4B links).
https://github.com/pucilpet/crawlgraph-mcp/releases/download/v0.2.2/crawlgraph-mcp.mcpb -
mcp
MCP serversRun web performance audits, get code-level fixes, crawl for SEO, and read real-user Core Web Vitals.
@speedvault/mcp@1.0.3 -
Eclipse Crawlway
MCP serversPay-per-crawl licensing receipts: sealed identity+terms+fingerprint binding. LOCAL/fixture only.
-
ai-visibility
MCP serversAI-search-visibility tools: check crawler access, generate llms.txt, lint robots.txt, census data.
-
Site Check
MCP serversPublic website health scan, AI-crawler and structured-data readiness, and a local presence score.
-
momentic
MCP serversFree SEO, GEO, and AEO audits: analyze any page or domain, AI-crawler access, agent readiness.
-
Crawl4Agent
MCP serverscrawl4ai-compatible web crawler API: POST a URL, get clean LLM-ready Markdown with fit_markdown...
-
GEO Inspector
MCP serversInspect a site's AI-search readiness: AI crawler access, llms.txt, schema markup, meta directives
geo-inspector-mcp@0.1.2 -
Scrawly MCP Server
MCP serversMCP server for the Scrawly SEO crawler: query local audits and propose confirmation-gated fixes.
sentinelseo@1.0.0 -
tdm-reservation-lint
MCP serversFinds the robots.txt lines that reserve nothing — retired crawler tokens, shadowed groups, rules abo
@readystack/tdm-reservation-lint@1.0.5 -
AI Visibility Checker
MCP serversAI visibility checker: GPTBot vs OAI-SearchBot, robots.txt audit, raw-HTML schema. 165 crawlers.
https://github.com/krisdiallo/ecom-agent/releases/download/v1.5.3/aivis.mcpb@1.5.3 -
robotstxt-ai
MCP serversAnalyze and generate robots.txt with AI crawler detection for 20+ bots like GPTBot and ClaudeBot.
robotstxt-ai-mcp@1.0.1 -
geo-tool-check
MCP serversIs this page readable for AI search? Crawler access, structure and citability checks, runs locally.
geo-tool-check@1.0.1 -
CitedBy
MCP serversCheck a page, AI-crawler access, llms.txt and backlinks of a site. Free, read-only.
-
QueryRev AI Readiness
MCP serversChecks a site for AI crawler access, robots.txt and llms.txt. Runs locally, no telemetry.
@queryrev/ai-readiness-mcp@1.0.0 -
SEOClave
MCP serversGoogle keyword data for Latin America plus technical SEO, robots.txt, DNS and AI-crawler checks.
-
scrapercity-cli
MCP serversB2B lead generation MCP server - 20+ scrapers, email finder, skip trace, and more.
scrapercity@1.0.1 -
seo-web-analysis-mcp-server
MCP serversOn-page crawl, tech-stack detection, DNS, SSL and WHOIS as agent tools.
-
Viral Outliers
MCP serversFind viral outlier posts on TikTok, Instagram and YouTube, pull creator stats, and crawl on demand.
-
PageWire
MCP serversWeb pages to Markdown, metadata and small crawls for agents. Free daily calls, then USDC x402/MPP.
Indexed entries aren't reviewed or tested by InnerVault. Details come straight from each source. Anything that can reach your accounts, files or browser can do damage, so read the source before you install it.