Library
85,340 resources from 11 public sources. 54 checked by hand; the rest are unreviewed.
Results
Looks like a goal we have a starting path for: I want to research potential clients
-
ai-visibility
MCP serversAI-search-visibility tools: check crawler access, generate llms.txt, lint robots.txt, census data.
-
Site Check
MCP serversPublic website health scan, AI-crawler and structured-data readiness, and a local presence score.
-
momentic
MCP serversFree SEO, GEO, and AEO audits: analyze any page or domain, AI-crawler access, agent readiness.
-
Crawl4Agent
MCP serverscrawl4ai-compatible web crawler API: POST a URL, get clean LLM-ready Markdown with fit_markdown...
-
GEO Inspector
MCP serversInspect a site's AI-search readiness: AI crawler access, llms.txt, schema markup, meta directives
geo-inspector-mcp@0.1.2 -
crawl-readiness
MCP serversCheck what AI crawlers may read and what a page permits, generate llms.txt and schema.
crawl-readiness-mcp@0.2.9 -
Scrawly MCP Server
MCP serversMCP server for the Scrawly SEO crawler: query local audits and propose confirmation-gated fixes.
sentinelseo@1.0.0 -
tdm-reservation-lint
MCP serversFinds the robots.txt lines that reserve nothing — retired crawler tokens, shadowed groups, rules abo
@readystack/tdm-reservation-lint@1.0.5 -
AI Visibility Checker
MCP serversAI visibility checker: GPTBot vs OAI-SearchBot, robots.txt audit, raw-HTML schema. 165 crawlers.
https://github.com/krisdiallo/ecom-agent/releases/download/v1.5.3/aivis.mcpb@1.5.3 -
robotstxt-ai
MCP serversAnalyze and generate robots.txt with AI crawler detection for 20+ bots like GPTBot and ClaudeBot.
robotstxt-ai-mcp@1.0.1 -
geo-tool-check
MCP serversIs this page readable for AI search? Crawler access, structure and citability checks, runs locally.
geo-tool-check@1.0.1 -
CitedBy
MCP serversCheck a page, AI-crawler access, llms.txt and backlinks of a site. Free, read-only.
-
QueryRev AI Readiness
MCP serversChecks a site for AI crawler access, robots.txt and llms.txt. Runs locally, no telemetry.
@queryrev/ai-readiness-mcp@1.0.0 -
SEOClave
MCP serversGoogle keyword data for Latin America plus technical SEO, robots.txt, DNS and AI-crawler checks.
-
Atlas Web Compiler & Scraper
MCP serversDeterministic Zero-LLM Web Compiler, Scraper, Crawler, and Site Mapper for AI Agents.
@atlascompiler/mcp@1.0.5 -
AIReady
MCP serversScan and fix your site's AI discoverability: crawler access, llms.txt, JSON-LD. Free.
-
Crawl Census
MCP serversAsk before you fetch: will this domain serve your crawler, refuse it, or charge it?
-
fastCRW
MCP serversScrape, crawl, map & search the web. Open-source, self-hostable Rust crawler & search for AI agents.
-
AEO Audit
MCP serversAEO audit: score any website 0-100 for AI visibility. Checks schema, meta, content, AI crawlers.
-
Storefront Check
MCP serversAudit any storefront from outside: ad tags, dead-tag detection, AI crawler access, feed readiness.
-
SEO Records
MCP serversSEO check of any website and AI crawler access test (access pass), and the full Audit.
-
RobotsGate
MCP serversGenerate, validate and check robots.txt rules for AI crawlers. Free; optional Pro key.
-
SiteWide
MCP serversOne MCP connector for GA4, Search Console, Google Ads, Ahrefs, a site crawler and Web Vitals.
-
Salience Logs
MCP serversServer-log intelligence: which bots and AI crawlers read your site, and what your pages served.
Indexed entries aren't reviewed or tested by InnerVault. Details come straight from each source. Anything that can reach your accounts, files or browser can do damage, so read the source before you install it.