Library
85,340 resources from 11 public sources. 54 checked by hand; the rest are unreviewed.
Results
Looks like a goal we have a starting path for: I want to research potential clients
-
matchstick
MCP serversChecks a site build: sitemaps, structured data, robots.txt and what crawlers see.
@astralchemist/matchstick@0.1.0-alpha.4 -
Wholetally
MCP serversCookieless analytics for agents: visitors, pages, sources, AI crawlers, funnels and revenue.
-
MTScraper
MCP serversFree local crawler: any site, JavaScript pages and linked PDFs, into clean text.
mtscraper@2.1.1 -
Prerender Buddy
MCP serversCrawler diagnostics, AI visibility evidence and article drafts for review in Prerender Buddy.
@prerenderbuddy/mcp@0.4.0 -
TidyTools
Public APIsWeb page to clean Markdown and AI crawler robots.txt checks, free without a key (rate limited)
-
domaintrack
MCP serversLook up domain reputation snapshots and AI crawler policy from Domduck's public store.
@reneturcios/domaintrack@0.1.0 -
AISeeWhy
MCP serversCan ChatGPT, Claude and Perplexity crawlers read your page? Audit, fixes, compare, monitoring.
-
Brainiall Web
MCP serversWeb search, URL content extraction to Markdown, site mapping, and recursive web crawler.
-
OpenAEO
MCP serversAsks 8 AI crawlers for your page, checks who really answered, and writes the fixes. MIT.
openaeo-audit@1.6.4 -
IndexPulse
MCP serversBing Webmaster, IndexNow and Google Search Console for AI: rankings, indexing gaps, AI crawlers.
-
acrawl
MCP serversAutonomous web crawler. 17 browser tools + goal-driven run_goal agent. Single binary, stealth.
https://github.com/Mingye-Lu/AgenticCrawler/releases/download/v0.17.0/acrawl-mcp-linux-x64.mcpb -
aeo-mcp
MCP serversAEO tools for AI agents: crawler permissions, llms.txt, structured data, AI-readiness audit.
aeo-mcp@1.0.1 -
pagerender
MCP serversWhat crawlers see from any URL, plus page lookups and content editing for your Pagerender sites.
@pagerender/mcp@1.3.0 -
alice
MCP serversAudit any site's AI visibility from your assistant: crawler access, rendering, and schema.
-
web-shooter
MCP serversFast, low-token web reader and focused crawler. Returns ranked passages, not whole pages.
web-shooter@0.2.0 -
Domduck
MCP serversDomain reputation over time: Domain Rating, Tranco rank, TLS, and AI crawler policy.
-
Crawl Readiness
Public APIsCheck what 50+ AI crawlers can read on a website and whether a page permits an AI use
-
Causabi GEO Optimizer
MCP serversAudit a site for AI readiness: AI-crawler access, schema, FAQ, content structure. Generates fixes.
geo-optimizer-mcp@0.5.1 -
Botcard
MCP serversCited AI crawler registry (training, search or user fetch) plus robots.txt checks. No fetching.
-
useragent-mcp
MCP serversParse user-agent strings into browser, engine, OS and device, and flag crawlers - fully local.
@mrfentmen/useragent-mcp@1.0.1 -
TheSEO
MCP serversAI-zichtbaarheid per model, gat-analyse, crawlercheck, NL vakregels met bron en 149 Claude-skills
-
geoscore
MCP serversAI-crawler readiness checks and fixes: GEO score, robots.txt, schema.org, FAQ and llms.txt.
@reneturcios/geoscore@0.1.0 -
Agent Audit AI
MCP serversAutonomous AI agent readiness, crawler reachability, and 30-point audit specification engine.
-
Preferly
MCP serversFree AI visibility checks for any website: AI crawler access, llms.txt, schema, business info.
Indexed entries aren't reviewed or tested by InnerVault. Details come straight from each source. Anything that can reach your accounts, files or browser can do damage, so read the source before you install it.