Library
85,340 resources from 11 public sources. 54 checked by hand; the rest are unreviewed.
Results
Looks like a goal we have a starting path for: I want to research potential clients
-
geolint
MCP serversESLint for AI search: audits AI-crawler access, llms.txt, schema and citability.
@iliasabk/geolint@0.4.0 -
matchstick
MCP serversChecks a site build: sitemaps, structured data, robots.txt and what crawlers see.
@astralchemist/matchstick@0.1.0-alpha.4 -
Wholetally
MCP serversCookieless analytics for agents: visitors, pages, sources, AI crawlers, funnels and revenue.
-
MTScraper
MCP serversFree local crawler: any site, JavaScript pages and linked PDFs, into clean text.
mtscraper@2.1.1 -
Prerender Buddy
MCP serversCrawler diagnostics, AI visibility evidence and article drafts for review in Prerender Buddy.
@prerenderbuddy/mcp@0.4.0 -
TidyTools
Public APIsWeb page to clean Markdown and AI crawler robots.txt checks, free without a key (rate limited)
-
domaintrack
MCP serversLook up domain reputation snapshots and AI crawler policy from Domduck's public store.
@reneturcios/domaintrack@0.1.0 -
AISeeWhy
MCP serversCan ChatGPT, Claude and Perplexity crawlers read your page? Audit, fixes, compare, monitoring.
-
MeshArc
MCP serversCrawl and scrape websites to clean markdown, and track what changed between crawls.
-
Brainiall Web
MCP serversWeb search, URL content extraction to Markdown, site mapping, and recursive web crawler.
-
OpenAEO
MCP serversAsks 8 AI crawlers for your page, checks who really answered, and writes the fixes. MIT.
openaeo-audit@1.6.4 -
IndexPulse
MCP serversBing Webmaster, IndexNow and Google Search Console for AI: rankings, indexing gaps, AI crawlers.
-
acrawl
MCP serversAutonomous web crawler. 17 browser tools + goal-driven run_goal agent. Single binary, stealth.
https://github.com/Mingye-Lu/AgenticCrawler/releases/download/v0.17.0/acrawl-mcp-linux-x64.mcpb -
aeo-mcp
MCP serversAEO tools for AI agents: crawler permissions, llms.txt, structured data, AI-readiness audit.
aeo-mcp@1.0.1 -
pagerender
MCP serversWhat crawlers see from any URL, plus page lookups and content editing for your Pagerender sites.
@pagerender/mcp@1.3.0 -
alice
MCP serversAudit any site's AI visibility from your assistant: crawler access, rendering, and schema.
-
web-shooter
MCP serversFast, low-token web reader and focused crawler. Returns ranked passages, not whole pages.
web-shooter@0.2.0 -
PyreCrawl
MCP serversWeb scraping + research toolkit for AI agents: scrape, crawl, monitor URLs with anti-bot bypass.
pyrecrawl@0.8.1 -
pline.ai
MCP serversScrape, crawl, batch-scrape, map, and search the web through the hosted pline.ai API.
pline-api@0.3.12 -
Domduck
MCP serversDomain reputation over time: Domain Rating, Tranco rank, TLS, and AI crawler policy.
-
Causabi GEO Optimizer
MCP serversAudit a site for AI readiness: AI-crawler access, schema, FAQ, content structure. Generates fixes.
geo-optimizer-mcp@0.5.1 -
Botcard
MCP serversCited AI crawler registry (training, search or user fetch) plus robots.txt checks. No fetching.
-
useragent-mcp
MCP serversParse user-agent strings into browser, engine, OS and device, and flag crawlers - fully local.
@mrfentmen/useragent-mcp@1.0.1 -
geoscore
MCP serversAI-crawler readiness checks and fixes: GEO score, robots.txt, schema.org, FAQ and llms.txt.
@reneturcios/geoscore@0.1.0
Indexed entries aren't reviewed or tested by InnerVault. Details come straight from each source. Anything that can reach your accounts, files or browser can do damage, so read the source before you install it.