Library
85,762 resources from 11 public sources. 53 checked by hand; the rest are unreviewed.
Results
Looks like a goal we have a starting path for: I want to research potential clients
-
Prerender Buddy
MCP serversCrawler diagnostics, AI visibility evidence and article drafts for review in Prerender Buddy.
@prerenderbuddy/mcp@0.4.0 -
seo-backlinks
MCP serversBacklinks, Domain Rating & expired-domain drops via seo-backlinks.net (Common Crawl)
seo-backlinks-mcp@0.1.2 -
SnoopScan
Public APIsScrape, crawl, map and search the web as clean markdown or JSON, with a free monthly tier
-
TidyTools
Public APIsWeb page to clean Markdown and AI crawler robots.txt checks, free without a key (rate limited)
-
Deepcrawl
MCP serversClone websites, scrape pages to markdown and crawl whole sites. A free Firecrawl alternative.
https://github.com/Soflutionltd/deepcrawl/releases/download/v1.1.0/deepcrawl.mcpb -
domaintrack
MCP serversLook up domain reputation snapshots and AI crawler policy from Domduck's public store.
@reneturcios/domaintrack@0.1.0 -
mira
MCP serversCrawl a website and get its colors, fonts, logos, images and a Tailwind theme.
mira-brand-mcp@1.0.0 -
Clonvo
MCP serversWeb search, scraping, crawling, research, a browser agent, and company and people data.
-
LV24 SEO
MCP serversFree-first SEO for agents: GSC, Yandex Webmaster/Metrika, Bing, CrUX, PSI, crawl.
lv24-seo@0.7.0 -
AIHackr
MCP serversRead public webpages, extract structured data, discover links, and run bounded crawls.
-
AISeeWhy
MCP serversCan ChatGPT, Claude and Perplexity crawlers read your page? Audit, fixes, compare, monitoring.
-
Arclan MCP Registry
MCP serversMCP registry: 138k servers crawled, handshake-validated, reliability-scored. 744 production-safe.
-
Brainiall Web
MCP serversWeb search, URL content extraction to Markdown, site mapping, and recursive web crawler.
-
OpenAEO
MCP serversAsks 8 AI crawlers for your page, checks who really answered, and writes the fixes. MIT.
openaeo-audit@1.6.4 -
IndexPulse
MCP serversBing Webmaster, IndexNow and Google Search Console for AI: rankings, indexing gaps, AI crawlers.
-
metalift
MCP serversMetalift MCP for AI agents: web search (2 credits), scrape, crawl, and map tools
@metalift/mcp@1.0.15 -
acrawl
MCP serversAutonomous web crawler. 17 browser tools + goal-driven run_goal agent. Single binary, stealth.
https://github.com/Mingye-Lu/AgenticCrawler/releases/download/v0.17.0/acrawl-mcp-linux-x64.mcpb -
PyreCrawl
MCP serversWeb scraping + research toolkit for AI agents: scrape, crawl, monitor URLs with anti-bot bypass.
pyrecrawl@0.8.1 -
auxiliar-mcp
MCP serversWeb access for AI agents — search/scrape/extract/crawl via the auxiliar.ai gateway.
auxiliar-mcp@0.22.1 -
aeo-mcp
MCP serversAEO tools for AI agents: crawler permissions, llms.txt, structured data, AI-readiness audit.
aeo-mcp@1.0.1 -
smart-web
MCP serversWeb search, direct-URL fetch, crawl, and docs export MCP. smartfetch for URLs.
smart-web-mcp@0.8.4 -
CRW Web Scraper
MCP serversOpen-source web scraper for AI agents with scrape, crawl, and map tools
ghcr.io/us/crw:latest -
pagerender
MCP serversWhat crawlers see from any URL, plus page lookups and content editing for your Pagerender sites.
@pagerender/mcp@1.3.0 -
alice
MCP serversAudit any site's AI visibility from your assistant: crawler access, rendering, and schema.
Indexed entries aren't reviewed or tested by InnerVault. Details come straight from each source. Anything that can reach your accounts, files or browser can do damage, so read the source before you install it.