Library
85,762 resources from 11 public sources. 53 checked by hand; the rest are unreviewed.
Results
Looks like a goal we have a starting path for: I want to research potential clients
-
RAG Documentation Scraper
MCP serversCrawl any documentation site and return heading-bounded, LLM-ready chunks with source metadata.
rag-docs-scraper-mcp-server@1.0.0 -
useragent-mcp
MCP serversParse user-agent strings into browser, engine, OS and device, and flag crawlers - fully local.
@mrfentmen/useragent-mcp@1.0.1 -
TheSEO
MCP serversAI-zichtbaarheid per model, gat-analyse, crawlercheck, NL vakregels met bron en 149 Claude-skills
-
geoscore
MCP serversAI-crawler readiness checks and fixes: GEO score, robots.txt, schema.org, FAQ and llms.txt.
@reneturcios/geoscore@0.1.0 -
TidyFetch
MCP serversWeb pages to markdown, site crawls, company contacts, app reviews, ATS jobs and Shopify products.
-
Diffbot
MCP serversWeb search, page extraction, crawling, and Knowledge Graph queries from Diffbot's web index.
diffbot-mcp@0.2.1 -
Agent Audit AI
MCP serversAutonomous AI agent readiness, crawler reachability, and 30-point audit specification engine.
-
Preferly
MCP serversFree AI visibility checks for any website: AI crawler access, llms.txt, schema, business info.
-
GoAI Moat Web Scrape
MCP serversScrape any URL into clean LLM-ready Markdown, or crawl a whole site.
-
ai-visibility
MCP serversAI-search-visibility tools: check crawler access, generate llms.txt, lint robots.txt, census data.
-
Site Check
MCP serversPublic website health scan, AI-crawler and structured-data readiness, and a local presence score.
-
momentic
MCP serversFree SEO, GEO, and AEO audits: analyze any page or domain, AI-crawler access, agent readiness.
-
GEO Inspector
MCP serversInspect a site's AI-search readiness: AI crawler access, llms.txt, schema markup, meta directives
geo-inspector-mcp@0.1.2 -
Scrawly MCP Server
MCP serversMCP server for the Scrawly SEO crawler: query local audits and propose confirmation-gated fixes.
sentinelseo@1.0.0 -
rankparse-mcp
MCP serversSEO MCP server — backlinks, domain authority, tech stack, and 18+ tools via Common Crawl.
-
Clawifi
MCP serversAgent-native internet gateway: typed search, fetch, scrape, crawl, and extract via the Clawifi API.
clawifi@0.4.1 -
SearXNG MCP Server
MCP serversSelf-hosted SearXNG metasearch for MCP clients: 13 tools, citation refs, deep search and crawling.
searxng-mcp-server@1.0.1 -
rasterly
MCP serversWeb toolkit for AI agents: read any URL as Markdown, screenshot, extract data, or crawl a site.
rasterly-mcp@0.2.0 -
tdm-reservation-lint
MCP serversFinds the robots.txt lines that reserve nothing — retired crawler tokens, shadowed groups, rules abo
@readystack/tdm-reservation-lint@1.0.5 -
AI Visibility Checker
MCP serversAI visibility checker: GPTBot vs OAI-SearchBot, robots.txt audit, raw-HTML schema. 165 crawlers.
https://github.com/krisdiallo/ecom-agent/releases/download/v1.5.3/aivis.mcpb@1.5.3 -
Firecrawl (Unofficial)
MCP serversUnofficial Firecrawl MCP — wraps the Firecrawl API (firecrawl.dev) for web scraping / crawling /…
@pipeworx/mcp-firecrawl@0.2.2 -
quanticdata-mcp
MCP serversLive web access for agents: scrape, SERP search, crawl/map, 100+ collectors, datasets, proxies.
quanticdata-mcp@0.11.4 -
quantumproxies-mcp
MCP serversWeb scraping, SERP search, crawl/map and 74 Collectors through residential proxies. 25 tools.
quantumproxies-mcp@0.11.4 -
scrapeless-mcp-server
MCP serversWeb search, browser automation, scraping, crawling and CAPTCHA solving for AI agents.
scrapeless-mcp-server@0.6.3
Indexed entries aren't reviewed or tested by InnerVault. Details come straight from each source. Anything that can reach your accounts, files or browser can do damage, so read the source before you install it.