Library
85,340 resources from 11 public sources. 54 checked by hand; the rest are unreviewed.
Results
Looks like a goal we have a starting path for: I want to research potential clients
-
exa-mcp-server
MCP serversExa MCP for web search and web crawling!
git clone https://github.com/exa-labs/exa-mcp-server.git -
webclaw
MCP serversFast, local-first web content extraction for LLMs. Scrape, crawl, extract structured data — all from Rust. CLI, REST API, and MCP server.
git clone https://github.com/0xMassi/webclaw.git -
firecrawl-mcp-server
MCP serversOfficial Firecrawl MCP server, the context API for AI agents: search, scrape, and interact with the web, plus parse, crawl, map, Agent and Monitor, from any MCP client.
git clone https://github.com/firecrawl/firecrawl-mcp-server.git -
pagesift
MCP serversLocal-first web & document ingestion engine in Rust — HTTP/browser capture, layout-aware PDF/Office/OCR parsing, persistent sync, and verifiable data graphs.
git clone https://github.com/YOLOW92/pagesift.git -
doc-scraper
MCP serversGo web crawler to scrape documentation sites and convert content to clean Markdown for LLM ingestion (RAG, training data)
git clone https://github.com/Sriram-PR/doc-scraper.git -
Crawlbase
MCP serversCrawlbase MCP — wraps the Crawlbase Crawling API (crawlbase.com, formerly ProxyCrawl). One…
@pipeworx/mcp-crawlbase@0.2.1 -
crawlproof
MCP serversAI-crawler audits + ads (crawlproof.com)
-
graphlit-mcp-server
MCP serversModel Context Protocol (MCP) Server for Graphlit Platform
git clone https://github.com/graphlit/graphlit-mcp-server.git -
Crawleo-MCP
MCP serversHosted Crawleo MCP (remote streamable HTTP endpoint).
-
CRW Web Scraper
MCP serversOpen-source web scraper for AI agents with scrape, crawl, and map tools
ghcr.io/fastcrw/crw:latest -
seo-crawler-mcp
MCP serversCrawl and analyse websites for SEO errors using Crawlee with SQLite storage
@houtini/seo-crawler-mcp@2.0.1 -
Nstdata Crawl
MCP serversScrape webpages, run crawls, and read Markdown and other results with Nstdata Crawl.
-
Crawlwise
MCP serversSEO audits and AI crawler checks. Honest findings only; no invented scores.
-
Crawlerpeek
MCP serversCheck whether AI crawlers (GPTBot, ClaudeBot, PerplexityBot) can access a URL. Read-only.
crawlerpeek@0.3.1 -
Crawlie
MCP serversTechnical SEO + GEO (AI-search) site audits: hosted crawls, prioritized fixes, report diffs.
-
Crawl4Agent
MCP serverscrawl4ai-compatible web crawler API: POST a URL, get clean LLM-ready Markdown with fit_markdown...
-
Crawlgraph
MCP serversCrawlGraph MCP — backlink intelligence on the public Common Crawl webgraph (4.4B edges, 120M…
@pipeworx/mcp-crawlgraph@0.2.1 -
ai-crawler-policy
MCP serversCloudflare Workers MCP server: ai-crawler-policy
-
Open SEO Crawler
MCP serversSelf-hosted SEO crawler: run site audits and AI crawler checks, then read the issues and pages.
https://github.com/puneetindersingh/open-seo-crawler/releases/download/mcp-v1.0.0/open-seo-crawler-mcp.mcpb@1.0.0 -
crawlport
MCP serversFirecrawl web data: scrape, map, search, crawl, extract, research, and llms.txt.
@reneturcios/crawlport@0.1.0 -
Crawlberg
MCP serversScrape, crawl, and map websites to Markdown or JSON via local CLI.
ghcr.io/xberg-io/crawlberg:1.12.3 -
CrawlRaven
MCP serversRead Search Console performance, keyword opportunities and annotations for your sites.
-
crawlforge-mcp-server
MCP serversWeb scraping, crawling, deep research & autonomous extraction — 31 MCP tools, clean Markdown/JSON
crawlforge-mcp-server@6.25.1 -
Crawlora MCP
MCP serversHosted MCP: 4684 structured web-data tools across 534 platform groups.
Indexed entries aren't reviewed or tested by InnerVault. Details come straight from each source. Anything that can reach your accounts, files or browser can do damage, so read the source before you install it.