InnerVault

Library

85,340 resources from 11 public sources. 54 checked by hand; the rest are unreviewed.

Results

Looks like a goal we have a starting path for: I want to research potential clients

  1. exa-mcp-server

    MCP servers

    Exa MCP for web search and web crawling!

    Stale GitHub, exa-labs 5,215 ★MITUpdated 11 days ago

    git clone https://github.com/exa-labs/exa-mcp-server.git
  2. webclaw

    MCP servers

    Fast, local-first web content extraction for LLMs. Scrape, crawl, extract structured data — all from Rust. CLI, REST API, and MCP server.

    Stale GitHub, 0xMassi 2,380 ★AGPL-3.0Updated 33 days ago

    git clone https://github.com/0xMassi/webclaw.git
  3. firecrawl-mcp-server

    MCP servers

    Official Firecrawl MCP server, the context API for AI agents: search, scrape, and interact with the web, plus parse, crawl, map, Agent and Monitor, from any MCP client.

    Indexed GitHub, firecrawl 7,836 ★MITUpdated today

    git clone https://github.com/firecrawl/firecrawl-mcp-server.git
  4. pagesift

    MCP servers

    Local-first web & document ingestion engine in Rust — HTTP/browser capture, layout-aware PDF/Office/OCR parsing, persistent sync, and verifiable data graphs.

    Indexed GitHub, YOLOW92 274 ★Apache-2.0Updated today

    git clone https://github.com/YOLOW92/pagesift.git
  5. doc-scraper

    MCP servers

    Go web crawler to scrape documentation sites and convert content to clean Markdown for LLM ingestion (RAG, training data)

    Indexed GitHub, Sriram-PR 109 ★Apache-2.0Updated 2 days ago

    git clone https://github.com/Sriram-PR/doc-scraper.git
  6. Crawlbase

    MCP servers

    Crawlbase MCP — wraps the Crawlbase Crawling API (crawlbase.com, formerly ProxyCrawl). One…

    Stale Official MCP Registry, io.github.pipeworx-io Updated 16 days ago 3 notes

    @pipeworx/mcp-crawlbase@0.2.1
  7. crawlproof

    MCP servers

    AI-crawler audits + ads (crawlproof.com)

    Stale Official MCP Registry, com.profullstack Updated 5 days ago 1 note

  8. graphlit-mcp-server

    MCP servers

    Model Context Protocol (MCP) Server for Graphlit Platform

    Stale GitHub, graphlit 378 ★MITUpdated 10 months ago

    git clone https://github.com/graphlit/graphlit-mcp-server.git
  9. Crawleo-MCP

    MCP servers

    Hosted Crawleo MCP (remote streamable HTTP endpoint).

    Stale Official MCP Registry, io.github.Crawleo Updated 10 months ago 1 note

  10. CRW Web Scraper

    MCP servers

    Open-source web scraper for AI agents with scrape, crawl, and map tools

    Indexed Official MCP Registry, io.github.fastcrw 1,259 ★Updated today 1 note

    ghcr.io/fastcrw/crw:latest
  11. seo-crawler-mcp

    MCP servers

    Crawl and analyse websites for SEO errors using Crawlee with SQLite storage

    Stale Official MCP Registry, io.github.houtini-ai Updated 9 months ago 1 note

    @houtini/seo-crawler-mcp@2.0.1
  12. Nstdata Crawl

    MCP servers

    Scrape webpages, run crawls, and read Markdown and other results with Nstdata Crawl.

    Stale Official MCP Registry, io.nstdata Updated 3 days ago 1 note

  13. Crawlwise

    MCP servers

    SEO audits and AI crawler checks. Honest findings only; no invented scores.

    Stale Official MCP Registry, site.crawlwise Updated 11 days ago 1 note

  14. Crawlerpeek

    MCP servers

    Check whether AI crawlers (GPTBot, ClaudeBot, PerplexityBot) can access a URL. Read-only.

    Stale Official MCP Registry, io.github.crawlerpeek Updated 18 days ago 1 note

    crawlerpeek@0.3.1
  15. Crawlie

    MCP servers

    Technical SEO + GEO (AI-search) site audits: hosted crawls, prioritized fixes, report diffs.

    Stale Official MCP Registry, app.crawlie Updated 4 months ago 1 note

  16. Crawl4Agent

    MCP servers

    crawl4ai-compatible web crawler API: POST a URL, get clean LLM-ready Markdown with fit_markdown...

    Stale Official MCP Registry, com.saastemly Updated 44 days ago 1 note

  17. Crawlgraph

    MCP servers

    CrawlGraph MCP — backlink intelligence on the public Common Crawl webgraph (4.4B edges, 120M…

    Stale Official MCP Registry, io.github.pipeworx-io Updated 16 days ago 3 notes

    @pipeworx/mcp-crawlgraph@0.2.1
  18. ai-crawler-policy

    MCP servers

    Cloudflare Workers MCP server: ai-crawler-policy

    Stale Official MCP Registry, io.github.lazymac2x Updated 6 months ago 1 note

  19. Open SEO Crawler

    MCP servers

    Self-hosted SEO crawler: run site audits and AI crawler checks, then read the issues and pages.

    Stale Official MCP Registry, io.github.puneetindersingh Updated 31 days ago 1 note

    https://github.com/puneetindersingh/open-seo-crawler/releases/download/mcp-v1.0.0/open-seo-crawler-mcp.mcpb@1.0.0
  20. crawlport

    MCP servers

    Firecrawl web data: scrape, map, search, crawl, extract, research, and llms.txt.

    Stale Official MCP Registry, io.github.CloudCorpRecords Updated 16 days ago 1 note

    @reneturcios/crawlport@0.1.0
  21. Crawlberg

    MCP servers

    Scrape, crawl, and map websites to Markdown or JSON via local CLI.

    Stale Official MCP Registry, io.github.xberg-io Updated 20 days ago 1 note

    ghcr.io/xberg-io/crawlberg:1.12.3
  22. CrawlRaven

    MCP servers

    Read Search Console performance, keyword opportunities and annotations for your sites.

    Stale Official MCP Registry, com.crawlraven Updated 3 months ago 1 note

  23. crawlforge-mcp-server

    MCP servers

    Web scraping, crawling, deep research & autonomous extraction — 31 MCP tools, clean Markdown/JSON

    Stale Official MCP Registry, io.github.mysleekdesigns Updated 4 days ago 2 notes

    crawlforge-mcp-server@6.25.1
  24. Crawlora MCP

    MCP servers

    Hosted MCP: 4684 structured web-data tools across 534 platform groups.

    Stale Official MCP Registry, net.crawlora Updated 6 days ago 1 note

Indexed entries aren't reviewed or tested by InnerVault. Details come straight from each source. Anything that can reach your accounts, files or browser can do damage, so read the source before you install it.