Library
85,340 resources from 11 public sources. 54 checked by hand; the rest are unreviewed.
Results
Looks like a goal we have a starting path for: I want to research potential clients
-
webclaw
MCP serversFast, local-first web content extraction for LLMs. Scrape, crawl, extract structured data — all from Rust. CLI, REST API, and MCP server.
git clone https://github.com/0xMassi/webclaw.git -
firecrawl-mcp-server
MCP serversOfficial Firecrawl MCP server, the context API for AI agents: search, scrape, and interact with the web, plus parse, crawl, map, Agent and Monitor, from any MCP client.
git clone https://github.com/firecrawl/firecrawl-mcp-server.git -
fastCRW
MCP serversScrape, crawl, map & search the web. Open-source, self-hostable Rust crawler & search for AI agents.
-
olostep-mcp-server
MCP serversMCP server for Olostep — the web scraping, crawling, and search infrastructure used by top AI companies. Gives any MCP-compatible AI agent the ability to scrape, crawl, batch-extract, and search the web in real time.
git clone https://github.com/olostep/olostep-mcp-server.git -
Web Tools and Web Tasks for AI agents. 100-credit MCP trial; API-key credits or x402.
-
CRW Web Scraper
MCP serversOpen-source web scraper for AI agents with scrape, crawl, and map tools
ghcr.io/fastcrw/crw:latest -
doc-scraper
MCP serversGo web crawler to scrape documentation sites and convert content to clean Markdown for LLM ingestion (RAG, training data)
git clone https://github.com/Sriram-PR/doc-scraper.git -
Web Scraper & Crawler for RAG (Markdown)
MCP serversWebsite to clean Markdown or JSON for AI and RAG: read pages, crawl sites, extract described fields.
-
Scrape-LE
MCP serversAnalyse robots.txt content and report whether a path may be crawled.
scrape-le-mcp@2.6.0 -
GoAI Moat Web Scrape
MCP serversScrape any URL into clean LLM-ready Markdown, or crawl a whole site.
-
web-scraping-mcp-server
MCP serversWebsite crawling, Google search and Wikipedia lookup as agent tools.
-
graphlit-mcp-server
MCP serversModel Context Protocol (MCP) Server for Graphlit Platform
git clone https://github.com/graphlit/graphlit-mcp-server.git -
Apify MCP server
MCP serversLets an agent run Apify's ready-made scrapers to pull data from websites, search engines, maps and social platforms.
-
Nstdata Crawl
MCP serversScrape webpages, run crawls, and read Markdown and other results with Nstdata Crawl.
-
PyreCrawl
MCP serversWeb scraping + research toolkit for AI agents: scrape, crawl, monitor URLs with anti-bot bypass.
pyrecrawl@0.8.1 -
pline.ai
MCP serversScrape, crawl, batch-scrape, map, and search the web through the hosted pline.ai API.
pline-api@0.3.12 -
CRW Web Scraper
MCP serversOpen-source web scraper for AI agents with scrape, crawl, and map tools
ghcr.io/us/crw:latest -
SnoopScan
MCP serversWeb scraping for agents: scrape, crawl, map, search and extract pages as clean markdown or JSON.
-
Ultimate Web Scraper
MCP serversScrape and crawl websites into queryable tables: products, leads, Shopify catalogs, real estate.
-
scrapeless-mcp-server
MCP serversWeb search, browser automation, scraping, crawling and CAPTCHA solving for AI agents.
scrapeless-mcp-server@0.6.3 -
MeshArc
MCP serversCrawl and scrape websites to clean markdown, and track what changed between crawls.
-
Douyin_TikTok_Download_API
MCP servers🚀 自托管的抖音、TikTok、B 站数据采集与无水印视频下载 API,支持 AI agent 通过 MCP 调用与离线语音转文字,Docker 一键部署。| Self-hosted TikTok, Douyin & Bilibili scraper and no-watermark video downloader — async REST API, MCP server for AI agents, CLI and web console, plus offline speech-to-text for downloaded videos. Self-healing identity pool, PostgreSQL archive, one docker compose up.
git clone https://github.com/Evil0ctal/Douyin_TikTok_Download_API.git -
firecrawl
MCP serversScrape, crawl, and extract structured data from websites at scale
mcparmory-firecrawl@1.0.3 -
Apex Flow 3D Scraper
MCP serversScrape, crawl and monitor public pages as Markdown, with house-price and news data tools.
Indexed entries aren't reviewed or tested by InnerVault. Details come straight from each source. Anything that can reach your accounts, files or browser can do damage, so read the source before you install it.