Library
85,762 resources from 11 public sources. 54 checked by hand; the rest are unreviewed.
Results
Looks like a goal we have a starting path for: I want to research potential clients
-
Fastcrawl
MCP serversCloud scraping & crawling API for AI agents. Turn any URL into clean, LLM-ready markdown.
-
llms.txt Checker - AI Readiness Audit
MCP serversChecks llms.txt, AI crawler access in robots.txt, and sitemap - with a 0-100 AI readiness score.
-
Clawifi
MCP serversAgent-native internet gateway: typed search, fetch, scrape, crawl, and extract via the Clawifi API.
clawifi@0.4.1 -
Firecrawl (Unofficial)
MCP serversUnofficial Firecrawl MCP — wraps the Firecrawl API (firecrawl.dev) for web scraping / crawling /…
@pipeworx/mcp-firecrawl@0.2.2 -
quanticdata-mcp
MCP serversLive web access for agents: scrape, SERP search, crawl/map, 100+ collectors, datasets, proxies.
quanticdata-mcp@0.11.4 -
quantumproxies-mcp
MCP serversWeb scraping, SERP search, crawl/map and 74 Collectors through residential proxies. 25 tools.
quantumproxies-mcp@0.11.4 -
scrapeless-mcp-server
MCP serversWeb search, browser automation, scraping, crawling and CAPTCHA solving for AI agents.
scrapeless-mcp-server@0.6.3 -
Firecrawl by Nova (CIVAI)
MCP serversScrape, crawl, and search the web via Firecrawl’s official hosted MCP.
-
Outcrawl
MCP serversWeb infrastructure for AI agents: scrape, crawl and search the web, run browsers and agents.
-
Playwright MCP
MCP serversLets an agent drive a real browser: open pages, click, fill in forms and read what's on screen.
claude mcp add playwright npx @playwright/mcp@latest -
Tech stack, WHOIS, DNS, SPF/DMARC, SSL expiry and AI crawler rules per domain. Runs on Apify.
-
WebLens
MCP serversScrape, crawl, map and extract the web. Pay per call in USDC, no account or API key.
-
Novada MCP
MCP serversOne MCP server for all web data. Scrape, search, crawl, and AI research in one install.
novada-mcp@0.9.49 -
WebReaper
MCP serversAI-native web scraper: scrape, crawl and map any site to clean markdown over stdio. MIT-licensed.
WebReaper.Mcp@11.3.2 -
apexapi-mcp
MCP serversCall 120+ AI models and live web context (scrape/crawl/extract) from any MCP client with one key
apexapi-mcp@0.1.1 -
lilbee
MCP serversA local model engine with a search engine and web crawler built in. Run your coding agents on your own GPUs, and get cited answers from your files, code, and the sites you crawl. One executable.
git clone https://github.com/tobocop2/lilbee.git -
Apex Flow 3D Scraper
MCP serversScrape, crawl and monitor public pages as Markdown, with house-price and news data tools.
-
Olostep MCP Server
MCP serversLive web search, scraping and crawling API for AI. Get structured, LLM-ready data from any site.
olostep-mcp@1.0.21 -
Webcrawl Anything
MCP serversScrape, map, crawl, search and monitor the web. Runs locally with no API key, cites every source.
@webcrawl/mcp@1.4.8 -
exa-mcp-server
MCP serversExa MCP for web search and web crawling!
git clone https://github.com/exa-labs/exa-mcp-server.git -
Scrapling MCP Server
MCP serversWeb scraping with stealth HTTP, real browsers, and Cloudflare bypass. CSS selectors supported.
scrapling@0.5.1 -
x-reader
MCP serversUniversal content reader MCP Server for 10+ platforms
git clone https://github.com/runesleo/x-reader.git -
google-search
MCP serversA Playwright-based Node.js tool that bypasses search engine anti-scraping mechanisms to execute Google searches. Local alternative to SERP APIs with MCP server integration.
git clone https://github.com/web-agent-master/google-search.git -
agentql-mcp
MCP serversModel Context Protocol server that integrates AgentQL's data extraction capabilities.
git clone https://github.com/tinyfish-io/agentql-mcp.git
Indexed entries aren't reviewed or tested by InnerVault. Details come straight from each source. Anything that can reach your accounts, files or browser can do damage, so read the source before you install it.