Library
85,762 resources from 11 public sources. 54 checked by hand; the rest are unreviewed.
Results
Looks like a goal we have a starting path for: I want to research potential clients
-
Firecrawl by Nova (CIVAI)
MCP serversScrape, crawl, and search the web via Firecrawl’s official hosted MCP.
-
Outcrawl
MCP serversWeb infrastructure for AI agents: scrape, crawl and search the web, run browsers and agents.
-
WebLens
MCP serversScrape, crawl, map and extract the web. Pay per call in USDC, no account or API key.
-
Novada MCP
MCP serversOne MCP server for all web data. Scrape, search, crawl, and AI research in one install.
novada-mcp@0.9.49 -
apexapi-mcp
MCP serversCall 120+ AI models and live web context (scrape/crawl/extract) from any MCP client with one key
apexapi-mcp@0.1.1 -
Playwright MCP
MCP serversLets an agent drive a real browser: open pages, click, fill in forms and read what's on screen.
claude mcp add playwright npx @playwright/mcp@latest -
Olostep MCP Server
MCP serversLive web search, scraping and crawling API for AI. Get structured, LLM-ready data from any site.
olostep-mcp@1.0.21 -
Webcrawl Anything
MCP serversScrape, map, crawl, search and monitor the web. Runs locally with no API key, cites every source.
@webcrawl/mcp@1.4.8 -
Crawl sites to Markdown with sitemaps, globs and depth limits, obeying robots and crawl-delay
-
seo-crawler-mcp
MCP serversCrawl and analyse websites for SEO errors using Crawlee with SQLite storage
@houtini/seo-crawler-mcp@2.0.1 -
crawl-readiness
MCP serversCheck what AI crawlers may read and what a page permits, generate llms.txt and schema.
crawl-readiness-mcp@0.2.9 -
Crawl Census
MCP serversAsk before you fetch: will this domain serve your crawler, refuse it, or charge it?
-
mcp-site-crawler-links-tables
MCP serversCrawl a website for links, file download links, HTML tables as rows, and lists, with no AI
@mambalabsdev/mcp-site-crawler-links-tables@1.0.2 -
Website to Markdown Crawler
MCP serversCrawl a website into clean Markdown for LLMs/RAG: main content only, linked docs converted.
-
Flarum Forum Scraper - Discussion Crawler Tool
MCP serversSearch or monitor any Flarum-powered forum for discussions, replies, participants, dates, and…
-
agentql-mcp
MCP serversModel Context Protocol server that integrates AgentQL's data extraction capabilities.
git clone https://github.com/tinyfish-io/agentql-mcp.git -
IndexLinks
MCP serversCheck how crawlers see a site, send new pages to search engines and AI crawlers, see crawl receipts.
-
google-search
MCP serversA Playwright-based Node.js tool that bypasses search engine anti-scraping mechanisms to execute Google searches. Local alternative to SERP APIs with MCP server integration.
git clone https://github.com/web-agent-master/google-search.git -
x-reader
MCP serversUniversal content reader MCP Server for 10+ platforms
git clone https://github.com/runesleo/x-reader.git -
xpay Web Scraping
MCP servers35+ web scraping tools. Firecrawl, Bright Data, Jina, Olostep, ScrapeGraph, Notte, Riveter.
-
Scrape.ly
MCP serversFind Actors in the Scrape.ly Store, run them, and read their datasets, key-value stores and logs.
scrapely-mcp@0.3.15 -
web-scraping
MCP serverssuperagnt: marketing plugin for Claude and ChatGPT. Know your market: scrape and search the web.
-
X1-BaaS Scraping API
MCP serversStealth scraping API for AI agents. Clean Markdown from any URL. x402 crypto payments.
-
Scrape Everything
MCP serversPublic data from Instagram, TikTok, X, YouTube, Facebook, Telegram, Spotify, Pinterest and Twitch.
@scrapeeverything/mcp@0.1.0
Indexed entries aren't reviewed or tested by InnerVault. Details come straight from each source. Anything that can reach your accounts, files or browser can do damage, so read the source before you install it.