Library
85,762 resources from 11 public sources. 53 checked by hand; the rest are unreviewed.
Results
Looks like a goal we have a starting path for: I want to research potential clients
-
pigfox.ai AI search readiness
MCP serversCheck if a site is ready for AI search: AI crawler access, llms.txt, JSON-LD, scored out of 100.
-
Spider Cloud
MCP serversCrawl, scrape, search the web, and automate browsers at scale with anti-bot bypass.
-
ReplyNodes
MCP serversWeb MCP: scrape/crawl sites, web search, brand assets, app stores, YouTube, Reddit, Hacker News.
-
SEO Content Machine
MCP serversRun SEO Content Machine tasks from an MCP client: scraping, crawls, Google Maps, Workspace pages.
seo-content-machine-mcp@1.1.1 -
stagenth · 网页数据
MCP serversWeb scraping to clean Markdown with JS rendering, multi-page crawl, structured extract, sitemaps.
-
Ultimate Web Scraper
MCP serversScrape and crawl websites into queryable tables: products, leads, Shopify catalogs, real estate.
-
Fastcrawl
MCP serversCloud scraping & crawling API for AI agents. Turn any URL into clean, LLM-ready markdown.
-
llms.txt Checker - AI Readiness Audit
MCP serversChecks llms.txt, AI crawler access in robots.txt, and sitemap - with a 0-100 AI readiness score.
-
Clawifi
MCP serversAgent-native internet gateway: typed search, fetch, scrape, crawl, and extract via the Clawifi API.
clawifi@0.4.1 -
Firecrawl (Unofficial)
MCP serversUnofficial Firecrawl MCP — wraps the Firecrawl API (firecrawl.dev) for web scraping / crawling /…
@pipeworx/mcp-firecrawl@0.2.2 -
quanticdata-mcp
MCP serversLive web access for agents: scrape, SERP search, crawl/map, 100+ collectors, datasets, proxies.
quanticdata-mcp@0.11.4 -
quantumproxies-mcp
MCP serversWeb scraping, SERP search, crawl/map and 74 Collectors through residential proxies. 25 tools.
quantumproxies-mcp@0.11.4 -
scrapeless-mcp-server
MCP serversWeb search, browser automation, scraping, crawling and CAPTCHA solving for AI agents.
scrapeless-mcp-server@0.6.3 -
Firecrawl by Nova (CIVAI)
MCP serversScrape, crawl, and search the web via Firecrawl’s official hosted MCP.
-
Outcrawl
MCP serversWeb infrastructure for AI agents: scrape, crawl and search the web, run browsers and agents.
-
Playwright MCP
MCP serversLets an agent drive a real browser: open pages, click, fill in forms and read what's on screen.
claude mcp add playwright npx @playwright/mcp@latest -
Tech stack, WHOIS, DNS, SPF/DMARC, SSL expiry and AI crawler rules per domain. Runs on Apify.
-
WebLens
MCP serversScrape, crawl, map and extract the web. Pay per call in USDC, no account or API key.
-
Novada MCP
MCP serversOne MCP server for all web data. Scrape, search, crawl, and AI research in one install.
novada-mcp@0.9.49 -
WebReaper
MCP serversAI-native web scraper: scrape, crawl and map any site to clean markdown over stdio. MIT-licensed.
WebReaper.Mcp@11.3.2 -
apexapi-mcp
MCP serversCall 120+ AI models and live web context (scrape/crawl/extract) from any MCP client with one key
apexapi-mcp@0.1.1 -
lilbee
MCP serversA local model engine with a search engine and web crawler built in. Run your coding agents on your own GPUs, and get cited answers from your files, code, and the sites you crawl. One executable.
git clone https://github.com/tobocop2/lilbee.git -
Apex Flow 3D Scraper
MCP serversScrape, crawl and monitor public pages as Markdown, with house-price and news data tools.
-
Olostep MCP Server
MCP serversLive web search, scraping and crawling API for AI. Get structured, LLM-ready data from any site.
olostep-mcp@1.0.21
Indexed entries aren't reviewed or tested by InnerVault. Details come straight from each source. Anything that can reach your accounts, files or browser can do damage, so read the source before you install it.