Library
85,762 resources from 11 public sources. 53 checked by hand; the rest are unreviewed.
Results
Looks like a goal we have a starting path for: I want to research potential clients
-
Agent Crawl Readiness
MCP serversBounded crawl-readiness check for agent access: robots.txt, sitemap.xml, llms.txt, homepage.
-
camoufox-cli
Agents & frameworksAnti-detect browser automation CLI & Skills for AI agents — Camoufox-powered fingerprint spoofing, no bot-detectable Playwright leaks
git clone https://github.com/Bin-Huang/camoufox-cli.git -
crawlinx-mcp
MCP serversFree technical-SEO audit MCP: crawl a site, run checks, return an LLM-ready shareable report.
-
Crawlwise Data MCP
MCP serversPer-URL tech-stack, feed and sitemap change events for AI agents, delivered as signed webhooks.
crawlwise-mcp@0.1.2 -
CrawlKit Scrapers
MCP servers58 scrapers via Apify MCP: Booking, Airbnb, Amazon, Google, Zillow, Indeed, Yelp, Reddit, Vinted
-
CrawlerData: Google Shopping & SERP
MCP serversGoogle Shopping products and seller prices, plus Google Search, Images, News and Local results.
-
opencode-browser
MCP serversBrowser automation plugin for OpenCode AI editor - Control Chrome/Edge with AI, automate web testing, scraping & form filling via MCP integration
git clone https://github.com/michaljach/opencode-browser.git -
Scrape.ly
MCP serversFind Actors in the Scrape.ly Store, run them, and read their datasets, key-value stores and logs.
scrapely-mcp@0.3.15 -
Find broken links on a website: crawls its pages and reports 404s, errors and redirect chains
-
xpay Web Scraping
MCP servers35+ web scraping tools. Firecrawl, Bright Data, Jina, Olostep, ScrapeGraph, Notte, Riveter.
-
apitap
MCP serversCLI, MCP server, and npm library that turns any website into an API — no docs, no SDK, no browser.
git clone https://github.com/n1byn1kt/apitap.git -
servo-fetch
SkillsA self-contained browser engine that fetches, renders, and extracts web content as Markdown, JSON, or screenshots — no Chromium, no API key, no setup.
git clone https://github.com/konippi/servo-fetch.git -
web-scraping
MCP serverssuperagnt: marketing plugin for Claude and ChatGPT. Know your market: scrape and search the web.
-
CrawlCheck
MCP serversVerification layer for the agentic web: a signed answer about any site before an agent acts.
-
X1-BaaS Scraping API
MCP serversStealth scraping API for AI agents. Clean Markdown from any URL. x402 crypto payments.
-
crawlbit
MCP serversFour free tools to check if AI engines can find, read and recognise a site. No API key.
crawlbit-mcp@1.0.1 -
AI-Coding
AI repositoriesAI 编程福利导航:汇总 Claude Code、Codex、Cursor 中转站与公益站,整理免费额度、注册福利、签到活动和评测记录,提供可视化看板与 Python 数据采集工具。
git clone https://github.com/liuda30201/AI-Coding.git -
agent-skills
SkillsAgent skills that teach AI coding agents to use Decodo for web scraping
git clone https://github.com/Decodo/agent-skills.git -
mifactory-scraping-api
MCP serversWeb scraping for AI agents. Extract text and metadata from any URL worldwide. $0.005/page.
-
stealth-browser-mcp
MCP serversStealth browser automation for AI agents over MCP and the Chrome DevTools Protocol: navigation, network hooks, DOM extraction, and pixel-accurate UI cloning.
git clone https://github.com/vibheksoni/stealth-browser-mcp.git -
awesome-ai-tools
AI repositoriesA hand-picked collection of AI tools for content, automation, e-commerce, web building, voice, and growth.
git clone https://github.com/cporter202/awesome-ai-tools.git -
foundrynet-scrape
MCP serversx402-gated web extraction gateway. Tools: extract, extract_batch.
-
free-proxy-list
MCP serversFree proxy list, verified around the clock: HTTP, HTTPS, SOCKS4 and SOCKS5 proxies with country, anonymity, latency and uptime on every row, updated several times a day. Live list, proxy checker, keyless API and MCP server at hproxy.com.
git clone https://github.com/hproxy-com/free-proxy-list.git -
x402-scrape-mcp
MCP serversx402 paid API for AI agents. USDC on Base. CDP facilitator.
x402-scrape-mcp@1.0.1
Indexed entries aren't reviewed or tested by InnerVault. Details come straight from each source. Anything that can reach your accounts, files or browser can do damage, so read the source before you install it.