Library
85,340 resources from 11 public sources. 54 checked by hand; the rest are unreviewed.
Results
Looks like a goal we have a starting path for: I want to research potential clients
-
skills
SkillsFirecrawl agent skills for Claude Code, Codex and Cursor: web search, scraping, crawling and browser interaction. Firecrawl is the most complete web data API for AI agents.
git clone https://github.com/firecrawl/skills.git -
Nstdata Crawl
MCP serversScrape webpages, run crawls, and read Markdown and other results with Nstdata Crawl.
-
cli
SkillsFirecrawl CLI and agent skills: search, scrape, and interact with the web from your terminal or any coding agent, plus parse, crawl, map, Agent and Monitor. Firecrawl is the context API for AI agents.
git clone https://github.com/firecrawl/cli.git -
PyreCrawl
MCP serversWeb scraping + research toolkit for AI agents: scrape, crawl, monitor URLs with anti-bot bypass.
pyrecrawl@0.8.1 -
pline.ai
MCP serversScrape, crawl, batch-scrape, map, and search the web through the hosted pline.ai API.
pline-api@0.3.12 -
CRW Web Scraper
MCP serversOpen-source web scraper for AI agents with scrape, crawl, and map tools
ghcr.io/us/crw:latest -
SnoopScan
MCP serversWeb scraping for agents: scrape, crawl, map, search and extract pages as clean markdown or JSON.
-
Ultimate Web Scraper
MCP serversScrape and crawl websites into queryable tables: products, leads, Shopify catalogs, real estate.
-
scrapeless-mcp-server
MCP serversWeb search, browser automation, scraping, crawling and CAPTCHA solving for AI agents.
scrapeless-mcp-server@0.6.3 -
MeshArc
MCP serversCrawl and scrape websites to clean markdown, and track what changed between crawls.
-
Webclaw
Public APIsWeb content extraction for LLMs with scrape, crawl, search, and summarize
-
Douyin_TikTok_Download_API
MCP servers🚀 自托管的抖音、TikTok、B 站数据采集与无水印视频下载 API,支持 AI agent 通过 MCP 调用与离线语音转文字,Docker 一键部署。| Self-hosted TikTok, Douyin & Bilibili scraper and no-watermark video downloader — async REST API, MCP server for AI agents, CLI and web console, plus offline speech-to-text for downloaded videos. Self-healing identity pool, PostgreSQL archive, one docker compose up.
git clone https://github.com/Evil0ctal/Douyin_TikTok_Download_API.git -
firecrawl
MCP serversScrape, crawl, and extract structured data from websites at scale
mcparmory-firecrawl@1.0.3 -
Apex Flow 3D Scraper
MCP serversScrape, crawl and monitor public pages as Markdown, with house-price and news data tools.
-
MESSORA
MCP serversScrape, crawl and search the web for AI agents via MCP.
-
crawlport
MCP serversFirecrawl web data: scrape, map, search, crawl, extract, research, and llms.txt.
@reneturcios/crawlport@0.1.0 -
WebReaper
MCP serversAI-native web scraper: scrape, crawl and map any site to clean markdown over stdio. MIT-licensed.
WebReaper.Mcp@11.3.2 -
pagesift
MCP serversLocal-first web & document ingestion engine in Rust — HTTP/browser capture, layout-aware PDF/Office/OCR parsing, persistent sync, and verifiable data graphs.
git clone https://github.com/YOLOW92/pagesift.git -
Anakin
MCP serversWeb data for AI agents: scrape, crawl, search, deep research, site monitoring, browser automation
@anakin-io/mcp@0.2.1 -
webclaw
MCP serversWeb scraping, search, crawling, structured extraction and research for AI agents.
@webclaw/mcp@0.7.1 -
Kreuzcrawl
MCP serversScrape, crawl, and map websites to Markdown or JSON via local CLI.
ghcr.io/kreuzberg-dev/kreuzcrawl:0.3.0 -
Crawlberg
MCP serversScrape, crawl, and map websites to Markdown or JSON via local CLI.
ghcr.io/xberg-io/crawlberg:1.12.3 -
Deepcrawl
MCP serversClone websites, scrape pages to markdown and crawl whole sites. A free Firecrawl alternative.
https://github.com/Soflutionltd/deepcrawl/releases/download/v1.1.1/deepcrawl.mcpb -
SnoopScan
Public APIsScrape, crawl, map and search the web as clean markdown or JSON, with a free monthly tier
Indexed entries aren't reviewed or tested by InnerVault. Details come straight from each source. Anything that can reach your accounts, files or browser can do damage, so read the source before you install it.