InnerVault

Library

85,340 resources from 11 public sources. 54 checked by hand; the rest are unreviewed.

Results

Looks like a goal we have a starting path for: I want to research potential clients

  1. {"jsonrpc":"2.0","id":1,"method":"tools/call","params":{"name":"whoami","arguments":{}}} free no key

    Stale Official MCP Registry, dev.workers.pathwren.www Updated 2 months ago 1 note

  2. Web Tools and Web Tasks for AI agents. 100-credit MCP trial; API-key credits or x402.

    Stale Official MCP Registry, dev.oassis Updated 25 days ago 1 note

  3. One-call audit: robots.txt AI-bot rules, llms.txt, JSON-LD, meta tags, sitemap. Score plus fixes.

    Stale Official MCP Registry, app.rowb.ai-visibility Updated 54 days ago 1 note

  4. seo-audit-console

    MCP servers

    Technical SEO in Claude: GSC + crawl + DataForSEO - audit, portfolio, market sizing, content recon.

    Stale Official MCP Registry, io.github.houtini-ai 101 ★Updated 4 days ago 2 notes

    @houtini/seo-audit-console@1.0.5
  5. seo-ops

    Skills

    SEO foundation checks as an Agent Skill: give it a URL, get a crawler's-eye pass/fail report with evidence. 26 structural checks, zero LLM, deterministic.

    Stale GitHub, tigerless-labs 951 ★Updated 21 days ago

    git clone https://github.com/tigerless-labs/seo-ops.git
  6. MeshArc

    MCP servers

    Crawl and scrape websites to clean markdown, and track what changed between crawls.

    Stale Official MCP Registry, dev.mesharc Updated 3 days ago 1 note

  7. Agent skills for fetching knowledge

    Stale GitHub, diffbot 5 ★MITUpdated 8 days ago

    git clone https://github.com/diffbot/diffbot-skills.git
  8. Black SEO Analyzer

    MCP servers

    Audit a page or crawl a whole site for technical SEO issues, locally. Compares crawls.

    Stale Official MCP Registry, io.github.sethblack Updated 12 days ago 2 notes

    https://github.com/sethblack/black-seo-analyzer/releases/download/v26.11.3/bseoa-26.11.3-win32.mcpb@26.11.3
  9. fastCRW

    MCP servers

    Scrape, crawl, map & search the web. Open-source, self-hostable Rust crawler & search for AI agents.

    Stale Official MCP Registry, io.github.us Updated 4 months ago 1 note

  10. MMClaw

    Agents & frameworks

    Ultra-Lightweight, Pure Python Multimodal Agent.

    Stale GitHub, CrawlScript 151 ★GPL-3.0Updated 22 days ago

    git clone https://github.com/CrawlScript/MMClaw.git
  11. Siteiz

    MCP servers

    Check which AI crawlers a site allows and see pages the way AI crawlers do. Free, read-only.

    Stale Official MCP Registry, com.siteiz Updated 44 days ago 1 note

  12. UAParse

    MCP servers

    Parse a User-Agent: browser, OS, device, plus bot, search crawler, AI crawler and AI agent flags.

    Stale Official MCP Registry, dev.workers.mike-tusa.uaparse Updated 15 days ago 1 note

  13. Commoncrawl

    MCP servers

    Common Crawl's public web archive — find every time a URL was crawled since 2008 and read the…

    Stale Official MCP Registry, io.github.pipeworx-io Updated 16 days ago 3 notes

    @pipeworx/mcp-commoncrawl@0.2.1
  14. wet

    MCP servers

    Open-source MCP server for AI agents: web search, content extraction, and library docs -- 5-strategy scraping, runs without API keys.

    Indexed GitHub, n24q02m 24 ★Apache-2.0Updated today

    git clone https://github.com/n24q02m/wet.git
  15. skald

    MCP servers

    Self-hosted Google Analytics alternative that reads your server access log: real people, AI assistants, crawlers, bots and the scanners probing your site, which JavaScript analytics never see. Leads and revenue by source. Every figure counted twice. No cookies, no third-party script. Python, SQLite, Docker.

    Indexed GitHub, spcaeo 22 ★Custom licence (see repository)Updated 3 days ago

    git clone https://github.com/spcaeo/skald.git
  16. ProxyCrawl

    Public APIs

    Scraping and crawling anticaptcha service

    Indexed public-apis (GitHub list)

  17. cli

    Skills

    Firecrawl CLI and agent skills: search, scrape, and interact with the web from your terminal or any coding agent, plus parse, crawl, map, Agent and Monitor. Firecrawl is the context API for AI agents.

    Stale GitHub, firecrawl 678 ★Updated 10 days ago

    git clone https://github.com/firecrawl/cli.git
  18. lilbee

    MCP servers

    A local model engine with a search engine and web crawler built in. Run your coding agents on your own GPUs, and get cited answers from your files, code, and the sites you crawl. One executable.

    Stale GitHub, tobocop2 70 ★MITUpdated 4 days ago

    git clone https://github.com/tobocop2/lilbee.git
  19. awesome-ai-web-scraping

    Docs & tutorials

    A curated list of AI-powered web scraping tools, LLM-friendly crawlers, MCP servers, and infrastructure for turning the web into data.

    Stale GitHub, h4ckf0r0day 114 ★CC0-1.0Updated 6 months ago

    git clone https://github.com/h4ckf0r0day/awesome-ai-web-scraping.git
  20. Svipall

    MCP servers

    Read any page past its anti-bot wall, crawl sites, search without an API key, solve captchas locally

    Stale Official MCP Registry, dev.ilien.svipall 20 ★Updated 3 days ago 1 note

    svipall@2.1.0
  21. skills

    Skills

    Firecrawl agent skills for Claude Code, Codex and Cursor: web search, scraping, crawling and browser interaction. Firecrawl is the most complete web data API for AI agents.

    Indexed GitHub, firecrawl 156 ★ISCUpdated 5 days ago

    git clone https://github.com/firecrawl/skills.git
  22. geo-skills

    Skills

    9 open Claude skills for GEO / AEO: check if AI search can read a page, collect and analyze how often AI engines name a brand (with confidence ranges), plus schema parity, AI crawler log checks and migration guards. From the AI Visibility Census.

    Indexed GitHub, aivisibilitycensus 5 ★MITUpdated 2 days ago

    git clone https://github.com/aivisibilitycensus/geo-skills.git
  23. Webclaw

    Public APIs

    Web content extraction for LLMs with scrape, crawl, search, and summarize

    Indexed public-apis (GitHub list)

  24. firecrawl

    MCP servers

    Scrape, crawl, and extract structured data from websites at scale

    Stale Official MCP Registry, com.mcparmory Updated 6 months ago 1 note

    mcparmory-firecrawl@1.0.3

Indexed entries aren't reviewed or tested by InnerVault. Details come straight from each source. Anything that can reach your accounts, files or browser can do damage, so read the source before you install it.