InnerVault

Library

85,762 resources from 11 public sources. 53 checked by hand; the rest are unreviewed.

Results

Looks like a goal we have a starting path for: I want to research potential clients

  1. Technical SEO audit crawler: broken links, 404s, redirects, titles, canonicals. Runs on Apify.

    Stale Official MCP Registry, io.github.stellalytics Updated 3 days ago 1 note

  2. Can ChatGPT, Claude and Perplexity crawlers reach a site? Real per-bot fetch, firewall/CDN blocks.

    Stale Official MCP Registry, io.github.hamzawamiqhq Updated 4 days ago 1 note

  3. Crimson Crawler

    MCP servers

    Enrich, search, assess, and manage threat intelligence through 80+ typed MCP tools.

    Stale Official MCP Registry, com.crimsoncrawler Updated 3 months ago 1 note

  4. seo-crawler-mcp

    MCP servers

    Crawl and analyse websites for SEO errors using Crawlee with SQLite storage

    Stale Official MCP Registry, io.github.houtini-ai Updated 9 months ago 1 note

    @houtini/seo-crawler-mcp@2.0.1
  5. smart-crawler

    MCP servers

    E-commerce competitor intelligence, VOC sentiment, Amazon ASIN analysis, Reddit growth playbooks.

    Stale Official MCP Registry, io.github.shulex-voc Updated 5 months ago 1 note

  6. Code Crawler

    MCP servers

    Static and dynamic call tracing MCP server backed by a SQLite property graph of your codebase

    Indexed Official MCP Registry, io.github.nithin554 Updated yesterday 1 note

    @nithin554/code-crawler@0.1.92
  7. browserpaw

    MCP servers

    BrowserClaw - Control your everyday Chrome browser from AI agents, without losing logins or focus

    Stale GitHub, GoldenLoaf24h 38 ★AGPL-3.0Updated 14 days ago

    git clone https://github.com/GoldenLoaf24h/browserpaw.git
  8. Search or monitor any Flarum-powered forum for discussions, replies, participants, dates, and…

    Stale Official MCP Registry, com.ranovam Updated 49 days ago 1 note

  9. AI Crawler Index

    MCP servers

    {"jsonrpc":"2.0","id":1,"method":"tools/call","params":{"name":"whoami","arguments":{}}} free no key

    Stale Official MCP Registry, dev.workers.pathwren.www Updated 2 months ago 1 note

  10. Crawler Log Triage

    MCP servers

    {"jsonrpc":"2.0","id":1,"method":"tools/call","params":{"name":"whoami","arguments":{}}} free no key

    Stale Official MCP Registry, dev.workers.pathwren.www Updated 2 months ago 1 note

  11. Crawl a website for links, file download links, HTML tables as rows, and lists, with no AI

    Stale Official MCP Registry, com.mambabuilt Updated 5 days ago 2 notes

    @mambalabsdev/mcp-site-crawler-links-tables@1.0.2
  12. webclaw

    MCP servers

    Fast, local-first web content extraction for LLMs. Scrape, crawl, extract structured data — all from Rust. CLI, REST API, and MCP server.

    Stale GitHub, 0xMassi 2,380 ★AGPL-3.0Updated 33 days ago

    git clone https://github.com/0xMassi/webclaw.git
  13. Crawl a website into clean Markdown for LLMs/RAG: main content only, linked docs converted.

    Stale Official MCP Registry, io.github.prometheus-maker Updated 10 days ago 1 note

  14. Turn a website into Markdown with headings, links and word counts.

    Stale Official MCP Registry, io.github.bepolabs Updated 4 days ago 1 note

  15. {"jsonrpc":"2.0","id":1,"method":"tools/call","params":{"name":"whoami","arguments":{}}} free no key

    Stale Official MCP Registry, dev.workers.pathwren.www Updated 2 months ago 1 note

  16. Crawl sites to Markdown with sitemaps, globs and depth limits, obeying robots and crawl-delay

    Stale Official MCP Registry, io.github.kriton-dev Updated 14 days ago 1 note

  17. Website to clean Markdown or JSON for AI and RAG: read pages, crawl sites, extract described fields.

    Stale Official MCP Registry, io.github.ByteBlisk Updated 8 days ago 1 note

  18. One-call audit: robots.txt AI-bot rules, llms.txt, JSON-LD, meta tags, sitemap. Score plus fixes.

    Stale Official MCP Registry, app.rowb.ai-visibility Updated 54 days ago 1 note

  19. 🚀 自托管的抖音、TikTok、B 站数据采集与无水印视频下载 API,支持 AI agent 通过 MCP 调用与离线语音转文字,Docker 一键部署。| Self-hosted TikTok, Douyin & Bilibili scraper and no-watermark video downloader — async REST API, MCP server for AI agents, CLI and web console, plus offline speech-to-text for downloaded videos. Self-healing identity pool, PostgreSQL archive, one docker compose up.

    Stale GitHub, Evil0ctal 21.1k ★Apache-2.0Updated 14 days ago

    git clone https://github.com/Evil0ctal/Douyin_TikTok_Download_API.git
  20. pagesift

    MCP servers

    Local-first web & document ingestion engine in Rust — HTTP/browser capture, layout-aware PDF/Office/OCR parsing, persistent sync, and verifiable data graphs.

    Indexed GitHub, YOLOW92 274 ★Apache-2.0Updated today

    git clone https://github.com/YOLOW92/pagesift.git
  21. IndexLinks

    MCP servers

    Check how crawlers see a site, send new pages to search engines and AI crawlers, see crawl receipts.

    Stale Official MCP Registry, app.indexlinks Updated 42 days ago 1 note

  22. Siteiz

    MCP servers

    Check which AI crawlers a site allows and see pages the way AI crawlers do. Free, read-only.

    Stale Official MCP Registry, com.siteiz Updated 44 days ago 1 note

  23. UAParse

    MCP servers

    Parse a User-Agent: browser, OS, device, plus bot, search crawler, AI crawler and AI agent flags.

    Stale Official MCP Registry, dev.workers.mike-tusa.uaparse Updated 15 days ago 1 note

  24. skald

    MCP servers

    Self-hosted Google Analytics alternative that reads your server access log: real people, AI assistants, crawlers, bots and the scanners probing your site, which JavaScript analytics never see. Leads and revenue by source. Every figure counted twice. No cookies, no third-party script. Python, SQLite, Docker.

    Indexed GitHub, spcaeo 22 ★Custom licence (see repository)Updated 3 days ago

    git clone https://github.com/spcaeo/skald.git

Indexed entries aren't reviewed or tested by InnerVault. Details come straight from each source. Anything that can reach your accounts, files or browser can do damage, so read the source before you install it.