InnerVault

Library

85,762 resources from 11 public sources. 53 checked by hand; the rest are unreviewed.

Results

Looks like a goal we have a starting path for: I want to research potential clients

  1. Webcrawl Anything

    MCP servers

    Scrape, map, crawl, search and monitor the web. Runs locally with no API key, cites every source.

    Indexed Official MCP Registry, io.github.brainfish-ai Updated yesterday 3 notes

    @webcrawl/mcp@1.4.8
  2. --- name: robots-txt-and-sitemap-checker description: Checks a site's robots.txt and XML sitemap offline the way Google reads them. Picks the crawler's group, resolves longest-match Allow and Disallow with wildcards…

    Indexed prompts.chat (CC0 prompt collection), f CC0-1.0

  3. Open-source SEO & GEO audit: a zero-dependency CLI (npx), an agent skill for Claude Code, Cursor, Codex, Gemini & Copilot, 47 SEO prompts and a cited Google/Bing/AI-search knowledge base. Checks robots.txt, sitemaps, canonicals, hreflang, structured data, Core Web Vitals and AI crawlers — then fixes them.

    Indexed GitHub, umutxyp 581 ★MITUpdated 5 days ago

    git clone https://github.com/umutxyp/Seo-Promt-Master.git
  4. seo-skills

    Skills

    Free, open-source Shopify SEO audit for Claude Code, Codex and Cursor. Check any store or site from its URL: what Google and AI crawlers can read, and what to fix first. No app, no API keys.

    Stale GitHub, JittoJoseph 6 ★MITUpdated 7 days ago

    git clone https://github.com/JittoJoseph/seo-skills.git
  5. scrape data from Google Maps. Extracts data such as the name, address, phone number, website URL, rating, reviews number, latitude and longitude, reviews,email and more for each place

    Indexed GitHub, gosom 8,121 ★MITUpdated yesterday

    git clone https://github.com/gosom/google-maps-scraper.git
  6. exa-mcp-server

    MCP servers

    Exa MCP for web search and web crawling!

    Stale GitHub, exa-labs 5,215 ★MITUpdated 11 days ago

    git clone https://github.com/exa-labs/exa-mcp-server.git
  7. nopecha-extension

    Agents & frameworks

    Automated CAPTCHA solver for your browser. Works with Selenium, Puppeteer, Playwright, and more.

    Stale GitHub, NopeCHALLC 11.0k ★MITUpdated 45 days ago

    git clone https://github.com/NopeCHALLC/nopecha-extension.git
  8. ketch

    Agents & frameworks

    Fast, stateless CLI for web search and scrape. Built for AI agents.

    Indexed GitHub, 1broseidon 748 ★MITUpdated 3 days ago

    git clone https://github.com/1broseidon/ketch.git
  9. JustHireMe

    AI repositories

    Local-first AI job intelligence workbench for scraping roles, ranking fit, and generating tailored application materials.

    Stale GitHub, vasu-devs 2,257 ★AGPL-3.0Updated 38 days ago

    git clone https://github.com/vasu-devs/JustHireMe.git
  10. reverse-api-engineer

    Agents & frameworks

    Reverse engineer any website into a typed API client. Works with Claude Code, Codex, Cursor and OpenCode.

    Stale GitHub, kalil0321 2,054 ★MITUpdated 18 days ago

    git clone https://github.com/kalil0321/reverse-api-engineer.git
  11. donsetch

    Agents & frameworks

    Web fetch, search, and crawl for AI agents. Built from scratch in Rust. No keys, no accounts. AGPL v3.

    Indexed GitHub, dondai44423 1,000 ★AGPL-3.0Updated today

    git clone https://github.com/dondai44423/donsetch.git
  12. Scrapling MCP Server

    MCP servers

    Web scraping with stealth HTTP, real browsers, and Cloudflare bypass. CSS selectors supported.

    Stale Official MCP Registry, io.github.D4Vinci 89.2k ★Updated 12 days ago 1 note

    scrapling@0.5.1
  13. decodo-openclaw-skill

    AI repositories

    OpenClaw skill for scraping any URL using the Decodo Web Scraping API.

    Stale GitHub, Decodo 152 ★Updated 18 days ago

    git clone https://github.com/Decodo/decodo-openclaw-skill.git
  14. Clone any website with one command using AI coding agents

    Indexed GitHub, JCodesMore 39.1k ★MITUpdated 6 days ago

    git clone https://github.com/JCodesMore/ai-website-cloner-template.git
  15. skills

    Skills

    Browser automation CLI built for AI agents. Break through anti-bot walls, hand off to humans across platforms when stuck. Parallel multi-task execution, independent multi-session operation, isolated multi-account browsing.

    Stale GitHub, browser-act 6,329 ★MITUpdated 12 days ago

    git clone https://github.com/browser-act/skills.git
  16. llm-reader

    Agents & frameworks

    Turn Webpage to LLM friendly input text. Similar to Firecrawl and Jina Reader API. Makes RAG, AI web scraping, image & webpage links extraction easy.

    Indexed GitHub, m92vyas 316 ★MITUpdated 6 days ago

    git clone https://github.com/m92vyas/llm-reader.git
  17. SurfSense

    AI repositories

    Air-gapped, privacy-focused, open-source NotebookLM alternative. AI agent that researches, transforms, and edits your documents. Join our Discord: https://discord.gg/ejRNvftDp9

    Indexed GitHub, MODSetter 16.9k ★Apache-2.0Updated 2 days ago

    git clone https://github.com/MODSetter/SurfSense.git
  18. stagehand

    Agents & frameworks

    The SDK to extract data and interact with any site on the web. Get started with Claude Code, Codex, Eve, Mastra, and more.

    Indexed GitHub, browserbase 26.0k ★MITUpdated 3 days ago

    git clone https://github.com/browserbase/stagehand.git
  19. MinerU-HTML

    AI repositories

    MinerU-HTML: An SLM-powered HTML main content extractor that outputs clean HTML bodies. Perfect for Deep Research Agents, RAG applications, and training data generation.

    Stale GitHub, opendatalab 299 ★Apache-2.0Updated 10 days ago

    git clone https://github.com/opendatalab/MinerU-HTML.git
  20. x-reader

    MCP servers

    Universal content reader MCP Server for 10+ platforms

    Stale GitHub, runesleo 988 ★MITUpdated 6 days ago

    git clone https://github.com/runesleo/x-reader.git
  21. google-search

    MCP servers

    A Playwright-based Node.js tool that bypasses search engine anti-scraping mechanisms to execute Google searches. Local alternative to SERP APIs with MCP server integration.

    Stale GitHub, web-agent-master 623 ★Updated 19 months ago

    git clone https://github.com/web-agent-master/google-search.git
  22. CloakBrowser

    Agents & frameworks

    Stealth Chromium that passes every bot detection test. Drop-in Playwright replacement with source-level fingerprint patches. 50+ tests passed.

    Stale GitHub, CloakHQ 32.5k ★MITUpdated 20 days ago

    git clone https://github.com/CloakHQ/CloakBrowser.git
  23. agentql-mcp

    MCP servers

    Model Context Protocol server that integrates AgentQL's data extraction capabilities.

    Indexed GitHub, tinyfish-io 183 ★MITUpdated 2 days ago

    git clone https://github.com/tinyfish-io/agentql-mcp.git
  24. Skill_Seekers

    Skills

    Convert documentation websites, GitHub repositories, and PDFs into Claude AI skills with automatic conflict detection

    Indexed GitHub, yusufkaraaslan 15.3k ★MITUpdated today

    git clone https://github.com/yusufkaraaslan/Skill_Seekers.git

Indexed entries aren't reviewed or tested by InnerVault. Details come straight from each source. Anything that can reach your accounts, files or browser can do damage, so read the source before you install it.