InnerVault

Library

85,340 resources from 11 public sources. 54 checked by hand; the rest are unreviewed.

Results

7 results with any of your words Clear search and filters

Looks like a goal we have a starting path for: I want to research potential clients

  1. Scrapegraph-ai

    AI repositories

    Python scraper based on AI

    Stale GitHub, ScrapeGraphAI 31.8k ★MITUpdated 41 days ago

    git clone https://github.com/ScrapeGraphAI/Scrapegraph-ai.git
  2. trafilatura

    AI repositories

    Python & Command-line tool to gather text and metadata on the Web: Crawling, scraping, extraction, output as CSV, JSON, HTML, MD, TXT, XML

    Indexed GitHub, adbar 7,128 ★Apache-2.0Updated 3 days ago

    git clone https://github.com/adbar/trafilatura.git
  3. searxNcrawl

    AI repositories

    Open-source MCP server that gives AI agents web search (SearXNG) and clean Markdown crawling of pages, whole sites and logged-in areas. Self-hosted, no API key. Firecrawl-compatible API planned.

    Stale GitHub, DasDigitaleMomentum 189 ★MITUpdated 5 days ago

    git clone https://github.com/DasDigitaleMomentum/searxNcrawl.git
  4. wigolo

    AI repositories

    The go-to web for your AI coding agent — local-first search, fetch, crawl & research over MCP. No API keys, no cloud, $0/query. Public beta.

    Indexed GitHub, KnockOutEZ 5,546 ★Custom licence (see repository)Updated yesterday

    git clone https://github.com/KnockOutEZ/wigolo.git
  5. fess

    AI repositories

    Open-source, self-hosted enterprise & site search server built on OpenSearch. Crawls web / file / DB / cloud sources, 20+ languages, REST API, and AI/RAG & semantic search. Apache-2.0.

    Indexed GitHub, codelibs 1,151 ★Apache-2.0Updated yesterday

    git clone https://github.com/codelibs/fess.git
  6. AnyCrawl

    AI repositories

    AnyCrawl 🚀: A Node.js/TypeScript crawler that turns websites into LLM-ready data and extracts structured SERP results from Google/Bing/Baidu/etc. Native multi-threading for bulk processing.

    Indexed GitHub, any4ai 3,528 ★MITUpdated 4 days ago

    git clone https://github.com/any4ai/AnyCrawl.git
  7. basemind

    AI repositories

    Full AI context and content layer for coding agents over one MCP server — tree-sitter code-map, document RAG, shared memory, multi-agent comms, web crawl, git history + blame. 300+ languages, 10+ agent harnesses, pure Rust.

    Indexed GitHub, Goldziher 121 ★MITUpdated today

    git clone https://github.com/Goldziher/basemind.git

Indexed entries aren't reviewed or tested by InnerVault. Details come straight from each source. Anything that can reach your accounts, files or browser can do damage, so read the source before you install it.