InnerVault

Library

85,340 resources from 11 public sources. 54 checked by hand; the rest are unreviewed.

Results

  1. inference

    AI repositories

    Open-source inference platform for language, vision, embedding, reranking, image, audio, and video models. Deploy with multiple engines across heterogeneous hardware, from a laptop to a distributed cluster. Serve models through OpenAI-compatible APIs.

    Indexed GitHub, xorbitsai 9,660 ★Apache-2.0Updated today

    git clone https://github.com/xorbitsai/inference.git
  2. ETOS-LLM-Studio

    AI repositories

    A native LLM client for iOS & Apple Watch. Run local GGUF models offline via llama.cpp, or connect to OpenAI/Claude/Gemini. Features local RAG, Model Context Protocol (MCP) tools, Siri Shortcuts, and cross-device sync. Built with Swift.

    Indexed GitHub, Eric-Terminal 220 ★GPL-3.0Updated yesterday

    git clone https://github.com/Eric-Terminal/ETOS-LLM-Studio.git
  3. df0

    AI repositories

    DF-0: Data processing Framework with Zero-overhead. Local-first C++20 data-processing infrastructure for deterministic, auditable, on-premise workflows. Supports 100+ formats, OCR, local AI, and opt-in cloud AI pipelines

    Indexed GitHub, df0-io 119 ★Custom licence (see repository)Updated yesterday

    git clone https://github.com/df0-io/df0.git
  4. agentty

    AI repositories

    AI pair programming in your terminal — one static binary, sub-ms startup, any model

    Indexed GitHub, agentty-org 624 ★MITUpdated yesterday

    git clone https://github.com/agentty-org/agentty.git
  5. askimo

    AI repositories

    AI desktop app for chat, RAG, Skills, MCP tools, and agents. Support multiple LLMs (Anthropic, OpenAI, VertexAI, vLLM, Nvidia NIM, Gemini, OpenRouter)

    Indexed GitHub, askimo-ai 550 ★AGPL-3.0Updated yesterday

    git clone https://github.com/askimo-ai/askimo.git
  6. jev

    AI repositories

    jevos: an open-source alternative to Jev and Microsoft-Decision-1. Yes/no decisions, choices and scores with probabilities, on your laptop's CPU.

    Stale GitHub, feder-cr 1,342 ★MITUpdated 31 days ago

    git clone https://github.com/feder-cr/jev.git
  7. janas

    AI repositories

    37 tok/s from Qwen3-Next-80B (48 GB) on a 32 GB laptop, 24 without drafts vs 2.8 for llama.cpp; reading 62 vs 16 tok/s. Faster than llama.cpp on all 13 models compared in Q4_K_M. LLMs bigger than your RAM, pure C, CPU or GPU.

    Indexed GitHub, prabanta-dev 717 ★GPL-3.0Updated today

    git clone https://github.com/prabanta-dev/janas.git
  8. ClawMem

    AI repositories

    On-device memory layer for AI agents. Claude Code, OpenClaw and Hermes. Hooks + MCP server + hybrid RAG search.

    Stale GitHub, yoloshii 212 ★MITUpdated 9 days ago

    git clone https://github.com/yoloshii/ClawMem.git
  9. graphrag-rs

    AI repositories

    GraphRAG-rs is a high-performance, state-of-the-art Rust implementation of GraphRAG (Graph-based Retrieval Augmented Generation) that builds knowledge graphs from documents and enables natural language querying with configurable entity extraction and local LLM integration

    Indexed GitHub, automataIA 539 ★MITUpdated today

    git clone https://github.com/automataIA/graphrag-rs.git
  10. Orkas-VideoStudio

    AI repositories

    Turn your coding agent into a video studio: describe a video in plain language, and your agent writes the timeline and produces the file.

    Indexed GitHub, Orkas-AI 349 ★MITUpdated yesterday

    git clone https://github.com/Orkas-AI/Orkas-VideoStudio.git
  11. yzma

    AI repositories

    Go with your own intelligence - Write Go applications that directly integrate llama.cpp for local inference using hardware acceleration on Linux, macOS, Windows, & WebAssembly.

    Stale GitHub, hybridgroup 652 ★Custom licence (see repository)Updated 32 days ago

    git clone https://github.com/hybridgroup/yzma.git
  12. h2ogpt

    AI repositories

    Private chat with local GPT with document, images, video, etc. 100% private, Apache 2.0. Supports oLLaMa, Mixtral, llama.cpp, and more. Demo: https://gpt.h2o.ai/ https://gpt-docs.h2o.ai/

    Stale Archived GitHub, h2oai 11.9k ★Apache-2.0Updated 13 months ago 1 note

    git clone https://github.com/h2oai/h2ogpt.git
  13. ipex-llm

    AI repositories

    Accelerate local LLM inference and finetuning (LLaMA, Mistral, ChatGLM, Qwen, DeepSeek, Mixtral, Gemma, Phi, MiniCPM, Qwen-VL, MiniCPM-V, etc.) on Intel XPU (e.g., local PC with iGPU and NPU, discrete GPU such as Arc, Flex and Max); seamlessly integrate with llama.cpp, Ollama, HuggingFace, LangChain, LlamaIndex, vLLM, DeepSpeed, Axolotl, etc.

    Stale Archived GitHub, intel 8,846 ★Apache-2.0Updated 9 months ago 1 note

    git clone https://github.com/intel/ipex-llm.git

Indexed entries aren't reviewed or tested by InnerVault. Details come straight from each source. Anything that can reach your accounts, files or browser can do damage, so read the source before you install it.