InnerVault

Library

85,762 resources from 11 public sources. 54 checked by hand; the rest are unreviewed.

Results

  1. halogen-flash-server

    AI repositories

    Local inference that behaves like a frontier API: Qwen3.8-Flash-Next on AMD Strix Halo plus small NPU models, over the OpenAI and Anthropic APIs on one port.

    Stale GitHub, peonist-ai 1,258 ★Custom licence (see repository)Updated 9 days ago

    git clone https://github.com/peonist-ai/halogen-flash-server.git
  2. locally-uncensored

    AI repositories

    The all-in-one local AI studio for your desktop: chat, image and video generation and a coding agent in one free, open source app. Windows and Linux. No Docker, no terminal, no cloud required.

    Stale GitHub, PurpleDoubleD 3,320 ★AGPL-3.0Updated 12 days ago

    git clone https://github.com/PurpleDoubleD/locally-uncensored.git
  3. jev

    AI repositories

    jevos: an open-source alternative to Jev and Microsoft-Decision-1. Yes/no decisions, choices and scores with probabilities, on your laptop's CPU.

    Stale GitHub, feder-cr 1,342 ★MITUpdated 32 days ago

    git clone https://github.com/feder-cr/jev.git
  4. ObsidianRAG

    AI repositories

    Ask questions about your Obsidian notes using local AI. Privacy-first RAG with Ollama, LM Studio, or any OpenAI-compatible server. Obsidian plugin + Docker + PyPI.

    Indexed GitHub, Vasallo94 127 ★MITUpdated 3 days ago

    git clone https://github.com/Vasallo94/ObsidianRAG.git
  5. LLM-Hub

    AI repositories

    Local LLM, image&video&music generator

    Indexed GitHub, timmyy123 646 ★Custom licence (see repository)Updated 5 days ago

    git clone https://github.com/timmyy123/LLM-Hub.git
  6. TinyLLM

    AI repositories

    Setup and run a local LLM and Chatbot using consumer grade hardware.

    Stale GitHub, jasonacox 353 ★MITUpdated 23 days ago

    git clone https://github.com/jasonacox/TinyLLM.git
  7. project-maya

    AI repositories

    Project Maya - run GLM-5.3-Flash (321B MoE), DeepSeek-V4.1-Flash-1017 (748B MoE) and MiniMax-M3.1-Flash (428B MoE) privately on your own GPU(s), from one card to 16, NVIDIA or AMD, Linux or Windows. Engine, server, dashboard, OpenAI- and Anthropic-compatible API, quant tools.

    Stale GitHub, mw00 2,482 ★MITUpdated 13 days ago

    git clone https://github.com/mw00/project-maya.git
  8. home-generative-agent

    AI repositories

    AI agent for Home Assistant — talk to your home, create automations in plain language, analyze cameras with face recognition, and get proactive anomaly alerts. Cloud LLMs or fully local.

    Indexed GitHub, goruck 378 ★MITUpdated yesterday

    git clone https://github.com/goruck/home-generative-agent.git
  9. NanoSage

    AI repositories

    Local LLM Powered Recursive Search & Smart Knowledge Explorer

    Stale GitHub, masterFoad 265 ★Apache-2.0Updated 22 days ago

    git clone https://github.com/masterFoad/NanoSage.git
  10. libre-webui

    AI repositories

    A local-first workspace for chat, private knowledge, artifacts, and isolated model-driven work. Self-hosted. Provider-flexible. Apache 2.0.

    Indexed GitHub, libre-webui 106 ★Apache-2.0Updated yesterday

    git clone https://github.com/libre-webui/libre-webui.git
  11. janas

    AI repositories

    37 tok/s from Qwen3-Next-80B (48 GB) on a 32 GB laptop, 24 without drafts vs 2.8 for llama.cpp; reading 62 vs 16 tok/s. Faster than llama.cpp on all 13 models compared in Q4_K_M. LLMs bigger than your RAM, pure C, CPU or GPU.

    Indexed GitHub, prabanta-dev 717 ★GPL-3.0Updated yesterday

    git clone https://github.com/prabanta-dev/janas.git
  12. starling

    AI repositories

    Local AI in .NET, with no Python sidecar and no API key: embeddings, entity extraction, image and video search and chat on ONNX Runtime (CPU/CUDA), through Microsoft.Extensions.AI.

    Indexed GitHub, starlinghq 102 ★Apache-2.0Updated yesterday

    git clone https://github.com/starlinghq/starling.git
  13. khoj

    AI repositories

    Your AI second brain. Self-hostable. Get answers from the web or your docs. Build custom agents, schedule automations, do deep research. Turn any online or local LLM into your personal, autonomous AI (gpt, claude, gemini, llama, qwen, mistral). Get started - free.

    Stale GitHub, khoj-ai 37.7k ★AGPL-3.0Updated 3 months ago

    git clone https://github.com/khoj-ai/khoj.git
  14. PolyStrata

    AI repositories

    Run large AI models on your own PC: Qwen3.8-Flash-Next on Strata's engine, and GLM 5.3 Flash, DeepSeek V4 Flash, LFM2.5, Qwen3.6, Ornith 1.5, Gemma 4, Tiel Coder and MiniCPM-V on a second engine written for PolyStrata. One-click install for Windows and Linux, OpenAI/Anthropic API on localhost.

    Stale GitHub, VecSzn 722 ★MITUpdated 17 days ago

    git clone https://github.com/VecSzn/PolyStrata.git
  15. llm-wiki-v2

    AI repositories

    Turn your documents into a Markdown wiki you can read, that answers with citations. Works with any LLM provider, Ollama included. CROW: 99.5% right note read vs 79%, 1.6× faster ingest, 63% fewer LLM tokens, no scaling limit.

    Indexed GitHub, crow-hq 284 ★AGPL-3.0Updated 3 days ago

    git clone https://github.com/crow-hq/llm-wiki-v2.git
  16. slotstream

    AI repositories

    Run a 105 GB AI model on a Mac that can't hold it. Qwen3.8-Flash-Next 4-bit, streamed from SSD on 16–64 GB Apple Silicon Macs. Fully native Swift, MLX and Metal. Offline, no Python. CLI, Swift library, and Ollama/OpenAI/Anthropic APIs. Works with Claude Code and Codex.

    Indexed GitHub, carloslfu 673 ★MITUpdated yesterday

    git clone https://github.com/carloslfu/slotstream.git
  17. humla

    AI repositories

    Open-source AI meeting notes for Mac. Records mic + system audio with no bot, transcribes on-device or via OpenAI / Deepgram / Groq, identifies speakers offline, and writes summaries that fuse your notes with the transcript. Ask your notes and get cited answers. Tauri 2 + Rust + Swift.

    Indexed GitHub, michaelwilhelmsen 349 ★MITUpdated 2 days ago

    git clone https://github.com/michaelwilhelmsen/humla.git
  18. IncarnaMind

    AI repositories

    From messy files to a checked report. A free, open-source desktop app for macOS, Windows and Linux: write and analyse with AI from your own files, check each sentence and figure against them, and export to Word. Meeting notes too. Works with ChatGPT, Claude, Gemini or a local model through Ollama.

    Indexed GitHub, IncarnaMind 858 ★Apache-2.0Updated yesterday

    git clone https://github.com/IncarnaMind/IncarnaMind.git
  19. model-compose

    AI repositories

    Declarative AI pipelines in one YAML file. Tokens, audio chunks, and video frames flow between isolated components. Compose 100+ components for models, agents, speech, vision, and live broadcast. Run local models, cloud APIs, or both. Inspired by docker-compose.

    Indexed GitHub, hanyeol 119 ★MITUpdated yesterday

    git clone https://github.com/hanyeol/model-compose.git
  20. OGAD

    AI repositories

    Your private, on-device personal AI assistant for macOS, Windows and Linux. Chat, create, search files, and connect tools with local models. Includes an OpenAI-compatible API. Opt-in Pro sees, remembers, reflects, and acts with your approval, for one payment. No cloud or account.

    Indexed GitHub, off-grid-ai 147 ★AGPL-3.0Updated 2 days ago

    git clone https://github.com/off-grid-ai/OGAD.git
  21. graphrag-rs

    AI repositories

    GraphRAG-rs is a high-performance, state-of-the-art Rust implementation of GraphRAG (Graph-based Retrieval Augmented Generation) that builds knowledge graphs from documents and enables natural language querying with configurable entity extraction and local LLM integration

    Indexed GitHub, automataIA 539 ★MITUpdated yesterday

    git clone https://github.com/automataIA/graphrag-rs.git
  22. restai

    AI repositories

    RESTai is an AIaaS (AI as a Service) open-source platform. Supports many public and local LLM suported by Ollama/vLLM/etc. Precise embeddings usage, tuning, analytics etc. Built-in image/audio generation with dynamic loading generators. Live chat deployment. Built-in block based graphical language. Prompt versioning and much more...

    Indexed GitHub, apocas 520 ★Apache-2.0Updated 4 days ago

    git clone https://github.com/apocas/restai.git
  23. ipex-llm

    AI repositories

    Accelerate local LLM inference and finetuning (LLaMA, Mistral, ChatGLM, Qwen, DeepSeek, Mixtral, Gemma, Phi, MiniCPM, Qwen-VL, MiniCPM-V, etc.) on Intel XPU (e.g., local PC with iGPU and NPU, discrete GPU such as Arc, Flex and Max); seamlessly integrate with llama.cpp, Ollama, HuggingFace, LangChain, LlamaIndex, vLLM, DeepSpeed, Axolotl, etc.

    Stale Archived GitHub, intel 8,846 ★Apache-2.0Updated 9 months ago 1 note

    git clone https://github.com/intel/ipex-llm.git
  24. self-hosted-ai-stack

    AI repositories

    Deploy a self-hosted AI stack with Docker Compose: local LLMs, chat, document parsing, embeddings, transcription, text-to-speech and MCP tools. Powered by Ollama, LiteLLM, AnythingLLM and more. Local-first with auto-configured authentication, lightweight stacks, optional HTTPS and NVIDIA GPU support. MIT licensed. Multi-arch: amd64, arm64.

    Indexed GitHub, hwdsl2 179 ★MITUpdated 2 days ago

    git clone https://github.com/hwdsl2/self-hosted-ai-stack.git

Indexed entries aren't reviewed or tested by InnerVault. Details come straight from each source. Anything that can reach your accounts, files or browser can do damage, so read the source before you install it.