InnerVault

Library

85,340 resources from 11 public sources. 54 checked by hand; the rest are unreviewed.

Results

  1. chatllm.cpp

    AI repositories

    Pure C++ implementation of several models for real-time chatting on your computer (CPU & GPU)

    Stale GitHub, foldl 932 ★MITUpdated 29 days ago

    git clone https://github.com/foldl/chatllm.cpp.git
  2. llama.rn

    AI repositories

    React Native binding of llama.cpp

    Stale GitHub, mybigday 1,073 ★MITUpdated 4 days ago

    git clone https://github.com/mybigday/llama.rn.git
  3. infinity

    AI repositories

    The AI-native database built for LLM applications, providing incredibly fast hybrid search of dense vector, sparse vector, tensor (multi-vector), and full-text.

    Indexed GitHub, infiniflow 4,766 ★Apache-2.0Updated today

    git clone https://github.com/infiniflow/infinity.git
  4. BigMoeOnEdge

    AI repositories

    Run MoE models bigger than your RAM. Frontier-size MoE on a phone, laptop, edge. Lossless, on stock llama.cpp. An adaptive streaming optimizer. Any hardware, any OS, any model, any quantization, behind a local OpenAI-compatible server.

    Indexed GitHub, Helldez 924 ★Apache-2.0Updated today

    git clone https://github.com/Helldez/BigMoeOnEdge.git
  5. PS5LM

    AI repositories

    llama.cpp on a jailbroken PS5: run any GGUF model natively on the console, starting with Qwen 3.8

    Stale GitHub, cobanov 673 ★GPL-3.0Updated 24 days ago

    git clone https://github.com/cobanov/PS5LM.git
  6. inferssd

    AI repositories

    Run models larger than your RAM or VRAM by streaming MoE experts from SSD. Built on llama.cpp.

    Indexed GitHub, wici-ai 1,025 ★Apache-2.0Updated 3 days ago

    git clone https://github.com/wici-ai/inferssd.git
  7. atomic-agent

    AI repositories

    Atomic Agent is a local-first AI agent. Runs open-weight models on your own machine via llama.cpp.

    Stale GitHub, AtomicBot-ai 3,460 ★MITUpdated 19 days ago

    git clone https://github.com/AtomicBot-ai/atomic-agent.git
  8. runanywhere-sdks

    AI repositories

    Production ready toolkit to run AI locally

    Stale GitHub, RunanywhereAI 10.3k ★Custom licence (see repository)Updated 12 days ago

    git clone https://github.com/RunanywhereAI/runanywhere-sdks.git
  9. LLamaSharp

    AI repositories

    A C#/.NET library to run LLM (🦙LLaMA/LLaVA) on your local device efficiently.

    Stale GitHub, SciSharp 3,810 ★MITUpdated 30 days ago

    git clone https://github.com/SciSharp/LLamaSharp.git
  10. Llamatik

    AI repositories

    True on-device AI SDK for Kotlin Multiplatform (Android, iOS, Desktop, JVM, WASM). LLM inference, Speech-to-Text, Image Generation, Agent Framework and RAG — powered by llama.cpp, whisper.cpp and stable-diffusion.cpp.

    Indexed GitHub, llamatik 220 ★Custom licence (see repository)Updated 3 days ago

    git clone https://github.com/llamatik/Llamatik.git
  11. LLMUnity

    AI repositories

    Create characters in Unity with LLMs!

    Stale GitHub, undreamai 1,719 ★Apache-2.0Updated 6 months ago

    git clone https://github.com/undreamai/LLMUnity.git
  12. Dot

    AI repositories

    Text-To-Speech, RAG, and LLMs. All local!

    Stale GitHub, alexpinel 1,914 ★GPL-3.0Updated 23 months ago

    git clone https://github.com/alexpinel/Dot.git
  13. llmman

    AI repositories

    Run any agent on any model, models stored as OCI images

    Indexed GitHub, llmmanorg 590 ★Apache-2.0Updated yesterday

    git clone https://github.com/llmmanorg/llmman.git
  14. forge

    AI repositories

    A Python framework for self-hosted LLM tool-calling and multi-step agentic workflows

    Stale GitHub, antoinezambelli 2,264 ★MITUpdated 14 days ago

    git clone https://github.com/antoinezambelli/forge.git
  15. llama-gpt

    AI repositories

    A self-hosted, offline, ChatGPT-like chatbot. Powered by Llama 2. 100% private, with no data leaving your device. New: Code Llama support!

    Stale GitHub, getumbrel 10.9k ★MITUpdated 2 years ago

    git clone https://github.com/getumbrel/llama-gpt.git
  16. hax

    AI repositories

    A minimalist, terminal-native coding agent written in C.

    Stale GitHub, OleksandrChekhovskyi 921 ★MITUpdated 30 days ago

    git clone https://github.com/OleksandrChekhovskyi/hax.git
  17. wllama

    AI repositories

    WebAssembly binding for llama.cpp - Enabling on-browser LLM inference

    Stale GitHub, ngxson 1,363 ★MITUpdated 10 days ago

    git clone https://github.com/ngxson/wllama.git
  18. LLM-Hub

    AI repositories

    Local LLM, image&video&music generator

    Indexed GitHub, timmyy123 646 ★Custom licence (see repository)Updated 4 days ago

    git clone https://github.com/timmyy123/LLM-Hub.git
  19. TinyLLM

    AI repositories

    Setup and run a local LLM and Chatbot using consumer grade hardware.

    Stale GitHub, jasonacox 353 ★MITUpdated 22 days ago

    git clone https://github.com/jasonacox/TinyLLM.git
  20. biniou

    AI repositories

    a self-hosted webui for 30+ generative ai

    Indexed GitHub, Woolverine94 1,153 ★GPL-3.0Updated 2 days ago

    git clone https://github.com/Woolverine94/biniou.git
  21. meetily

    AI repositories

    Privacy-first AI meeting note taker for Windows and macOS. Free, open source (MIT). On-device Whisper/Parakeet transcription and speaker diarization, no meeting bot. Open-source alternative to Granola, Otter and Fireflies. https://meetily.ai

    Indexed GitHub, Zackriya-Solutions 32.7k ★MITUpdated 3 days ago

    git clone https://github.com/Zackriya-Solutions/meetily.git
  22. SiliconScope

    AI repositories

    Sudoless Apple Silicon system monitor (native SwiftUI GUI) with ANE / Media Engine / memory-bandwidth tracking

    Stale GitHub, kennss 1,013 ★MITUpdated 14 days ago

    git clone https://github.com/kennss/SiliconScope.git
  23. HilbertRaum

    AI repositories

    AI, fully local on your computer.

    Indexed GitHub, HilbertraumAI 149 ★GPL-3.0Updated today

    git clone https://github.com/HilbertraumAI/HilbertRaum.git
  24. oneDNN

    AI repositories

    Open-source library of optimized deep learning operations (matmul, convolution, attention) for CPUs (x64, AArch64, RISC-V) and Intel GPUs. Used by PyTorch, TensorFlow, OpenVINO, and ONNX Runtime.

    Indexed GitHub, uxlfoundation 4,094 ★Apache-2.0Updated today

    git clone https://github.com/uxlfoundation/oneDNN.git

Indexed entries aren't reviewed or tested by InnerVault. Details come straight from each source. Anything that can reach your accounts, files or browser can do damage, so read the source before you install it.