InnerVault

Library

85,762 resources from 11 public sources. 53 checked by hand; the rest are unreviewed.

Results

  1. llama.rn

    AI repositories

    React Native binding of llama.cpp

    Stale GitHub, mybigday 1,073 ★MITUpdated 4 days ago

    git clone https://github.com/mybigday/llama.rn.git
  2. PS5LM

    AI repositories

    llama.cpp on a jailbroken PS5: run any GGUF model natively on the console, starting with Qwen 3.8

    Stale GitHub, cobanov 673 ★GPL-3.0Updated 24 days ago

    git clone https://github.com/cobanov/PS5LM.git
  3. inferssd

    AI repositories

    Run models larger than your RAM or VRAM by streaming MoE experts from SSD. Built on llama.cpp.

    Indexed GitHub, wici-ai 1,025 ★Apache-2.0Updated 3 days ago

    git clone https://github.com/wici-ai/inferssd.git
  4. atomic-agent

    AI repositories

    Atomic Agent is a local-first AI agent. Runs open-weight models on your own machine via llama.cpp.

    Stale GitHub, AtomicBot-ai 3,460 ★MITUpdated 19 days ago

    git clone https://github.com/AtomicBot-ai/atomic-agent.git
  5. LLamaSharp

    AI repositories

    A C#/.NET library to run LLM (🦙LLaMA/LLaVA) on your local device efficiently.

    Stale GitHub, SciSharp 3,810 ★MITUpdated 30 days ago

    git clone https://github.com/SciSharp/LLamaSharp.git
  6. LLMUnity

    AI repositories

    Create characters in Unity with LLMs!

    Stale GitHub, undreamai 1,719 ★Apache-2.0Updated 6 months ago

    git clone https://github.com/undreamai/LLMUnity.git
  7. llmman

    AI repositories

    Run any agent on any model, models stored as OCI images

    Indexed GitHub, llmmanorg 590 ★Apache-2.0Updated yesterday

    git clone https://github.com/llmmanorg/llmman.git
  8. forge

    AI repositories

    A Python framework for self-hosted LLM tool-calling and multi-step agentic workflows

    Stale GitHub, antoinezambelli 2,264 ★MITUpdated 14 days ago

    git clone https://github.com/antoinezambelli/forge.git
  9. llama-gpt

    AI repositories

    A self-hosted, offline, ChatGPT-like chatbot. Powered by Llama 2. 100% private, with no data leaving your device. New: Code Llama support!

    Stale GitHub, getumbrel 10.9k ★MITUpdated 2 years ago

    git clone https://github.com/getumbrel/llama-gpt.git
  10. hax

    AI repositories

    A minimalist, terminal-native coding agent written in C.

    Stale GitHub, OleksandrChekhovskyi 921 ★MITUpdated 30 days ago

    git clone https://github.com/OleksandrChekhovskyi/hax.git
  11. BigMoeOnEdge

    AI repositories

    Run MoE models bigger than your RAM. Frontier-size MoE on a phone, laptop, edge. Lossless, on stock llama.cpp. An adaptive streaming optimizer. Any hardware, any OS, any model, any quantization, behind a local OpenAI-compatible server.

    Indexed GitHub, Helldez 924 ★Apache-2.0Updated today

    git clone https://github.com/Helldez/BigMoeOnEdge.git
  12. wllama

    AI repositories

    WebAssembly binding for llama.cpp - Enabling on-browser LLM inference

    Stale GitHub, ngxson 1,363 ★MITUpdated 10 days ago

    git clone https://github.com/ngxson/wllama.git
  13. LLM-Hub

    AI repositories

    Local LLM, image&video&music generator

    Indexed GitHub, timmyy123 646 ★Custom licence (see repository)Updated 4 days ago

    git clone https://github.com/timmyy123/LLM-Hub.git
  14. TinyLLM

    AI repositories

    Setup and run a local LLM and Chatbot using consumer grade hardware.

    Stale GitHub, jasonacox 353 ★MITUpdated 22 days ago

    git clone https://github.com/jasonacox/TinyLLM.git
  15. biniou

    AI repositories

    a self-hosted webui for 30+ generative ai

    Indexed GitHub, Woolverine94 1,153 ★GPL-3.0Updated 2 days ago

    git clone https://github.com/Woolverine94/biniou.git
  16. SiliconScope

    AI repositories

    Sudoless Apple Silicon system monitor (native SwiftUI GUI) with ANE / Media Engine / memory-bandwidth tracking

    Stale GitHub, kennss 1,013 ★MITUpdated 14 days ago

    git clone https://github.com/kennss/SiliconScope.git
  17. HilbertRaum

    AI repositories

    AI, fully local on your computer.

    Indexed GitHub, HilbertraumAI 149 ★GPL-3.0Updated today

    git clone https://github.com/HilbertraumAI/HilbertRaum.git
  18. ETOS-LLM-Studio

    AI repositories

    A native LLM client for iOS & Apple Watch. Run local GGUF models offline via llama.cpp, or connect to OpenAI/Claude/Gemini. Features local RAG, Model Context Protocol (MCP) tools, Siri Shortcuts, and cross-device sync. Built with Swift.

    Indexed GitHub, Eric-Terminal 220 ★GPL-3.0Updated yesterday

    git clone https://github.com/Eric-Terminal/ETOS-LLM-Studio.git
  19. inference

    AI repositories

    Open-source inference platform for language, vision, embedding, reranking, image, audio, and video models. Deploy with multiple engines across heterogeneous hardware, from a laptop to a distributed cluster. Serve models through OpenAI-compatible APIs.

    Indexed GitHub, xorbitsai 9,660 ★Apache-2.0Updated today

    git clone https://github.com/xorbitsai/inference.git
  20. Llamatik

    AI repositories

    True on-device AI SDK for Kotlin Multiplatform (Android, iOS, Desktop, JVM, WASM). LLM inference, Speech-to-Text, Image Generation, Agent Framework and RAG — powered by llama.cpp, whisper.cpp and stable-diffusion.cpp.

    Indexed GitHub, llamatik 220 ★Custom licence (see repository)Updated 3 days ago

    git clone https://github.com/llamatik/Llamatik.git
  21. jev

    AI repositories

    jevos: an open-source alternative to Jev and Microsoft-Decision-1. Yes/no decisions, choices and scores with probabilities, on your laptop's CPU.

    Stale GitHub, feder-cr 1,342 ★MITUpdated 31 days ago

    git clone https://github.com/feder-cr/jev.git
  22. janas

    AI repositories

    37 tok/s from Qwen3-Next-80B (48 GB) on a 32 GB laptop, 24 without drafts vs 2.8 for llama.cpp; reading 62 vs 16 tok/s. Faster than llama.cpp on all 13 models compared in Q4_K_M. LLMs bigger than your RAM, pure C, CPU or GPU.

    Indexed GitHub, prabanta-dev 717 ★GPL-3.0Updated today

    git clone https://github.com/prabanta-dev/janas.git
  23. ClawMem

    AI repositories

    On-device memory layer for AI agents. Claude Code, OpenClaw and Hermes. Hooks + MCP server + hybrid RAG search.

    Stale GitHub, yoloshii 212 ★MITUpdated 9 days ago

    git clone https://github.com/yoloshii/ClawMem.git
  24. graphrag-rs

    AI repositories

    GraphRAG-rs is a high-performance, state-of-the-art Rust implementation of GraphRAG (Graph-based Retrieval Augmented Generation) that builds knowledge graphs from documents and enables natural language querying with configurable entity extraction and local LLM integration

    Indexed GitHub, automataIA 539 ★MITUpdated today

    git clone https://github.com/automataIA/graphrag-rs.git

Indexed entries aren't reviewed or tested by InnerVault. Details come straight from each source. Anything that can reach your accounts, files or browser can do damage, so read the source before you install it.