InnerVault

Library

85,337 resources from 11 public sources. 54 checked by hand; the rest are unreviewed.

Results

  1. llama.cpp

    Models

    The C/C++ engine many local-model tools are built on. It runs models efficiently on ordinary hardware.

    Hand-checked InnerVault (hand-checked), ggml-org MIT

  2. whisper.cpp

    Models

    automatic speech recognition model by ggerganov

    Indexed Hugging Face Hub, ggerganov 1,702 ♥mitUpdated 2 years ago

    ggerganov/whisper.cpp
  3. text generation model by prism-ml · llama.cpp

    Indexed Hugging Face Hub, prism-ml 3,025 ♥apache-2.0Updated 12 days ago

    prism-ml/Ternary-Bonsai-2-27B-gguf
  4. text generation model by prism-ml · llama.cpp

    Indexed Hugging Face Hub, prism-ml 1,448 ♥apache-2.0Updated 2 months ago

    prism-ml/Ternary-Bonsai-27B-gguf
  5. rea

    Skills

    Reverse engineer anything with agents, from app behavior down to native binaries.

    Indexed GitHub, morluto 462.5k ★MITUpdated today

    git clone https://github.com/morluto/rea.git
  6. text to speech model by audio-cpp · audio.cpp

    Stale Hugging Face Hub, audio-cpp 306 ♥otherUpdated 10 days ago

    audio-cpp/audio.cpp-gguf
  7. text generation model by prism-ml · llama.cpp

    Stale Hugging Face Hub, prism-ml 920 ♥apache-2.0Updated 4 months ago

    prism-ml/Bonsai-27B-gguf
  8. text generation model by prism-ml · llama.cpp

    Stale Hugging Face Hub, prism-ml 796 ♥apache-2.0Updated 7 months ago

    prism-ml/Bonsai-8B-gguf
  9. text generation model by JonathanColetti · llama.cpp

    Indexed Hugging Face Hub, JonathanColetti 2,010 ♥apache-2.0Updated 2 months ago

    JonathanColetti/Qwen3.8-27B-Uncensored-GGUF
  10. chatllm.cpp

    AI repositories

    Pure C++ implementation of several models for real-time chatting on your computer (CPU & GPU)

    Stale GitHub, foldl 932 ★MITUpdated 29 days ago

    git clone https://github.com/foldl/chatllm.cpp.git
  11. llama.rn

    AI repositories

    React Native binding of llama.cpp

    Stale GitHub, mybigday 1,073 ★MITUpdated 4 days ago

    git clone https://github.com/mybigday/llama.rn.git
  12. image text to text model by prism-ml · llama.cpp

    Indexed Hugging Face Hub, prism-ml 181 ♥apache-2.0Updated 12 days ago

    prism-ml/Ternary-Bonsai-2-9B-gguf
  13. infinity

    AI repositories

    The AI-native database built for LLM applications, providing incredibly fast hybrid search of dense vector, sparse vector, tensor (multi-vector), and full-text.

    Indexed GitHub, infiniflow 4,766 ★Apache-2.0Updated today

    git clone https://github.com/infiniflow/infinity.git
  14. text generation model by yuxinlu1 · gguf

    Indexed Hugging Face Hub, yuxinlu1 3,013 ♥apache-2.0Updated 5 months ago

    yuxinlu1/gemma-4-12B-coder-fable5-composer2.5-v1-GGUF
  15. BigMoeOnEdge

    AI repositories

    Run MoE models bigger than your RAM. Frontier-size MoE on a phone, laptop, edge. Lossless, on stock llama.cpp. An adaptive streaming optimizer. Any hardware, any OS, any model, any quantization, behind a local OpenAI-compatible server.

    Indexed GitHub, Helldez 924 ★Apache-2.0Updated today

    git clone https://github.com/Helldez/BigMoeOnEdge.git
  16. PS5LM

    AI repositories

    llama.cpp on a jailbroken PS5: run any GGUF model natively on the console, starting with Qwen 3.8

    Stale GitHub, cobanov 673 ★GPL-3.0Updated 24 days ago

    git clone https://github.com/cobanov/PS5LM.git
  17. model by froggeric · mlx

    Indexed Hugging Face Hub, froggeric 1,908 ♥apache-2.0Updated 2 months ago

    froggeric/Qwen-Fixed-Chat-Templates
  18. inferssd

    AI repositories

    Run models larger than your RAM or VRAM by streaming MoE experts from SSD. Built on llama.cpp.

    Indexed GitHub, wici-ai 1,025 ★Apache-2.0Updated 3 days ago

    git clone https://github.com/wici-ai/inferssd.git
  19. text generation model by orcarouter · llama.cpp

    Indexed Hugging Face Hub, orcarouter 629 ♥apache-2.0Updated 5 days ago 1 note

    orcarouter/OrcaSAQ-2-Cyber-27B-Uncensored-GGUF
  20. atomic-agent

    AI repositories

    Atomic Agent is a local-first AI agent. Runs open-weight models on your own machine via llama.cpp.

    Stale GitHub, AtomicBot-ai 3,460 ★MITUpdated 19 days ago

    git clone https://github.com/AtomicBot-ai/atomic-agent.git
  21. model by Tesslate

    Stale Hugging Face Hub, Tesslate 350 ♥apache-2.0Updated 8 months ago

    Tesslate/OmniCoder-9B-GGUF
  22. image text to text model by openbmb · llama.cpp

    Stale Hugging Face Hub, openbmb 455 ♥apache-2.0Updated 21 days ago

    openbmb/MiniCPM-V-4.7-35B-A3B-gguf
  23. llama-cpp-agent

    Agents & frameworks

    The llama-cpp-agent framework is a tool designed for easy interaction with Large Language Models (LLMs). Allowing users to chat with LLM models, execute structured function calls and get structured output. Works also with models not fine-tuned to JSON output and function calls.

    Stale GitHub, Maximilian-Winter 659 ★Custom licence (see repository)Updated 8 months ago

    git clone https://github.com/Maximilian-Winter/llama-cpp-agent.git
  24. text generation model by Scantist

    Indexed Hugging Face Hub, Scantist 1,420 ♥otherUpdated 13 days ago

    Scantist/GLM-5.3-SLIM-GGUF

Indexed entries aren't reviewed or tested by InnerVault. Details come straight from each source. Anything that can reach your accounts, files or browser can do damage, so read the source before you install it.