Library
85,340 resources from 11 public sources. 54 checked by hand; the rest are unreviewed.
Results
-
llama.cpp
ModelsThe C/C++ engine many local-model tools are built on. It runs models efficiently on ordinary hardware.
-
Ternary-Bonsai-2-27B-gguf
Modelstext generation model by prism-ml · llama.cpp
prism-ml/Ternary-Bonsai-2-27B-gguf -
Ternary-Bonsai-27B-gguf
Modelstext generation model by prism-ml · llama.cpp
prism-ml/Ternary-Bonsai-27B-gguf -
Bonsai-27B-gguf
Modelstext generation model by prism-ml · llama.cpp
prism-ml/Bonsai-27B-gguf -
Bonsai-8B-gguf
Modelstext generation model by prism-ml · llama.cpp
prism-ml/Bonsai-8B-gguf -
Qwen3.8-27B-Uncensored-GGUF
Modelstext generation model by JonathanColetti · llama.cpp
JonathanColetti/Qwen3.8-27B-Uncensored-GGUF -
llama.rn
AI repositoriesReact Native binding of llama.cpp
git clone https://github.com/mybigday/llama.rn.git -
Ternary-Bonsai-2-9B-gguf
Modelsimage text to text model by prism-ml · llama.cpp
prism-ml/Ternary-Bonsai-2-9B-gguf -
text generation model by yuxinlu1 · gguf
yuxinlu1/gemma-4-12B-coder-fable5-composer2.5-v1-GGUF -
PS5LM
AI repositoriesllama.cpp on a jailbroken PS5: run any GGUF model natively on the console, starting with Qwen 3.8
git clone https://github.com/cobanov/PS5LM.git -
inferssd
AI repositoriesRun models larger than your RAM or VRAM by streaming MoE experts from SSD. Built on llama.cpp.
git clone https://github.com/wici-ai/inferssd.git -
Qwen-Fixed-Chat-Templates
Modelsmodel by froggeric · mlx
froggeric/Qwen-Fixed-Chat-Templates -
text generation model by orcarouter · llama.cpp
orcarouter/OrcaSAQ-2-Cyber-27B-Uncensored-GGUF -
OmniCoder-9B-GGUF
Modelsmodel by Tesslate
Tesslate/OmniCoder-9B-GGUF -
atomic-agent
AI repositoriesAtomic Agent is a local-first AI agent. Runs open-weight models on your own machine via llama.cpp.
git clone https://github.com/AtomicBot-ai/atomic-agent.git -
MiniCPM-V-4.7-35B-A3B-gguf
Modelsimage text to text model by openbmb · llama.cpp
openbmb/MiniCPM-V-4.7-35B-A3B-gguf -
llama-cpp-agent
Agents & frameworksThe llama-cpp-agent framework is a tool designed for easy interaction with Large Language Models (LLMs). Allowing users to chat with LLM models, execute structured function calls and get structured output. Works also with models not fine-tuned to JSON output and function calls.
git clone https://github.com/Maximilian-Winter/llama-cpp-agent.git -
GLM-5.3-SLIM-GGUF
Modelstext generation model by Scantist
Scantist/GLM-5.3-SLIM-GGUF -
humanizer
Modelstext generation model by jialinyyzz · gguf
jialinyyzz/humanizer -
LLamaSharp
AI repositoriesA C#/.NET library to run LLM (🦙LLaMA/LLaVA) on your local device efficiently.
git clone https://github.com/SciSharp/LLamaSharp.git -
text generation model by OS-Software · llama.cpp
OS-Software/Ternary-Bonsai-2-27B-Uncensored-Heretic-GGUF -
text generation model by Jiunsong
Jiunsong/supergemma4-26b-uncensored-gguf-v2 -
text generation model by yuxinlu1 · gguf
yuxinlu1/gemma-4-12B-agentic-fable5-composer2.5-v2-3.5x-tau2-GGUF -
Ternary-Bonsai-2-2B-gguf
Modelsimage text to text model by prism-ml · llama.cpp
prism-ml/Ternary-Bonsai-2-2B-gguf
Indexed entries aren't reviewed or tested by InnerVault. Details come straight from each source. Anything that can reach your accounts, files or browser can do damage, so read the source before you install it.