Library
85,340 resources from 11 public sources. 54 checked by hand; the rest are unreviewed.
Results
-
llama.cpp
ModelsThe C/C++ engine many local-model tools are built on. It runs models efficiently on ordinary hardware.
-
whisper.cpp
Modelsautomatic speech recognition model by ggerganov
ggerganov/whisper.cpp -
Ternary-Bonsai-2-27B-gguf
Modelstext generation model by prism-ml · llama.cpp
prism-ml/Ternary-Bonsai-2-27B-gguf -
Ternary-Bonsai-27B-gguf
Modelstext generation model by prism-ml · llama.cpp
prism-ml/Ternary-Bonsai-27B-gguf -
rea
SkillsReverse engineer anything with agents, from app behavior down to native binaries.
git clone https://github.com/morluto/rea.git -
audio.cpp-gguf
Modelstext to speech model by audio-cpp · audio.cpp
audio-cpp/audio.cpp-gguf -
Bonsai-27B-gguf
Modelstext generation model by prism-ml · llama.cpp
prism-ml/Bonsai-27B-gguf -
Bonsai-8B-gguf
Modelstext generation model by prism-ml · llama.cpp
prism-ml/Bonsai-8B-gguf -
Qwen3.8-27B-Uncensored-GGUF
Modelstext generation model by JonathanColetti · llama.cpp
JonathanColetti/Qwen3.8-27B-Uncensored-GGUF -
chatllm.cpp
AI repositoriesPure C++ implementation of several models for real-time chatting on your computer (CPU & GPU)
git clone https://github.com/foldl/chatllm.cpp.git -
llama.rn
AI repositoriesReact Native binding of llama.cpp
git clone https://github.com/mybigday/llama.rn.git -
Ternary-Bonsai-2-9B-gguf
Modelsimage text to text model by prism-ml · llama.cpp
prism-ml/Ternary-Bonsai-2-9B-gguf -
infinity
AI repositoriesThe AI-native database built for LLM applications, providing incredibly fast hybrid search of dense vector, sparse vector, tensor (multi-vector), and full-text.
git clone https://github.com/infiniflow/infinity.git -
text generation model by yuxinlu1 · gguf
yuxinlu1/gemma-4-12B-coder-fable5-composer2.5-v1-GGUF -
BigMoeOnEdge
AI repositoriesRun MoE models bigger than your RAM. Frontier-size MoE on a phone, laptop, edge. Lossless, on stock llama.cpp. An adaptive streaming optimizer. Any hardware, any OS, any model, any quantization, behind a local OpenAI-compatible server.
git clone https://github.com/Helldez/BigMoeOnEdge.git -
PS5LM
AI repositoriesllama.cpp on a jailbroken PS5: run any GGUF model natively on the console, starting with Qwen 3.8
git clone https://github.com/cobanov/PS5LM.git -
Qwen-Fixed-Chat-Templates
Modelsmodel by froggeric · mlx
froggeric/Qwen-Fixed-Chat-Templates -
inferssd
AI repositoriesRun models larger than your RAM or VRAM by streaming MoE experts from SSD. Built on llama.cpp.
git clone https://github.com/wici-ai/inferssd.git -
text generation model by orcarouter · llama.cpp
orcarouter/OrcaSAQ-2-Cyber-27B-Uncensored-GGUF -
atomic-agent
AI repositoriesAtomic Agent is a local-first AI agent. Runs open-weight models on your own machine via llama.cpp.
git clone https://github.com/AtomicBot-ai/atomic-agent.git -
OmniCoder-9B-GGUF
Modelsmodel by Tesslate
Tesslate/OmniCoder-9B-GGUF -
MiniCPM-V-4.7-35B-A3B-gguf
Modelsimage text to text model by openbmb · llama.cpp
openbmb/MiniCPM-V-4.7-35B-A3B-gguf -
llama-cpp-agent
Agents & frameworksThe llama-cpp-agent framework is a tool designed for easy interaction with Large Language Models (LLMs). Allowing users to chat with LLM models, execute structured function calls and get structured output. Works also with models not fine-tuned to JSON output and function calls.
git clone https://github.com/Maximilian-Winter/llama-cpp-agent.git -
GLM-5.3-SLIM-GGUF
Modelstext generation model by Scantist
Scantist/GLM-5.3-SLIM-GGUF
Indexed entries aren't reviewed or tested by InnerVault. Details come straight from each source. Anything that can reach your accounts, files or browser can do damage, so read the source before you install it.