Library
85,340 resources from 11 public sources. 54 checked by hand; the rest are unreviewed.
Results
-
humanizer
Modelstext generation model by jialinyyzz · gguf
jialinyyzz/humanizer -
runanywhere-sdks
AI repositoriesProduction ready toolkit to run AI locally
git clone https://github.com/RunanywhereAI/runanywhere-sdks.git -
LLamaSharp
AI repositoriesA C#/.NET library to run LLM (🦙LLaMA/LLaVA) on your local device efficiently.
git clone https://github.com/SciSharp/LLamaSharp.git -
text generation model by OS-Software · llama.cpp
OS-Software/Ternary-Bonsai-2-27B-Uncensored-Heretic-GGUF -
text generation model by Jiunsong
Jiunsong/supergemma4-26b-uncensored-gguf-v2 -
text generation model by yuxinlu1 · gguf
yuxinlu1/gemma-4-12B-agentic-fable5-composer2.5-v2-3.5x-tau2-GGUF -
Llamatik
AI repositoriesTrue on-device AI SDK for Kotlin Multiplatform (Android, iOS, Desktop, JVM, WASM). LLM inference, Speech-to-Text, Image Generation, Agent Framework and RAG — powered by llama.cpp, whisper.cpp and stable-diffusion.cpp.
git clone https://github.com/llamatik/Llamatik.git -
LLMUnity
AI repositoriesCreate characters in Unity with LLMs!
git clone https://github.com/undreamai/LLMUnity.git -
Ternary-Bonsai-2-2B-gguf
Modelsimage text to text model by prism-ml · llama.cpp
prism-ml/Ternary-Bonsai-2-2B-gguf -
Dot
AI repositoriesText-To-Speech, RAG, and LLMs. All local!
git clone https://github.com/alexpinel/Dot.git -
Underdog-Saluki-27B-1.0
Modelstext generation model by ConwayResearch · gguf
ConwayResearch/Underdog-Saluki-27B-1.0 -
model by TeichAI
TeichAI/GLM-4.7-Flash-Claude-Opus-4.5-High-Reasoning-Distill-GGUF -
llmman
AI repositoriesRun any agent on any model, models stored as OCI images
git clone https://github.com/llmmanorg/llmman.git -
Ternary-Bonsai-2-4B-gguf
Modelsimage text to text model by prism-ml · llama.cpp
prism-ml/Ternary-Bonsai-2-4B-gguf -
forge
AI repositoriesA Python framework for self-hosted LLM tool-calling and multi-step agentic workflows
git clone https://github.com/antoinezambelli/forge.git -
image text to text model by empero-ai · gguf
empero-ai/Qwythos-9B-Claude-Mythos-5-1M-GGUF -
Mistral-Large-4-1T-A52B
Modelsimage text to text model by mistralai · transformers
mistralai/Mistral-Large-4-1T-A52B -
text generation model by AlicanKiraz0 · transformers
AlicanKiraz0/Cybersecurity-BaronLLM_Offensive_Security_LLM_Q6_K_GGUF -
ai-agents-from-scratch
Agents & frameworksDemystify AI agents by building them yourself. Local LLMs, no black boxes, real understanding of function calling, memory, and ReAct patterns.
git clone https://github.com/pguso/ai-agents-from-scratch.git -
MiniCPM-V-4.7-1B-gguf
Modelsimage text to text model by openbmb · llama.cpp
openbmb/MiniCPM-V-4.7-1B-gguf -
llama-gpt
AI repositoriesA self-hosted, offline, ChatGPT-like chatbot. Powered by Llama 2. 100% private, with no data leaving your device. New: Code Llama support!
git clone https://github.com/getumbrel/llama-gpt.git -
image text to text model by huihui-ai · transformers
huihui-ai/Huihui-Qwen3.8-27B-abliterated-GGUF -
text to image model by AtomicChat · gguf
AtomicChat/Qwen-Image-2.1-Turbo-Uncensored-GGUF -
Clover-35B-A3B-Preview-GGUF
Modelstext generation model by Diffuspace · llama.cpp
Diffuspace/Clover-35B-A3B-Preview-GGUF
Indexed entries aren't reviewed or tested by InnerVault. Details come straight from each source. Anything that can reach your accounts, files or browser can do damage, so read the source before you install it.