InnerVault

Library

85,340 resources from 11 public sources. 54 checked by hand; the rest are unreviewed.

Results

  1. text generation model by qvac · gguf

    Indexed Hugging Face Hub, qvac 22 ♥apache-2.0Updated 5 days ago

    qvac/BotPsy-0.8B-GGUFs
  2. image text to text model by Mia-AiLab · exllamav3

    Stale Hugging Face Hub, Mia-AiLab 33 ♥mitUpdated 27 days ago

    Mia-AiLab/DeepSeek-V4.1-Flash-1017-EXL3-EAQ-v1-2.9-bpw
  3. text generation model by nota-ai · mlx

    Stale Hugging Face Hub, nota-ai 32 ♥openmdw-1.1Updated 34 days ago

    nota-ai/Nemotron-3.5-Lightning-30B-A3B-Nota-Ternary-MLX-1014
  4. text generation model by abenzerps · gguf

    Stale Hugging Face Hub, abenzerps 23 ♥apache-2.0Updated 22 days ago

    abenzerps/Spark-X2.6-4B-Uncensored-GSQ-RCO-GGUF
  5. image text to text model by SC117 · gguf

    Stale Hugging Face Hub, SC117 150 ♥otherUpdated 23 days ago

    SC117/Swift-1.5-Qwen3.8-Flash-Next-GSQ-RCO-abliterated-GGUF
  6. modern-llm-notebook

    Docs & tutorials

    A hands-on course on modern LLM architectures, training, and inference, with step-by-step PyTorch implementations and runnable notebooks.

    Stale GitHub, walkinglabs 252 ★Custom licence (see repository)Updated 46 days ago

    git clone https://github.com/walkinglabs/modern-llm-notebook.git
  7. image text to text model by nvidia · Model Optimizer

    Indexed Hugging Face Hub, nvidia 24 ♥otherUpdated 4 days ago

    nvidia/Kimi-K3.1-Pro-NVFP4
  8. image text to video model by BennyDaBall · minimax-h3

    Indexed Hugging Face Hub, BennyDaBall 35 ♥otherUpdated yesterday

    BennyDaBall/HyperFlow-H3-Flash-INT8-ComfyUI
  9. project-maya

    AI repositories

    Project Maya - run GLM-5.3-Flash (321B MoE), DeepSeek-V4.1-Flash-1017 (748B MoE) and MiniMax-M3.1-Flash (428B MoE) privately on your own GPU(s), from one card to 16, NVIDIA or AMD, Linux or Windows. Engine, server, dashboard, OpenAI- and Anthropic-compatible API, quant tools.

    Stale GitHub, mw00 2,482 ★MITUpdated 12 days ago

    git clone https://github.com/mw00/project-maya.git
  10. llama-modchip

    Agents & frameworks

    Run 284B DeepSeek-V4-Flash (<59GiB RAM: 41.1 cold pp, 9.1 N=1 tg, up to 25.3 spec tok/s) & 30B MoEs (22.4 N=1 / 111.6 spec tok/s) on 64GB CPU (0 GPUs).

    Indexed GitHub, synchopate 1,137 ★Apache-2.0Updated 3 days ago

    git clone https://github.com/synchopate/llama-modchip.git
  11. image text to text model by nerkyor · ninfer

    Stale Hugging Face Hub, nerkyor 52 ♥apache-2.0Updated 29 days ago

    nerkyor/Qwen3.8-27B-Coder390-EfficientThink-Opus5.5-GPT6Astra-Grok4.7-DSV4Pro-K3-SFT-RLOO-GGUF-NInfer
  12. image text to text model by Cactus-Compute · mlx

    Indexed Hugging Face Hub, Cactus-Compute 22 ♥otherUpdated 4 days ago 1 note

    Cactus-Compute/nemotron-3.5-120b-cq
  13. image text to text model by DavidAU

    Indexed Hugging Face Hub, DavidAU 194 ♥apache-2.0Updated 7 days ago

    DavidAU/Qwen3.8-Flash-Next-Abliterated-Uncensored-Turbo-Brilliance-50x-Reasoning-Instruct-GSQ-RCO-GGUF
  14. janas

    AI repositories

    37 tok/s from Qwen3-Next-80B (48 GB) on a 32 GB laptop, 24 without drafts vs 2.8 for llama.cpp; reading 62 vs 16 tok/s. Faster than llama.cpp on all 13 models compared in Q4_K_M. LLMs bigger than your RAM, pure C, CPU or GPU.

    Indexed GitHub, prabanta-dev 717 ★GPL-3.0Updated today

    git clone https://github.com/prabanta-dev/janas.git
  15. ARIS-in-AI-Offer

    AI repositories

    Bilingual (中文+EN) ML / LLM / diffusion / agent interview cheat sheets for AI 秋招 — generated by ARIS /interview-cheatsheet, rendered by /render-html into single-file HTML, reads anywhere — plus a CV→DBLP-fact-checked academic homepage generator and hand-authored long-form blogs 🌱

    Stale GitHub, wanshuiyin 640 ★MITUpdated 10 days ago

    git clone https://github.com/wanshuiyin/ARIS-in-AI-Offer.git
  16. deepseek-local-guide-ru

    Docs & tutorials

    🐋 Полный гайд на русском: как установить и запустить DeepSeek локально (V4, R1) на ПК, Mac и сервере — Ollama, llama.cpp, LM Studio, vLLM, Open WebUI, API, RAG, агенты, fine-tuning, лучшие фишки

    Stale GitHub, justxor 115 ★Custom licence (see repository)Updated 30 days ago

    git clone https://github.com/justxor/deepseek-local-guide-ru.git
  17. taOS

    Agents & frameworks

    Self-hosted AI agent OS. Your memory, chat, agents, and files stay on hardware you own, offline by default, cloud by choice. Offline AI memory (taOSmd), self-hosted multi-framework group chat, a full web desktop + app store, and auto-clustering across the consumer hardware you already have (Orange/Raspberry Pi, Mac mini, gaming PC).

    Indexed GitHub, jaylfc 608 ★AGPL-3.0Updated yesterday

    git clone https://github.com/jaylfc/taOS.git
  18. image text to text model by DavidAU

    Stale Hugging Face Hub, DavidAU 31 ♥apache-2.0Updated 26 days ago

    DavidAU/Qwen3.8-Flash-Next-Turbo-Brilliance-50x-Reasoning-Instruct-GSQ-RCO-GGUF
  19. gguf-mcp

    MCP servers

    Inspect local GGUF/safetensors models: quantization, params, VRAM fit — headers only.

    Stale Official MCP Registry, io.github.arose26 Updated 3 months ago 1 note

    gguf-mcp@0.1.1
  20. BigMoeOnEdge

    AI repositories

    Run MoE models bigger than your RAM. Frontier-size MoE on a phone, laptop, edge. Lossless, on stock llama.cpp. An adaptive streaming optimizer. Any hardware, any OS, any model, any quantization, behind a local OpenAI-compatible server.

    Indexed GitHub, Helldez 924 ★Apache-2.0Updated today

    git clone https://github.com/Helldez/BigMoeOnEdge.git
  21. agent-mosaic-skill

    MCP servers

    Convert photos to LEGO-style brick mosaic previews with AI-powered color quantization.

    Stale Official MCP Registry, io.github.Able-rip Updated 6 months ago 1 note

    @bmbrick/agent-mosaic-skill@1.0.2
  22. imp

    Agents & frameworks

    Run large AI chat models privately on your own NVIDIA RTX 50 or RTX PRO graphics card. On one RTX 5090, Qwen3.8-27B writes about 70 words per second, 1.4x faster than vLLM. Even a model almost four times larger than the card's memory runs. Works with apps made for ChatGPT or Claude. Starts with one docker command.

    Stale GitHub, kekzl 124 ★MITUpdated 12 days ago

    git clone https://github.com/kekzl/imp.git
  23. z-image-studio

    MCP servers

    A Cli, a webUI, and a MCP server for the Z-Image-Turbo text-to-image generation model (Tongyi-MAI/Z-Image-Turbo base model as well as quantized models)

    Stale GitHub, iconben 128 ★Apache-2.0Updated 25 days ago

    git clone https://github.com/iconben/z-image-studio.git
  24. apple-silicon-llm-bench

    Datasets & benchmarks

    Reproducible on-device LLM benchmarks for Apple Silicon (iPhone 17 Pro, M4 Max): Apple Core AI, MLX, llama.cpp, LiteRT-LM and Core ML on the same model and harness, every number with its quantization and capture session; hybrid Mamba-2 models (Nemotron-3 Nano, Granite-4.0-H, Falcon-H1) included.

    Indexed GitHub, john-rocky 73 ★MITUpdated today

    git clone https://github.com/john-rocky/apple-silicon-llm-bench.git

Indexed entries aren't reviewed or tested by InnerVault. Details come straight from each source. Anything that can reach your accounts, files or browser can do damage, so read the source before you install it.