InnerVault

Library

86,689 resources from 11 public sources. 54 checked by hand; the rest are unreviewed.

Results

425 results with any of your words Clear search and filters
  1. llama-modchip

    Agents & frameworks

    Run 284B DeepSeek-V4-Flash (<59GiB RAM: 41.1 cold pp, 9.1 N=1 tg, up to 25.3 spec tok/s) & 30B MoEs (22.4 N=1 / 111.6 spec tok/s) on 64GB CPU (0 GPUs).

    Stale GitHub, synchopate 1,137 ★Apache-2.0Updated 5 days ago

    git clone https://github.com/synchopate/llama-modchip.git
  2. image text to text model by JonathanColetti · transformers

    Stale Hugging Face Hub, JonathanColetti 25 ♥apache-2.0Updated 11 days ago

    JonathanColetti/Qwen3.5-0.8B-Astra-WeightEdit
  3. Alpie_seed

    Models

    image text to text model by 169Pi · transformers

    Stale Hugging Face Hub, 169Pi 27 ♥apache-2.0Updated 6 days ago

    169Pi/Alpie_seed
  4. image text to text model by saidutta69 · transformers

    Stale Hugging Face Hub, saidutta69 30 ♥apache-2.0Updated 34 days ago

    saidutta69/MiniCPM-V-4.7-1B-heretic
  5. image text to text model by saidutta69 · transformers

    Stale Hugging Face Hub, saidutta69 25 ♥apache-2.0Updated 12 days ago

    saidutta69/Qwen3.5-4B-heretic
  6. janas

    AI repositories

    37 tok/s from Qwen3-Next-80B (48 GB) on a 32 GB laptop, 24 without drafts vs 2.8 for llama.cpp; reading 62 vs 16 tok/s. Faster than llama.cpp on all 13 models compared in Q4_K_M. LLMs bigger than your RAM, pure C, CPU or GPU.

    Indexed GitHub, prabanta-dev 717 ★GPL-3.0Updated 2 days ago

    git clone https://github.com/prabanta-dev/janas.git
  7. PolyStrata

    AI repositories

    Run large AI models on your own PC: Qwen3.8-Flash-Next on Strata's engine, and GLM 5.3 Flash, DeepSeek V4 Flash, LFM2.5, Qwen3.6, Ornith 1.5, Gemma 4, Tiel Coder and MiniCPM-V on a second engine written for PolyStrata. One-click install for Windows and Linux, OpenAI/Anthropic API on localhost.

    Stale GitHub, VecSzn 722 ★MITUpdated 18 days ago

    git clone https://github.com/VecSzn/PolyStrata.git
  8. vmlx

    MCP servers

    vMLX - Use MLX models easily - JANGQ (GGUF for MLX) - Not dependant on mlx_vlm

    Stale GitHub, jjang-ai 906 ★Apache-2.0Updated 16 days ago

    git clone https://github.com/jjang-ai/vmlx.git
  9. Velocity Local Services: an app for running LLMs locally on Windows and Linux. Load any GGUF model and chat with web search, tools and schematics, let it use your computer by voice, and serve it to opencode, Hermes or any app through an OpenAI-compatible API and MCP. Context up to 32M tokens. No cloud.

    Stale GitHub, Veloresearch 34 ★Custom licence (see repository)Updated 29 days ago

    git clone https://github.com/Veloresearch/velocity-local-services.git
  10. deepseek-local-guide-ru

    Docs & tutorials

    🐋 Полный гайд на русском: как установить и запустить DeepSeek локально (V4, R1) на ПК, Mac и сервере — Ollama, llama.cpp, LM Studio, vLLM, Open WebUI, API, RAG, агенты, fine-tuning, лучшие фишки

    Stale GitHub, justxor 115 ★Custom licence (see repository)Updated 32 days ago

    git clone https://github.com/justxor/deepseek-local-guide-ru.git
  11. lilbee

    MCP servers

    A local model engine with a search engine and web crawler built in. Run your coding agents on your own GPUs, and get cited answers from your files, code, and the sites you crawl. One executable.

    Stale GitHub, tobocop2 70 ★MITUpdated 6 days ago

    git clone https://github.com/tobocop2/lilbee.git
  12. LumaBrowser

    MCP servers

    Local AI desktop app: a Chromium browser with a GPU-aware llama.cpp runtime, OpenAI-compatible API, AI chat and agents, Stable Diffusion image/video, TTS and music, plus an MCP server so Claude Code, Codex and Cline can drive your browser. Windows, macOS, Linux.

    Indexed GitHub, amurgola 144 ★Custom licence (see repository)Updated 3 days ago

    git clone https://github.com/amurgola/LumaBrowser.git
  13. model-scanner

    MCP servers

    Scans ML model files (PyTorch, joblib, NumPy, GGUF, TensorFlow…) and HF repos for supply-chain risks

    Stale Official MCP Registry, io.github.GuardBee Updated 19 days ago 1 note

    @guardbee/mcp-model-scanner@0.4.0
  14. hayward

    MCP servers

    Checks ML model files (pickle, PyTorch, joblib, NumPy, GGUF, ONNX) for code that runs on load.

    Stale Official MCP Registry, io.github.hedgerow-dev Updated 26 days ago 1 note

    hayward@1.4.1
  15. vetted-consumer

    MCP servers

    Will a local LLM run on your hardware? GGUF quant, buy-vs-rent-vs-API cost, used-GPU prices.

    Stale Official MCP Registry, io.github.TheBaronofAI Updated 4 months ago 1 note

  16. MCP server to fine-tune LoRA, export GGUF, and deploy local LLMs on Onde Inference.

    Indexed Official MCP Registry, io.github.ondeinference Updated yesterday 1 note

    @ondeinference/cli@0.6.1
  17. Lynn

    Agents & frameworks

    开源桌面 AI Agent 与 CLI:长期记忆、多 Agent、实时语音;Qwen3.8-27B Coder390 EfficientThink 本地 GGUF(llama.cpp Q2/Q3,内置 Q4 MTP)· Open-source desktop AI agent & CLI with Coder390 local models

    Stale GitHub, MerkyorLynn 71 ★Apache-2.0Updated 6 days ago

    git clone https://github.com/MerkyorLynn/Lynn.git

Indexed entries aren't reviewed or tested by InnerVault. Details come straight from each source. Anything that can reach your accounts, files or browser can do damage, so read the source before you install it.