InnerVault

Library

85,340 resources from 11 public sources. 54 checked by hand; the rest are unreviewed.

Results

  1. llama.cpp

    Models

    The C/C++ engine many local-model tools are built on. It runs models efficiently on ordinary hardware.

    Hand-checked InnerVault (hand-checked), ggml-org MIT

  2. PowerInfer

    AI repositories

    High-speed Large Language Model Serving for Local Deployment

    Stale GitHub, Tiiny-AI 9,828 ★MITUpdated 6 months ago

    git clone https://github.com/Tiiny-AI/PowerInfer.git
  3. text to speech model by owensong

    Indexed Hugging Face Hub, owensong 39 ♥apache-2.0Updated 4 days ago

    owensong/Inflect-Mini-v3
  4. text classification model by Phocinae

    Stale Hugging Face Hub, Phocinae 235 ♥apache-2.0Updated 32 days ago

    Phocinae/Phocinae-Largha-150M-v1
  5. mojo-dllm

    AI repositories

    Local inference for diffusion language models (LLaDA, Dream), written in Mojo

    Stale GitHub, vladimirrott 506 ★Apache-2.0Updated 6 days ago

    git clone https://github.com/vladimirrott/mojo-dllm.git
  6. text generation model by StarpowerTechnology · pytorch

    Indexed Hugging Face Hub, StarpowerTechnology 43 ♥Updated 4 days ago

    StarpowerTechnology/WVY-Blender-5m
  7. Klee

    AI repositories

    A native macOS AI chat app powered by MLX. 100% local inference on Apple Silicon, no cloud required. Built with ShipSwift.

    Indexed GitHub, signerlabs 1,773 ★Updated 2 days ago

    git clone https://github.com/signerlabs/Klee.git
  8. image text to text model by Jackrong · transformers

    Stale Hugging Face Hub, Jackrong 24 ♥apache-2.0Updated 34 days ago

    Jackrong/Qwopus3-5-9B-Coder-Flash-GGUF
  9. ollaya

    MCP servers

    Jev-compatible API server for open decision models. Ollama for decision models: pull and serve 29 model families (Laya, pplx-decider, Clef, Winnow, coba...) locally or self-hosted behind /v1/systemone. The TypeSafe SDK works unchanged: set its base URL and pick an open model. CLI, desktop app, Docker, MCP server, public bench.

    Stale GitHub, ollaya-dev 1,436 ★Apache-2.0Updated 10 days ago

    git clone https://github.com/ollaya-dev/ollaya.git
  10. yzma

    AI repositories

    Go with your own intelligence - Write Go applications that directly integrate llama.cpp for local inference using hardware acceleration on Linux, macOS, Windows, & WebAssembly.

    Stale GitHub, hybridgroup 652 ★Custom licence (see repository)Updated 32 days ago

    git clone https://github.com/hybridgroup/yzma.git
  11. offline-mcp

    MCP servers

    Local AI over Ollama for low connectivity: status, local inference, model and deployment guides.

    Stale Official MCP Registry, io.github.gabrielmahia Updated 6 days ago 1 note

    offline-mcp@0.1.13
  12. localharness

    Agents & frameworks

    An open-source, coding agent harness designed specifically for local LLMs. Designed as everything a user needs to jumpstart their own harness (detailed event steams, logs, and performance data) or quickly replace closed source one (featuring out of the box plugins for web search, image gen, memory, auto research and more in dev).

    Stale GitHub, ahwurm 59 ★MITUpdated 12 days ago

    git clone https://github.com/ahwurm/localharness.git
  13. halogen-flash-server

    AI repositories

    Local inference that behaves like a frontier API: Qwen3.8-Flash-Next on AMD Strix Halo plus small NPU models, over the OpenAI and Anthropic APIs on one port.

    Stale GitHub, peonist-ai 1,258 ★Custom licence (see repository)Updated 8 days ago

    git clone https://github.com/peonist-ai/halogen-flash-server.git

Indexed entries aren't reviewed or tested by InnerVault. Details come straight from each source. Anything that can reach your accounts, files or browser can do damage, so read the source before you install it.