InnerVault

llama.cpp

Hand-checked InnerVault (hand-checked), ggml-org

The C/C++ engine many local-model tools are built on. It runs models efficiently on ordinary hardware.

Open the source (opens github.com) https://github.com/ggml-org/llama.cpp

What it is

Models from ggml-org. Good for:

  • Squeeze a model onto a laptop or small server

Level: advanced

How to get it

Setup steps: not provided by the source. Follow the instructions on the source.

Related

  1. Ollama

    Models

    Runs open models such as gpt-oss, Qwen and DeepSeek on your own computer.

    Hand-checked InnerVault (hand-checked), Ollama 186.7k ★MIT

    curl -fsSL https://ollama.com/install.sh | sh
  2. model by TeichAI

    Stale Hugging Face Hub, TeichAI 515 ♥apache-2.0Updated 8 months ago

    TeichAI/GLM-4.7-Flash-Claude-Opus-4.5-High-Reasoning-Distill-GGUF
  3. image text to text model by Jackrong · transformers

    Stale Hugging Face Hub, Jackrong 352 ♥apache-2.0Updated 4 months ago

    Jackrong/Qwopus3.5-27B-v3-GGUF
  4. image text to text model by Jackrong · transformers

    Stale Hugging Face Hub, Jackrong 682 ♥apache-2.0Updated 4 months ago

    Jackrong/Qwen3.5-27B-Claude-4.6-Opus-Reasoning-Distilled-GGUF
  5. image text to text model by Jackrong · transformers

    Stale Hugging Face Hub, Jackrong 354 ♥apache-2.0Updated 4 months ago

    Jackrong/Qwopus3.5-9B-Coder-GGUF
  6. image text to text model by Jackrong · transformers

    Stale Hugging Face Hub, Jackrong 336 ♥apache-2.0Updated 4 months ago

    Jackrong/Qwopus3.6-27B-Coder-MTP-GGUF