llama.cpp
The C/C++ engine many local-model tools are built on. It runs models efficiently on ordinary hardware.
Open the source (opens github.com) https://github.com/ggml-org/llama.cpp
What it is
Models from ggml-org. Good for:
- Squeeze a model onto a laptop or small server
Level: advanced
How to get it
Setup steps: not provided by the source. Follow the instructions on the source.
Related
-
Ollama
ModelsRuns open models such as gpt-oss, Qwen and DeepSeek on your own computer.
curl -fsSL https://ollama.com/install.sh | sh -
model by TeichAI
TeichAI/GLM-4.7-Flash-Claude-Opus-4.5-High-Reasoning-Distill-GGUF -
Qwopus3.5-27B-v3-GGUF
Modelsimage text to text model by Jackrong · transformers
Jackrong/Qwopus3.5-27B-v3-GGUF -
image text to text model by Jackrong · transformers
Jackrong/Qwen3.5-27B-Claude-4.6-Opus-Reasoning-Distilled-GGUF -
Qwopus3.5-9B-Coder-GGUF
Modelsimage text to text model by Jackrong · transformers
Jackrong/Qwopus3.5-9B-Coder-GGUF -
Qwopus3.6-27B-Coder-MTP-GGUF
Modelsimage text to text model by Jackrong · transformers
Jackrong/Qwopus3.6-27B-Coder-MTP-GGUF