Library
85,762 resources from 11 public sources. 54 checked by hand; the rest are unreviewed.
Results
-
BigMoeOnEdge
AI repositoriesRun MoE models bigger than your RAM. Frontier-size MoE on a phone, laptop, edge. Lossless, on stock llama.cpp. An adaptive streaming optimizer. Any hardware, any OS, any model, any quantization, behind a local OpenAI-compatible server.
git clone https://github.com/Helldez/BigMoeOnEdge.git -
Whittle-Next-27B-A3B
Modelstext generation model by whittleOrg · transformers
whittleOrg/Whittle-Next-27B-A3B -
Ming-3.0-audio-flash
Modelstext to speech model by inclusionAI · transformers
inclusionAI/Ming-3.0-audio-flash -
halogen-flash-server
AI repositoriesLocal inference that behaves like a frontier API: Qwen3.8-Flash-Next on AMD Strix Halo plus small NPU models, over the OpenAI and Anthropic APIs on one port.
git clone https://github.com/peonist-ai/halogen-flash-server.git -
Ming-3.0-tts-tiny
Modelstext to speech model by inclusionAI · transformers
inclusionAI/Ming-3.0-tts-tiny -
image text to text model by SC117 · gguf
SC117/Swift-1.5-Qwen3.8-Flash-Next-GSQ-RCO-abliterated-GGUF -
Lara-4-Mini-Base
Modelstext generation model by translated · transformers
translated/Lara-4-Mini-Base -
Ming-3.0-audio-tiny
Modelstext to speech model by inclusionAI · transformers
inclusionAI/Ming-3.0-audio-tiny -
Agnes-2.5-Pro-Theta
Modelsimage text to text model by Agnes-AI · transformers
Agnes-AI/Agnes-2.5-Pro-Theta -
Kimi-K3.1-Pro-pruned75
Modelsimage text to text model by vllm-project · transformers
vllm-project/Kimi-K3.1-Pro-pruned75 -
project-maya
AI repositoriesProject Maya - run GLM-5.3-Flash (321B MoE), DeepSeek-V4.1-Flash-1017 (748B MoE) and MiniMax-M3.1-Flash (428B MoE) privately on your own GPU(s), from one card to 16, NVIDIA or AMD, Linux or Windows. Engine, server, dashboard, OpenAI- and Anthropic-compatible API, quant tools.
git clone https://github.com/mw00/project-maya.git -
llama-modchip
Agents & frameworksRun 284B DeepSeek-V4-Flash (<59GiB RAM: 41.1 cold pp, 9.1 N=1 tg, up to 25.3 spec tok/s) & 30B MoEs (22.4 N=1 / 111.6 spec tok/s) on 64GB CPU (0 GPUs).
git clone https://github.com/synchopate/llama-modchip.git -
janas
AI repositories37 tok/s from Qwen3-Next-80B (48 GB) on a 32 GB laptop, 24 without drafts vs 2.8 for llama.cpp; reading 62 vs 16 tok/s. Faster than llama.cpp on all 13 models compared in Q4_K_M. LLMs bigger than your RAM, pure C, CPU or GPU.
git clone https://github.com/prabanta-dev/janas.git -
PolyStrata
AI repositoriesRun large AI models on your own PC: Qwen3.8-Flash-Next on Strata's engine, and GLM 5.3 Flash, DeepSeek V4 Flash, LFM2.5, Qwen3.6, Ornith 1.5, Gemma 4, Tiel Coder and MiniCPM-V on a second engine written for PolyStrata. One-click install for Windows and Linux, OpenAI/Anthropic API on localhost.
git clone https://github.com/VecSzn/PolyStrata.git -
slotstream
AI repositoriesRun a 105 GB AI model on a Mac that can't hold it. Qwen3.8-Flash-Next 4-bit, streamed from SSD on 16–64 GB Apple Silicon Macs. Fully native Swift, MLX and Metal. Offline, no Python. CLI, Swift library, and Ollama/OpenAI/Anthropic APIs. Works with Claude Code and Codex.
git clone https://github.com/carloslfu/slotstream.git -
imp
Agents & frameworksRun large AI chat models privately on your own NVIDIA RTX 50 or RTX PRO graphics card. On one RTX 5090, Qwen3.8-27B writes about 70 words per second, 1.4x faster than vLLM. Even a model almost four times larger than the card's memory runs. Works with apps made for ChatGPT or Claude. Starts with one docker command.
git clone https://github.com/kekzl/imp.git -
inclusionAI: Ling 3.1 Flash
ModelsLing 3.1 Flash is a hybrid reasoning mixture-of-experts model from inclusionAI, with 25B active parameters out of 560B total.
inclusionai/ling-3.1-flash -
DeepSeek V4 Pro 0813 is a large-scale mixture-of-experts model from DeepSeek. This is the GA release of DeepSeek V4 Pro.
deepseek/deepseek-v4-pro-0813 -
Tencent: Hy4 preview
ModelsTencent: Hy4 preview is a mixture-of-experts model from Tencent, with 49B active parameters out of 770B total. It is designed for coding agents, complex tool-use workflows, and productivity tasks that...
tencent/hy4-preview -
Tencent: Hy3 preview
ModelsHy3 preview is a high-efficiency Mixture-of-Experts model from Tencent designed for agentic workflows and production use. It supports configurable reasoning levels across disabled, low, and high modes, allowing it to...
tencent/hy3-preview -
MoonshotAI: Kimi K2 0711
ModelsKimi K2 Instruct is a large-scale Mixture-of-Experts (MoE) language model developed by Moonshot AI, featuring 1 trillion total parameters with 32 billion active per forward pass. It is optimized for...
moonshotai/kimi-k2 -
Qwen: Qwen3 30B A3B
ModelsQwen3, the latest generation in the Qwen large language model series, features both dense and mixture-of-experts (MoE) architectures to excel in reasoning, multilingual support, and advanced agent tasks. Its unique...
qwen/qwen3-30b-a3b -
Tencent: Hy3
ModelsHy3 is a 295B-parameter Mixture-of-Experts model from Tencent (21B active, 192 experts with top-8 routing) built for reasoning, agentic workflows, and real-world production use. It supports a configurable reasoning effort:...
tencent/hy3 -
North Mini Code is Cohere's first agentic coding model and the debut of its North family. A sparse mixture-of-experts model with 30B total parameters and 3B active, it is optimized...
cohere/north-mini-code:free
Indexed entries aren't reviewed or tested by InnerVault. Details come straight from each source. Anything that can reach your accounts, files or browser can do damage, so read the source before you install it.