InnerVault

Library

85,340 resources from 11 public sources. 54 checked by hand; the rest are unreviewed.

Results

  1. kimi-k3-in-c

    AI repositories

    A 2.78-trillion-parameter Kimi K3 running inference on a single CPU in 8.24 GB of RAM. Portable C99: no BLAS, no framework, no GPU.

    Stale GitHub, FareedKhan-dev 9,049 ★Apache-2.0Updated 45 days ago

    git clone https://github.com/FareedKhan-dev/kimi-k3-in-c.git
  2. mojo-dllm

    AI repositories

    Local inference for diffusion language models (LLaDA, Dream), written in Mojo

    Stale GitHub, vladimirrott 506 ★Apache-2.0Updated 6 days ago

    git clone https://github.com/vladimirrott/mojo-dllm.git
  3. jev

    AI repositories

    jevos: an open-source alternative to Jev and Microsoft-Decision-1. Yes/no decisions, choices and scores with probabilities, on your laptop's CPU.

    Stale GitHub, feder-cr 1,342 ★MITUpdated 31 days ago

    git clone https://github.com/feder-cr/jev.git
  4. handy-ollama

    AI repositories

    动手学Ollama,CPU玩转大模型部署,在线阅读地址:https://datawhalechina.github.io/handy-ollama/

    Stale GitHub, datawhalechina 2,543 ★Custom licence (see repository)Updated 10 months ago

    git clone https://github.com/datawhalechina/handy-ollama.git
  5. chatllm.cpp

    AI repositories

    Pure C++ implementation of several models for real-time chatting on your computer (CPU & GPU)

    Stale GitHub, foldl 932 ★MITUpdated 29 days ago

    git clone https://github.com/foldl/chatllm.cpp.git
  6. janas

    AI repositories

    37 tok/s from Qwen3-Next-80B (48 GB) on a 32 GB laptop, 24 without drafts vs 2.8 for llama.cpp; reading 62 vs 16 tok/s. Faster than llama.cpp on all 13 models compared in Q4_K_M. LLMs bigger than your RAM, pure C, CPU or GPU.

    Indexed GitHub, prabanta-dev 717 ★GPL-3.0Updated today

    git clone https://github.com/prabanta-dev/janas.git
  7. GenieX

    AI repositories

    Run frontier LLMs and VLMs locally on Qualcomm devices across NPU, GPU, and CPU with a few lines of code

    Stale GitHub, qualcomm 8,494 ★BSD-3-ClauseUpdated 11 days ago

    git clone https://github.com/qualcomm/GenieX.git
  8. qwenputer

    AI repositories

    A computer, compiled into the weights of a language model. An exact CPU inside Qwen3.5-4B, with Gated DeltaNet state as RAM.

    Stale GitHub, divagr18 757 ★Custom licence (see repository)Updated 7 days ago

    git clone https://github.com/divagr18/qwenputer.git
  9. oneDNN

    AI repositories

    Open-source library of optimized deep learning operations (matmul, convolution, attention) for CPUs (x64, AArch64, RISC-V) and Intel GPUs. Used by PyTorch, TensorFlow, OpenVINO, and ONNX Runtime.

    Indexed GitHub, uxlfoundation 4,094 ★Apache-2.0Updated today

    git clone https://github.com/uxlfoundation/oneDNN.git
  10. paddler

    AI repositories

    Open-source LLM/VLM load balancer and serving platform for self-hosting LLMs (and VLMs) at scale 🏓🦙 Alternative to projects like llm-d, Docker Model Runner, etc but with less moving parts and simple deployments built around ggml ecosystem. Runs on CPU and GPU.

    Stale GitHub, intentee 1,690 ★Apache-2.0Updated 9 days ago

    git clone https://github.com/intentee/paddler.git
  11. ⚡ Build your chatbot within minutes on your favorite device; offer SOTA compression techniques for LLMs; run LLMs efficiently on Intel Platforms⚡

    Stale Archived GitHub, intel 2,169 ★Apache-2.0Updated 2 years ago 1 note

    git clone https://github.com/intel/intel-extension-for-transformers.git
  12. Pi-Bolt

    AI repositories

    ⚡ Pi, the coding agent, compiled ahead of time to one native executable. 10× faster to start, 7× less CPU and 4.5× less memory than Pi on Node. Linux, macOS, Windows, ARM64 and Android (Termux).

    Stale GitHub, opensec-git 790 ★MITUpdated 5 days ago

    git clone https://github.com/opensec-git/Pi-Bolt.git
  13. starling

    AI repositories

    Local AI in .NET, with no Python sidecar and no API key: embeddings, entity extraction, image and video search and chat on ONNX Runtime (CPU/CUDA), through Microsoft.Extensions.AI.

    Indexed GitHub, starlinghq 102 ★Apache-2.0Updated today

    git clone https://github.com/starlinghq/starling.git

Indexed entries aren't reviewed or tested by InnerVault. Details come straight from each source. Anything that can reach your accounts, files or browser can do damage, so read the source before you install it.