kimi-k3-in-c
A 2.78-trillion-parameter Kimi K3 running inference on a single CPU in 8.24 GB of RAM. Portable C99: no BLAS, no framework, no GPU.
Open the source (opens github.com) https://github.com/fareedkhan-dev/kimi-k3-in-c
What it is
AI repositories from FareedKhan-dev.
The problem it solves and who it suits haven't been reviewed by InnerVault. The description above is the source's own.
How to get it
Get the code
git clone https://github.com/FareedKhan-dev/kimi-k3-in-c.git
Standard git access to a public repository
Setup steps: not provided by the source. Follow the instructions on the source.
Related
-
janas
AI repositories37 tok/s from Qwen3-Next-80B (48 GB) on a 32 GB laptop, 24 without drafts vs 2.8 for llama.cpp; reading 62 vs 16 tok/s. Faster than llama.cpp on all 13 models compared in Q4_K_M. LLMs bigger than your RAM, pure C, CPU or GPU.
git clone https://github.com/prabanta-dev/janas.git -
jev
AI repositoriesjevos: an open-source alternative to Jev and Microsoft-Decision-1. Yes/no decisions, choices and scores with probabilities, on your laptop's CPU.
git clone https://github.com/feder-cr/jev.git -
nano-vllm
AI repositoriesNano vLLM
git clone https://github.com/GeeeekExplorer/nano-vllm.git -
web-llm
AI repositoriesHigh-performance In-browser LLM Inference Engine
git clone https://github.com/mlc-ai/web-llm.git -
llm-foundry
AI repositoriesLLM training code for Databricks foundation models
git clone https://github.com/mosaicml/llm-foundry.git -
learning
AI repositoriesA log of things I'm learning
git clone https://github.com/amitness/learning.git