InnerVault

kimi-k3-in-c

Stale GitHub, FareedKhan-dev

A 2.78-trillion-parameter Kimi K3 running inference on a single CPU in 8.24 GB of RAM. Portable C99: no BLAS, no framework, no GPU.

Open the source (opens github.com) https://github.com/fareedkhan-dev/kimi-k3-in-c

What it is

AI repositories from FareedKhan-dev.

The problem it solves and who it suits haven't been reviewed by InnerVault. The description above is the source's own.

How to get it

Get the code

git clone https://github.com/FareedKhan-dev/kimi-k3-in-c.git

Standard git access to a public repository

Setup steps: not provided by the source. Follow the instructions on the source.

Related

  1. janas

    AI repositories

    37 tok/s from Qwen3-Next-80B (48 GB) on a 32 GB laptop, 24 without drafts vs 2.8 for llama.cpp; reading 62 vs 16 tok/s. Faster than llama.cpp on all 13 models compared in Q4_K_M. LLMs bigger than your RAM, pure C, CPU or GPU.

    Indexed GitHub, prabanta-dev 717 ★GPL-3.0Updated today

    git clone https://github.com/prabanta-dev/janas.git
  2. jev

    AI repositories

    jevos: an open-source alternative to Jev and Microsoft-Decision-1. Yes/no decisions, choices and scores with probabilities, on your laptop's CPU.

    Stale GitHub, feder-cr 1,342 ★MITUpdated 31 days ago

    git clone https://github.com/feder-cr/jev.git
  3. nano-vllm

    AI repositories

    Nano vLLM

    Stale GitHub, GeeeekExplorer 15.8k ★MITUpdated 6 months ago

    git clone https://github.com/GeeeekExplorer/nano-vllm.git
  4. web-llm

    AI repositories

    High-performance In-browser LLM Inference Engine

    Stale GitHub, mlc-ai 19.3k ★Apache-2.0Updated 36 days ago

    git clone https://github.com/mlc-ai/web-llm.git
  5. llm-foundry

    AI repositories

    LLM training code for Databricks foundation models

    Stale GitHub, mosaicml 4,455 ★Apache-2.0Updated 7 months ago

    git clone https://github.com/mosaicml/llm-foundry.git
  6. learning

    AI repositories

    A log of things I'm learning

    Stale GitHub, amitness 6,988 ★MITUpdated 15 days ago

    git clone https://github.com/amitness/learning.git