kimi-k3-in-c
Lets a 2.78-trillion-parameter AI model run inference on a regular laptop with no GPU and just 8GB of RAM, by rewriting the whole inference engine in dependency-free C.
View fareedkhan-dev/kimi-k3-in-c on GitHub- GitHub stars
- 11,972
- Forks
- —
- Language
- C
Project details
- Repository
- fareedkhan-dev/kimi-k3-in-c
- Licence
- Apache-2.0
- Primary language
- C
- Catalog status
- Available
- Catalog check
- 2026-11-13
Repository description
A 2.78-trillion-parameter Kimi K3 running inference on a single CPU in 8.24 GB of RAM. Portable C99: no BLAS, no framework, no GPU.
Explore by topic
More tools in Models & training
- project-maya
mw00 · MIT
Lets anyone run a very large open-weight AI model privately on their own GPUs instead of relying on a cloud provider.
- slotstream
carloslfu · MIT
Runs a 125-billion-parameter language model on a Mac with far less RAM than it needs by streaming parts of the model from the SSD.
- transformers
huggingface · Apache-2.0
The open-source library that provides ready-to-use implementations of virtually every major AI model for text, vision, audio, and multimodal use, letting developers run…
- labllm
greninja9257 · MIT
LabLLM is a free native macOS app that lets you design a GPT-style model, train it from scratch on your own data using Apple Silicon, then fine-tune and chat with the…