smolmaxxing
smolmaxxing runs the biggest LLM it can on the smallest hardware you own, with measured benchmarks on a TV box, an old iPad, and a phone running 16B-80B parameter models on 1-3GB of RAM.
View hyperionaidev/smolmaxxing on GitHub- GitHub stars
- 517
- Forks
- —
- Language
- C
Project details
- Repository
- hyperionaidev/smolmaxxing
- Licence
- MIT
- Primary language
- C
- Catalog status
- Available
- Catalog check
- 2026-11-13
Repository description
maxxing the ability to run different LLMs on the smallest devices possible
Explore by topic
More tools in Models & training
- project-maya
mw00 · MIT
Lets anyone run a very large open-weight AI model privately on their own GPUs instead of relying on a cloud provider.
- llama-modchip
synchopate · Apache-2.0
Lets you run a huge 284-billion-parameter AI model on an ordinary 64GB computer using only the CPU, no GPU required.
- kimi-k3-in-c
fareedkhan-dev · Apache-2.0
Lets a 2.78-trillion-parameter AI model run inference on a regular laptop with no GPU and just 8GB of RAM, by rewriting the whole inference engine in dependency-free C.
- soup
makazhanalpamys · Apache-2.0
Soup lets you fine-tune an 8-billion-parameter AI model on a laptop with just 4GB of GPU memory, using one YAML config file instead of wrestling with cloud setup.