slotstream
Runs a 125-billion-parameter language model on a Mac with far less RAM than it needs by streaming parts of the model from the SSD.
View carloslfu/slotstream on GitHub- GitHub stars
- 671
- Forks
- —
- Language
- Swift
Project details
- Repository
- carloslfu/slotstream
- Licence
- MIT
- Primary language
- Swift
- Catalog status
- Available
- Catalog check
- 2026-11-13
Repository description
Run a 105 GB AI model on a Mac that can't hold it. Qwen3.8-Flash-Next 4-bit, streamed from SSD on 16–64 GB Apple Silicon Macs. Fully native Swift, MLX and Metal. Offline, no Python. CLI, Swift library, and Ollama/OpenAI/Anthropic APIs. Works with Claude Code and Codex.
Explore by topic
More tools in Models & training
- labllm
greninja9257 · MIT
LabLLM is a free native macOS app that lets you design a GPT-style model, train it from scratch on your own data using Apple Silicon, then fine-tune and chat with the…
- project-maya
mw00 · MIT
Lets anyone run a very large open-weight AI model privately on their own GPUs instead of relying on a cloud provider.
- kaggle-tpu-lab
arahim3 · MIT
A recipe for serving the 27B-parameter Qwen3.8 model on Kaggle free TPUs with a public OpenAI-compatible endpoint and a 262k-token context window, no paid GPU.
- omlx
jundot · Apache-2.0
Run and manage local language models on Apple Silicon from a macOS menu bar app.