omlx
Run and manage local language models on Apple Silicon from a macOS menu bar app.
View jundot/omlx on GitHub- GitHub stars
- 23,600
- Forks
- —
- Language
- Python
Project details
- Repository
- jundot/omlx
- Licence
- Apache-2.0
- Primary language
- Python
- Catalog status
- Available
- Catalog check
- 2026-11-13
Repository description
LLM inference server with continuous batching & SSD caching for Apple Silicon — managed from the macOS menu bar
Explore by topic
More tools in Models & training
- slotstream
carloslfu · MIT
Runs a 125-billion-parameter language model on a Mac with far less RAM than it needs by streaming parts of the model from the SSD.
- labllm
greninja9257 · MIT
LabLLM is a free native macOS app that lets you design a GPT-style model, train it from scratch on your own data using Apple Silicon, then fine-tune and chat with the…
- taskdistill
b0yko · Apache-2.0
A tool that watches how you actually use an expensive AI model on one task, then trains a small local model to handle most of those calls itself, falling back to the…
- llmfit
alexsjones · MIT
One command tells you which local AI models will actually run well on your specific computer, out of hundreds of options.