magnitude
Magnitude profiles your computer's hardware, recommends the best local AI models it can run, then downloads, tunes and runs them so your existing coding agent works fully offline with no API costs.
View magnitudedev/magnitude on GitHub- GitHub stars
- 7,792
- Forks
- —
- Language
- Rust
Project details
- Repository
- magnitudedev/magnitude
- Licence
- Apache-2.0
- Primary language
- Rust
- Catalog status
- Available
- Catalog check
- 2026-11-13
Repository description
Open source inference engine that tunes its kernels on your hardware to find the fastest way to run each model. 2x faster than Ollama. Works on Apple Silicon, NVIDIA, AMD, Intel, or just a CPU.
Explore by topic
More tools in Models & training
- opencode
anomalyco · MIT
OpenCode is a free, open-source AI coding agent you run from your terminal, an alternative to tools like Claude Code or Cursor that works with any LLM provider.
- transformers
huggingface · Apache-2.0
The open-source library that provides ready-to-use implementations of virtually every major AI model for text, vision, audio, and multimodal use, letting developers run…
- comfyui
comfy-org · GPL-3.0
ComfyUI is a free, node-based visual interface for running diffusion models like Stable Diffusion locally, so you can build AI image and video generation workflows by…
- pi
earendil-works · MIT
An open-source toolkit for building AI agents: one unified API across OpenAI, Anthropic and Google models, plus a ready-made interactive coding agent CLI.