llm-inference-engineering
A growing free course by Amit Shekhar (founder of Outcome School) that breaks down how LLM inference actually works under the hood, from the basic token-generation loop to the serving techniques that make chatbots respond quickly.
View amitshekhariitbhu/llm-inference-engineering on GitHub- GitHub stars
- 411
- Forks
- —
- Language
- Markdown
Project details
- Repository
- amitshekhariitbhu/llm-inference-engineering
- Licence
- Apache-2.0
- Primary language
- Markdown
- Catalog status
- Available
- Catalog check
- 2026-11-13
Repository description
Learn LLM Inference Engineering step by step - from KV cache, PagedAttention, and continuous batching to vLLM, SGLang, and GPUs.
Explore by topic
More tools in Models & training
- unsloth
unslothai · Apache-2.0
A free local app for running and training your own AI language and image models on your own machine.
- kimi-k3-in-c
fareedkhan-dev · Apache-2.0
Lets a 2.78-trillion-parameter AI model run inference on a regular laptop with no GPU and just 8GB of RAM, by rewriting the whole inference engine in dependency-free C.
- project-maya
mw00 · MIT
Lets anyone run a very large open-weight AI model privately on their own GPUs instead of relying on a cloud provider.
- llm-master
youngyangyang04 · MIT
A free, structured roadmap of 150+ tutorials taking developers from their first LLM API call through building production-ready RAG pipelines and AI agents.