skyzh /
tiny-llm
learn LLM inference system on Apple Silicon for systems engineers: build a tiny vLLM + Qwen
Updated 5 min ago
Maintain this repo? Add this badge to your README.
Why now
+721 stars gained this week
48× its usual pace
Stars gained each day, last 30 days
Usual pace · 2 / day
Oct 4Oct 19Today
This week Before Usual pace
In short
A hands-on course that builds a small LLM inference and serving stack for Qwen models on Apple Silicon, using MLX arrays without high-level neural-network layers.
Summary written by AI from the repository’s description and README.
skyzh / tiny-llm
View on GitHub(opens in new tab)