Morrowmake /
glm53-flash-cmp170hx-recipe
GLM-5.3-Flash on 4× NVIDIA CMP 170HX with vLLM: up to 482.6 tok/s single-user, up to 943.7 tok/s at 8 users, 262K context, TP4 or PP4, one-command container install
Updated 1 h ago
+2 stars gained this week
Stars gained each day, last 30 days
Usual pace · 3 / day
Oct 4Oct 19Today
This week Before Usual pace
In short
The README covers the container install, the Ampere kernel patches and the optional speculative drafter. It assumes four CMP 170HX cards and a host with Docker, with the engine kept inside the container.
Summary written by AI from the repository’s description and README.
Morrowmake / glm53-flash-cmp170hx-recipe
View on GitHub(opens in new tab)