jpezzulli /
sglang-rtxpro6000
Optimized SGLang runtime for Qwen3.8-27B FP8 with DFlash2 and Qwen3.8 Flash-Next NVFP4 with FR-Spec on one NVIDIA RTX PRO 6000 Blackwell 96 GB GPU (SM120): 524K context, HiCache and NIXL.
Updated 41 min ago
Why now
Version pennyroyal-v3.1.4 came out on October 29.
+10 stars gained this week
Stars gained each day, last 30 days
Usual pace · 2 / day
Oct 4Oct 19Today
This week Before Usual pace
In short
The README says it targets Qwen3.8 models on one or two RTX PRO 6000 Blackwell cards, and that it needs extra system RAM for the draft cache, with 27B DFlash2 qualified and Flash-Next DFlash2 still alpha.
Summary written by AI from the repository’s description and README.
jpezzulli / sglang-rtxpro6000
View on GitHub(opens in new tab)