headpiece747 /
ninfer-5090-windows
Native Windows port of NInfer engine for RTX 5090. Features Qwen3.8-27B with QUASAR and NInfer models, MTP/DFlash2 with vision and 262,144 context
Updated 11 min ago
Why now
Version v1.2.3 came out on October 31.
+9 stars gained this week
Stars gained each day, last 30 days
Usual pace · 1 / day
Oct 4Oct 19Today
This week Before Usual pace
In short
It needs an RTX 5090 GPU on Windows 11 x64 with CUDA 13.3, plus a model download via downloadmodel.bat, and runs from the command line or as an HTTP API.
Summary written by AI from the repository’s description and README.
headpiece747 / ninfer-5090-windows
View on GitHub(opens in new tab)