sergqwer /
strata-nvfp4
Strata fork: Qwen3.8-Flash-Next 125B MoE in NVFP4 on one RTX 20-50 card (12 GB+) and 64 GB of RAM or more. Setup installs our GPTQ quants (huihui abliterated, OrcaRouter) from Hugging Face. CPU experts on AVX-512 or AVX2 (+AVX-VNNI), all experts in RAM from 92 GB, a low-RAM mode below, vision, W4A8…
Updated 47 min ago
+21 stars gained this week
Stars gained each day, last 30 days
Oct 4Oct 19Today
This week Before
sergqwer / strata-nvfp4
View on GitHub(opens in new tab)