hanxiao /
DeepSeek-V4.1-Flash-1017-FP8-abliterated-4x-RTX-PRO-6000
Abliterated DeepSeek-V4.1-Flash-1017 (FP8 dense, FP4 experts) on 4x RTX PRO 6000 with vLLM-Moet r21 and DSpark: 371-376 tok/s single-stream agent decode at 30k-120k context, 1M context, Flex-start GCE VM
Updated 15 min ago
+8 stars gained this week
Stars gained each day, last 30 days
Oct 4Oct 19Today
This week Before
hanxiao / DeepSeek-V4.1-Flash-1017-FP8-abliterated-4x-RTX-PRO-6000
View on GitHub(opens in new tab)