GGZ14 /
vllm-mxfp4
The fastest vLLM build for AMD R9700's. For the latest updates join the Launch80 discord server. I am on X now also https://x.com/bkuyper
Updated 13 min ago
+8 stars gained this week
Stars gained each day, last 30 days
Usual pace · 2 / day
Oct 4Oct 19Today
This week Before Usual pace
In short
A vLLM inference server for AMD Radeon AI PRO R9700 GPUs, packaged as a container with ROCm, PyTorch, Triton and RDNA4-tuned kernels. Aimed at people running local LLM inference on that card.
Summary written by AI from the repository’s description and README.
GGZ14 / vllm-mxfp4
View on GitHub(opens in new tab)