1CatAI /
1Cat-vLLM
V100 / SM70-focused vLLM engineering fork for modern LLM inference.
Updated 20 min ago
+50 stars gained this week
Stars gained each day, last 30 days
Usual pace · 8 / day
Oct 4Oct 19Today
This week Before Usual pace
In short
A vLLM fork that optimizes LLM inference for NVIDIA Tesla V100 (SM70) GPUs, adding faster kernels and GGUF support for running modern models on Volta hardware. Aimed at users with V100 setups.
Summary written by AI from the repository’s description and README.
1CatAI / 1Cat-vLLM
View on GitHub(opens in new tab)