JakeATX /
llamAmpere
llama.cpp fork for significantly improved performance on Ampere generation Nvidia cards (especially RTX 3090 / 3090 Ti): example: 110+ tok/s over a 100K-token generation at temperature 1 for qwen3.8, supporting full 262K ctx. Supports low memory (12gb) configs for 200k+ ctx
Updated 11 min ago
Why now
Version v0.6.2 came out on November 1.
+21 stars gained this week
Stars gained each day, last 30 days
Usual pace · 2 / day
Oct 4Oct 19Today
This week Before Usual pace
In short
The README needs Linux, an NVIDIA RTX 30-series card with 24 GB, and a build step before it runs. Models run locally through llama.cpp-style commands.
Summary written by AI from the repository’s description and README.
JakeATX / llamAmpere
View on GitHub(opens in new tab)