kekzl /
imp
Run large AI chat models privately on your own NVIDIA RTX 50 or RTX PRO graphics card. On one RTX 5090, Qwen3.8-27B writes about 70 words per second, 1.4x faster than vLLM. Even a model almost four times larger than the card's memory runs. Works with apps made for ChatGPT or Claude. Starts with one…
Updated 23 min ago
Why now
Version v0.61.0 came out on November 1.
+77 stars gained this week
77× its usual pace
Stars gained each day, last 30 days
Usual pace · 1 / day
Oct 4Oct 19Today
This week Before Usual pace
In short
It needs a Blackwell-generation NVIDIA GPU, Linux or WSL2, and Docker with the NVIDIA Container Toolkit. Models must be in SafeTensors format, and you chat in the browser or point coding agents at its local API.
Summary written by AI from the repository’s description and README.
kekzl / imp
View on GitHub(opens in new tab)