0xBakeer /
TandemLLM
An environment where open models work as agents: a first-level harness with routing, skills, memory and sandboxed tools, on an engine that drafts and verifies its own tokens.
Updated 53 min ago
Why now
Version v0.15.0 came out on October 27.
+7 stars gained this week
Stars gained each day, last 30 days
Usual pace · 2 / day
Oct 4Oct 19Today
This week Before Usual pace
In short
TandemLLM is an inference engine for a single NVIDIA DGX Spark that runs open models such as Qwen and Nemotron, using small drafter models verified by the main model for faster decoding. It is aimed at people self-hosting LLMs on that hardware.
Summary written by AI from the repository’s description and README.
0xBakeer / TandemLLM
View on GitHub(opens in new tab)