al-jshen /
flashmap
Flow Map Speculative Decoding
Updated 34 min ago
+17 stars gained this week
Stars gained each day, last 30 days
Oct 4Oct 19Today
This week Before
In short
It needs torch and transformers 4.56 or newer, and serving via SGLang or vLLM requires an extra install. It runs as a Python library on Hugging Face models, with the drafter loaded alongside a target model.
Summary written by AI from the repository’s description and README.
al-jshen / flashmap
View on GitHub(opens in new tab)