kvcache-ai /
Mooncake
Mooncake is the serving platform for Kimi, a leading LLM service provided by Moonshot AI.
Updated 43 min ago
+70 stars gained this week
Stars gained each day, last 30 days
Usual pace · 8 / day
Oct 4Oct 19Today
This week Before Usual pace
In short
Mooncake is a KVCache-centric disaggregated serving platform for large language models, used to run Kimi. It offers KV cache pooling and fast data transfer that inference engines such as vLLM and SGLang can build on.
Summary written by AI from the repository’s description and README.
kvcache-ai / Mooncake
View on GitHub(opens in new tab)