KY

kyegomez/Latent-MoE

Implementation of LatentMoE,Toward Optimal Accuracy per FLOP and Parameter in Mixture of Experts (Elango et al., NVIDIA 2026) — in Pytorch. A single-file, dependency-light layer you can drop in place of a standard MoE FFN.

PythonApache-2.0license Last commit 2 months ago discord.gg/EamjgSaEQf(opens in new tab)

Growth

Last 24 hours
+0
stars
Last 7 days
+2
stars
Last 30 days
+5
stars
Total stars
23
18 a month ago
Forks
1
0 contributors

Star history

131518202325Jul 28Aug 11Aug 25Sep 8Sep 22Oct 6

Last 12 weeks · weekly cumulative stars · computed from public GitHub star events

Rank in its topics

Position among repos ranked in each topic (min. 20 stars gained)
Rank of kyegomez/Latent-MoE in each topic for today, this week and this month
TopicTodayThis weekThis month
Python–––
LLM–––
Machine learning–––

README

README.md