cloudrift-ai /
emmy
Optimized GPU compiler for LLM inference. Choose from a list of optimized recipes or optimize your own model via kernel fusion, autotuning, and advanced scheduling. Run benchmarks across different GPU types and configurations, track results and share experiments with the community.
Updated 53 min ago
+4 stars gained this week
Stars gained each day, last 30 days
Usual pace · 1 / day
Oct 4Oct 19Today
This week Before Usual pace
In short
Emmy is a Python compiler that turns PyTorch models into optimized CUDA kernels for LLM inference, with benchmarking and deployment on local or cloud GPUs. It is aimed at developers who want faster model serving.
Summary written by AI from the repository’s description and README.
cloudrift-ai / emmy
View on GitHub(opens in new tab)