LLM serving on GitHub, Oct 19 – Oct 25, 2026

150 repositories ranked in this topic that week. EAGLE-4 ranked first with 989 stars, then MemT-1.0 (398 stars) and kapitsa (349 stars).

The full ranking as the week’s last hourly run left it: stars gained over those seven days, relative to each repo’s size. This week’s LLM serving ranking

1. 1 eagle-hq/EAGLE-4 +989 stars that week
2. 2 MemTensor/MemT-1.0 +398 stars that week
3. 3 nace-ai/kapitsa +349 stars that week
4. 4 routerhubSI/uncensored-ai-api +365 stars that week
5. 5 Generated-Computers/Locals +320 stars that week
6. 6 StartLuxLabs/StartLux-Decision +838 stars that week
7. 7 Niko1221/Strata +5.2k stars that week
8. 8 respanai/respan-gateway +300 stars that week
9. 9 eliasbiondo/antirion +264 stars that week
10. 10 mw00/project-maya +820 stars that week
11. 11 Alice-Marx/dsh-model-router +262 stars that week
12. 12 7API/uncensored-ai-api +217 stars that week
13. 13 recursive-oss/rec +213 stars that week
14. 14 Indras-Mirror/Xolotl +230 stars that week
15. 15 T-Crypt/berth +181 stars that week
16. 16 securetron-gh/aifw +244 stars that week
17. 17 VecSzn/PolyStrata +258 stars that week
18. 18 shuishuipingan/qoder2api-hub +166 stars that week
19. 19 cheaper-inference/OmniRoute +3.1k stars that week
20. 20 modelsphere/modelsphere +99 stars that week
21. 21 ThinkWatchProject/ThinkWatch-Lite +104 stars that week
22. 22 StartLuxLabs/StartLux-Prism +71 stars that week
23. 23 incoai/splash +273 stars that week
24. 24 qiniu/xhub +69 stars that week
25. 25 lyogavin/airllm +1.3k stars that week
26. 26 bitcloud-ai/Bittune +65 stars that week
27. 27 mnfst/awesome-free-llm-apis +643 stars that week
28. 28 ahtx/kindi +60 stars that week
29. 29 higress-group/HiRoute +88 stars that week
30. 30 TheLastOxygen/mafdet +54 stars that week
31. 31 3145544645/gouji +50 stars that week
32. 32 surya-koritala/Glyd +76 stars that week
33. 33 justxor/deepseek-local-guide-ru +48 stars that week
34. 34 ovg-project/kvcached +202 stars that week
35. 35 vllm-project/vllm +1.4k stars that week
36. 36 maximpri/mlxtop +43 stars that week
37. 37 CSUNX233/qwen3.8-27b-ninfer-5070tilaptop-kvmem-local-agent +43 stars that week
38. 38 nicorobinreal/llmspeed +45 stars that week
39. 39 cablate/model-relay +40 stars that week
40. 40 LAGcomcom/zen-gate +51 stars that week
41. 41 trymirai/uzu +183 stars that week
42. 42 Elevatormusic/DeepSeek-V4.1-Flash-1017-EXL3-TensorFold-2x-DGX-Spark +37 stars that week
43. 43 QuickButlerPace65/AnythingLLM-Desktop +37 stars that week
44. 44 pegainfer-project/kern +36 stars that week
45. 45 syv-ai/HyperQwen +152 stars that week
46. 46 bojieli/ai-infra-book +265 stars that week
47. 47 yanstd888/node2mint +31 stars that week
48. 48 rednote-machine-learning/RedKnot +156 stars that week
49. 49 yreidev/workbuddy2api-panel +29 stars that week
50. 50 groundingpi/GroundAnything +29 stars that week
51. 51 Calcium-Ion/AstrLink +48 stars that week
52. 52 lidge-jun/opencodex +367 stars that week
53. 53 ashhart/TensorFold +102 stars that week
54. 54 xiaodou-official/xiaodou-open-platform +45 stars that week
55. 55 agentgateway/agentgateway +198 stars that week
56. 56 StayLameBro/backburner +86 stars that week
57. 57 ddalcu/mlx-serve +118 stars that week
58. 58 peonist-ai/halogen-flash-server +81 stars that week
59. 59 datawhalechina/zero-to-sglang +98 stars that week
60. 60 snap-stanford/memorilla +25 stars that week
61. 61 hardenedlinux/SonicBoom +25 stars that week
62. 62 Dami-wq-k03/nano-lmcache +25 stars that week
63. 63 decolua/9router +438 stars that week
64. 64 Magnvs7/Promethevs +24 stars that week
65. 65 QuantumNous/new-api +526 stars that week
66. 66 pallavi-shekhar/ai-engineering-interview-questions-company-wise +95 stars that week
67. 67 warpfront/hipfire +59 stars that week
68. 68 BerriAI/litellm +554 stars that week
69. 69 Orchestra-Research/AI-Research-SKILLs +258 stars that week
70. 70 Wallawalla47/Infernix +24 stars that week
71. 71 smg-project/smg +54 stars that week
72. 72 ggml-org/llama.cpp +787 stars that week
73. 73 0xShug0/audio.cpp +130 stars that week
74. 74 magnitudedev/magnitude +182 stars that week
75. 75 modal-projects/spindle +21 stars that week
76. 76 shawnshekari/strixite +21 stars that week
77. 77 sergqwer/strata-nvfp4 +26 stars that week
78. 78 maximhq/bifrost +182 stars that week
79. 79 panxunying/ai-coding-welfare +63 stars that week
80. 80 sgl-project/sglang-omni +71 stars that week
81. 81 verl-project/verl-omni +64 stars that week
82. 82 zexadev/gemini-web2api-go +45 stars that week
83. 83 nokia-applied-research/AnyJev +66 stars that week
84. 84 WizisCool/oh-my-cpa +25 stars that week
85. 85 FlashML-org/FreeToken +208 stars that week
86. 86 ARahim3/kaggle-tpu-lab +42 stars that week
87. 87 nobodywho-ooo/nobodywho +62 stars that week
88. 88 lightseekorg/tokenspeed +80 stars that week
89. 89 amitshekhariitbhu/ai-engineering-interview-questions +83 stars that week
90. 90 zhongkaifu/TensorSharp +34 stars that week
91. 91 ollaya-dev/ollaya +49 stars that week
92. 92 feder-cr/jev +39 stars that week
93. 93 gitleaks/gitleaks +228 stars that week
94. 94 drumih/turbo-fieldfare +109 stars that week
95. 95 vllm-project/vllm-omni +107 stars that week
96. 96 seakee/CPA-Manager-Plus +78 stars that week
97. 97 amitshekhariitbhu/ai-engineering-course +28 stars that week
98. 98 XHToken/Spark-X2.6 +33 stars that week
99. 99 1CatAI/1Cat-vLLM +42 stars that week
100. 100 prabanta-dev/janas +23 stars that week