LLM serving on GitHub, Oct 26 – Nov 1, 2026

152 repositories ranked in this topic that week. resin ranked first with 277 stars, then Strata (4,760 stars) and antirion (303 stars).

The full ranking as the week’s last hourly run left it: stars gained over those seven days, relative to each repo’s size. This week’s LLM serving ranking

1. 1 ekzhang/resin +277 stars that week
2. 2 Niko1221/Strata +4.8k stars that week
3. 3 eliasbiondo/antirion +303 stars that week
4. 4 StartLuxLabs/StartLux-Prism +149 stars that week
5. 5 deepseek-ai/DeepInfer +2.2k stars that week
6. 6 jesdga95/basalt +195 stars that week
7. 7 NerverDevs/nervecenter +122 stars that week
8. 8 trymirai/uzu +588 stars that week
9. 9 martina9516/uncensored-ai-models +107 stars that week
10. 10 mw00/project-maya +465 stars that week
11. 11 VecSzn/PolyStrata +240 stars that week
12. 12 skyzh/tiny-llm +720 stars that week
13. 13 Calcium-Ion/AstrLink +179 stars that week
14. 14 Alice-Marx/dsh-model-router +194 stars that week
15. 15 respanai/respan-gateway +159 stars that week
16. 16 cheaper-inference/OmniRoute +2.5k stars that week
17. 17 drawthingsai/local-code-community +83 stars that week
18. 18 kekzl/imp +77 stars that week
19. 19 routerhubSI/uncensored-ai-api +139 stars that week
20. 20 giienew/9router-pro +70 stars that week
21. 21 synchopate/nemotron-30b-cpu-256k +68 stars that week
22. 22 carloslfu/slotstream +145 stars that week
23. 23 bitcloud-ai/Bittune +64 stars that week
24. 24 rednote-machine-learning/RedKnot +327 stars that week
25. 25 ThinkWatchProject/ThinkWatch-Lite +120 stars that week
26. 26 dayuwang401/spectral-orthogonal-exploration +60 stars that week
27. 27 mnfst/awesome-free-llm-apis +636 stars that week
28. 28 cablate/model-relay +57 stars that week
29. 29 shuishuipingan/qoder2api-hub +108 stars that week
30. 30 01men/ybkkasi +53 stars that week
31. 31 musicurgy/delta-inference-engine +53 stars that week
32. 32 syv-ai/HyperQwen +248 stars that week
33. 33 ahtx/kindi +52 stars that week
34. 34 nace-ai/kapitsa +112 stars that week
35. 35 T-Crypt/berth +71 stars that week
36. 36 Generated-Computers/Locals +94 stars that week
37. 37 FlashML-org/FreeToken +598 stars that week
38. 38 prabanta-dev/janas +98 stars that week
39. 39 incoai/splash +192 stars that week
40. 40 Indras-Mirror/Xolotl +81 stars that week
41. 41 lyogavin/airllm +843 stars that week
42. 42 ddalcu/mlx-serve +181 stars that week
43. 43 MemTensor/MemT-1.0 +79 stars that week
44. 44 3145544645/gouji +39 stars that week
45. 45 chalk-ai/chalk-router-oss +39 stars that week
46. 46 magnitudedev/magnitude +328 stars that week
47. 47 WizisCool/oh-my-cpa +57 stars that week
48. 48 eagle-hq/EAGLE-4 +110 stars that week
49. 49 Agentic-System-Lab/agent-loop-visualizer +34 stars that week
50. 50 meshapplied/goethe +33 stars that week
51. 51 LAGcomcom/zen-gate +49 stars that week
52. 52 christopherowen/spark-ds41f +31 stars that week
53. 53 nsbradley88/talus-public +30 stars that week
54. 54 Wallawalla47/Infernix +36 stars that week
55. 55 agentgateway/agentgateway +220 stars that week
56. 56 recursive-oss/rec +43 stars that week
57. 57 yreidev/workbuddy2api-panel +29 stars that week
58. 58 bojieli/ai-infra-book +241 stars that week
59. 59 0xShug0/audio.cpp +170 stars that week
60. 60 afdEP/afdEP-comm +27 stars that week
61. 61 ashhart/TensorFold +103 stars that week
62. 62 NVIDIA/spark-local-inference +65 stars that week
63. 63 bpx03/QEngine +25 stars that week
64. 64 decolua/9router +428 stars that week
65. 65 zexadev/gemini-web2api-go +62 stars that week
66. 66 pallavi-shekhar/ai-engineering-interview-questions-company-wise +102 stars that week
67. 67 CSUNX233/qwen3.8-27b-ninfer-5070tilaptop-kvmem-local-agent +23 stars that week
68. 68 peonist-ai/halogen-flash-server +76 stars that week
69. 69 TheLastOxygen/mafdet +22 stars that week
70. 70 ggml-org/llama.cpp +789 stars that week
71. 71 QuantumNous/new-api +479 stars that week
72. 72 amitshekhariitbhu/ai-engineering-course +50 stars that week
73. 73 w8123/EnterpriseAgentFramework +64 stars that week
74. 74 Leonccaa/ReVolta +20 stars that week
75. 75 lidge-jun/opencodex +265 stars that week
76. 76 BerriAI/litellm +487 stars that week
77. 77 Orchestra-Research/AI-Research-SKILLs +227 stars that week
78. 78 maximhq/bifrost +182 stars that week
79. 79 vllm-project/vllm +563 stars that week
80. 80 justxor/deepseek-local-guide-ru +22 stars that week
81. 81 verl-project/verl-omni +64 stars that week
82. 82 StartLuxLabs/StartLux-Decision +67 stars that week
83. 83 nokia-applied-research/AnyJev +65 stars that week
84. 84 datawhalechina/zero-to-sglang +63 stars that week
85. 85 AtomicBot-ai/Atomic-Chat +64 stars that week
86. 86 jundot/omlx +225 stars that week
87. 87 gitleaks/gitleaks +255 stars that week
88. 88 JakeATX/llamAmpere +20 stars that week
89. 89 sergqwer/strata-nvfp4 +20 stars that week
90. 90 vllm-project/vllm-omni +119 stars that week
91. 91 vllm-project/semantic-router +105 stars that week
92. 92 1CatAI/1Cat-vLLM +48 stars that week
93. 93 panxunying/ai-coding-welfare +42 stars that week
94. 94 lbjlaq/Antigravity-Manager +217 stars that week
95. 95 higress-group/HiRoute +22 stars that week
96. 96 tetherto/qvac +31 stars that week
97. 97 lightseekorg/tokenspeed +58 stars that week
98. 98 warpfront/hipfire +30 stars that week
99. 99 zhongkaifu/TensorSharp +27 stars that week
100. 100 XHToken/Spark-X2.6 +31 stars that week