Upstar ranks the fastest-rising GitHub repos every hour, across 69 topics. Browse topics

#llm-serving

LLM serving on GitHub, November 9–15, 2026

In LLM serving, 155 repos ranked the week of November 9 and gained 39,606 stars between them, 9% more than the week before. RunanywhereAI/trnrt, new to the topic, went straight to #1 with 1,570 stars gained. The top 10 had 8 repos that were not in it the week before, among them OmniJev/Flide at #2, up from #76. basetenlabs/deepseek-ultrafast, at #3, was one of the 30 repos ranked in the topic for the first time that week.

The ranking as the week’s last hourly run left it, on November 16 at 00:00 UTC. It does not change.

repos ranked
155
stars gained +9% vs the week before
39,606
new in the top 10
8 of 10
ranked in #llm-serving for the first time
30

The top 10

Ordered by stars gained over the seven days relative to each repo’s size, which is why a repo can rank above one that gained more.

  1. 1
    RunanywhereAI/trnrt The open LLM inference engine for AWS Trainium: NKI megakernels, 1M-token context, OpenAI-compatible API. By RunAnywhere. First week in #llm-serving Stars doubled since
    stars that week +1.6k
  2. 2
    OmniJev/Flide 🔥🔥 The extremely fast inference engine for decision model up from #76 the week before
    stars that week +471
  3. 3
    basetenlabs/deepseek-ultrafast First week in #llm-serving
    stars that week +407
  4. 5
    huawei-csl/MACaQ SOTA model-agnostic quantization for GGUF, local inference and beyond. Quantize and run text, image, video and audio models with llama.cpp, vLLM, Diffusers and PyTorch. First week in #llm-serving
    stars that week +311
  5. 6
    synchopate/llama-modchip Run 284B DeepSeek-V4-Flash (<59GiB RAM: 41.1 cold pp, 9.1 N=1 tg, up to 25.3 spec tok/s) & 30B MoEs (22.4 N=1 / 111.6 spec tok/s) on 64GB CPU (0 GPUs). down from #2 the week before
    stars that week +691
  6. 8
    Continuum-AI-Corp/OrcaRouter-Lite Self-hosted LLM router with a managed safety net. OpenAI-compatible. BYOK. Single-workspace. Streaming. For more advanced routing choose hosted OrcaRouter up from #15 the week before
    stars that week +1.1k
  7. 9
    yetone/magpie Every agent's model. One place. Codex on DeepSeek, Claude Code on Kimi, from the menu bar. down from #3 the week before
    stars that week +4.3k
  8. 10
    yanstd888/9routerx 9RouterX (9R Next Go Generation): Single-binary Go AI router, LLM gateway & 20-40% token saver. Route Claude Code, Cursor & Codex across 155 providers, 28 OAuth & 248 free models (24 keyless) — OpenAI, Claude, Gemini, DeepSeek, Groq, Ollama & MCP. First week in #llm-serving
    stars that week +199

6 repos of this ranking were removed since and are not shown: deleted from GitHub or taken out by Upstar’s review. Their ranks stay empty.

Ranks 11 to 30

  1. 11affifuddin-hazam/ghost-inferup from #34 the week before +191 stars that week
  2. 12Zyphra/ZONOS3-Mininot ranked the week before +165 stars that week
  3. 13tashfeenahmed/freellmapidown from #8 the week before +3.6k stars that week
  4. 14ashhart/TensorFoldup from #55 the week before +542 stars that week
  5. 15RainBowLuoCS/Gamernot ranked the week before +123 stars that week
  6. 16Niko1221/Stratadown from #5 the week before +2.4k stars that week
  7. 19jesdga95/basaltdown from #7 the week before +275 stars that week
  8. 20datawhalechina/zero-to-sglangup from #95 the week before +400 stars that week
  9. 21respanai/respan-gatewayup from #25 the week before +219 stars that week
  10. 22ShawnZhuge/aiottodown from #6 the week before +161 stars that week
  11. 23RustingStudio/RustingStratadown from #11 the week before +101 stars that week
  12. 24StartLuxLabs/StartLux-Prismdown from #19 the week before +158 stars that week
  13. 25adventists-ai/duplexjevnot ranked the week before +75 stars that week
  14. 26FareedKhan-dev/kimi-k3-in-cdown from #4 the week before +795 stars that week
  15. 27cheaper-inference/OmniRoutedown from #20 the week before +2.1k stars that week
  16. 28davide-troiani/moeshiftup from #56 the week before +71 stars that week
  17. 30afdEP/afdEP-commnot ranked the week before +70 stars that week
Show the other 124 repos
  1. 31xiaodou-official/xiaodou-open-platformnot ranked the week before +119 stars that week
  2. 32bitcloud-ai/Bittuneup from #40 the week before +89 stars that week
  3. 33mnfst/awesome-free-llm-apisnot ranked the week before +645 stars that week
  4. 34ThinkWatchProject/ThinkWatch-Litedown from #18 the week before +171 stars that week
  5. 35Lowaltitudeflight/local-llm-tuning-guideup from #47 the week before +53 stars that week
  6. 36christopherowen/spark-ds41fdown from #21 the week before +65 stars that week
  7. 37JakeATX/llamAmperedown from #29 the week before +84 stars that week
  8. 38bojieli/ai-infra-bookup from #85 the week before +416 stars that week
  9. 39WizisCool/oh-my-cpaup from #52 the week before +90 stars that week
  10. 40simplexai-labs/PolyStratadown from #24 the week before +146 stars that week
  11. 41openlake-project/openlakedown from #38 the week before +242 stars that week
  12. 42OpenBitSys/BitDecoding-FP4not ranked the week before +44 stars that week
  13. 43mw00/project-mayadown from #27 the week before +225 stars that week
  14. 44ggml-org/llama.cppup from #78 the week before +1.5k stars that week
  15. 45eagle-hq/EAGLE-4up from #93 the week before +137 stars that week
  16. 46yanstd888/node2mintnot ranked the week before +36 stars that week
  17. 47Tencent-Hunyuan/FlashTopKnot ranked the week before +33 stars that week
  18. 48drawthingsai/local-code-communitydown from #39 the week before +37 stars that week
  19. 49nace-ai/kapitsadown from #32 the week before +85 stars that week
  20. 50simranjeet97/AI_Engineer_Roadmap_2027not ranked the week before +31 stars that week
  21. 51incoai/splashdown from #50 the week before +142 stars that week
  22. 52Magnvs7/Promethevsdown from #12 the week before +37 stars that week
  23. 53martian56/redcellnot ranked the week before +55 stars that week
  24. 54FlashML-org/FreeTokendown from #16 the week before +369 stars that week
  25. 55shuishuipingan/qoder2api-hubup from #72 the week before +64 stars that week
  26. 56thenabbu/BharatCode-VSCode-Extensionnot ranked the week before +27 stars that week
  27. 57yqing004-boop/magpie-androidnot ranked the week before +26 stars that week
  28. 58amitshekhariitbhu/ai-engineering-courseup from #86 the week before +66 stars that week
  29. 59fosrl/pangolinup from #129 the week before +381 stars that week
  30. 60peonist-ai/halogen-flash-serverup from #70 the week before +88 stars that week
  31. 61deepseek-ai/DeepInferdown from #31 the week before +392 stars that week
  32. 62san-digital/tokspurnot ranked the week before +24 stars that week
  33. 63sii-nex/Nex-N2.6not ranked the week before +24 stars that week
  34. 64lyogavin/airllmdown from #63 the week before +474 stars that week
  35. 65ProprietaryLegal/Volta-sPLIt-DeepSeek-V4.1-Flash-1017-8xV100-SXM2-PP2xTP4not ranked the week before +23 stars that week
  36. 66ShawTim/gemini-app2apinot ranked the week before +23 stars that week
  37. 67lidge-jun/opencodexup from #98 the week before +295 stars that week
  38. 68zexadev/gemini-web2api-goup from #73 the week before +62 stars that week
  39. 69kindlingai/gr8not ranked the week before +21 stars that week
  40. 70Zihao-Wu06/distillopsdown from #22 the week before +21 stars that week
  41. 71higress-group/HiRoutedown from #59 the week before +43 stars that week
  42. 72agentgateway/agentgatewaydown from #71 the week before +159 stars that week
  43. 73decolua/9routerup from #82 the week before +362 stars that week
  44. 74patchy631/time-to-first-tokendown from #46 the week before +68 stars that week
  45. 750xShug0/audio.cppdown from #51 the week before +129 stars that week
  46. 76iffiX/neutrinonot ranked the week before +20 stars that week
  47. 77Wei-Shaw/sub2apinot ranked the week before +411 stars that week
  48. 78syv-ai/HyperQwendown from #54 the week before +98 stars that week
  49. 79trymirai/uzuup from #102 the week before +108 stars that week
  50. 80sgl-project/sglang-omniup from #104 the week before +77 stars that week
  51. 81QuantumNous/new-apisame rank as the week before +405 stars that week
  52. 82mozilla-ai/otaridown from #60 the week before +52 stars that week
  53. 83Orchestra-Research/AI-Research-SKILLsup from #92 the week before +193 stars that week
  54. 85vllm-project/vllm-omniup from #87 the week before +136 stars that week
  55. 86prabanta-dev/janasdown from #36 the week before +40 stars that week
  56. 87ForceInjection/AI-fundamentalsnot ranked the week before +89 stars that week
  57. 88BerriAI/litellmsame rank as the week before +385 stars that week
  58. 89langfuse/langfusenot ranked the week before +290 stars that week
  59. 90Indras-Mirror/Xolotldown from #69 the week before +33 stars that week
  60. 91gitleaks/gitleaksup from #100 the week before +254 stars that week
  61. 92maximhq/bifrostdown from #89 the week before +136 stars that week
  62. 93lbjlaq/Antigravity-Managerup from #111 the week before +247 stars that week
  63. 94vllm-project/vllmdown from #90 the week before +418 stars that week
  64. 95ddalcu/mlx-servedown from #75 the week before +65 stars that week
  65. 96jundot/omlxup from #99 the week before +195 stars that week
  66. 971CatAI/1Cat-vLLMup from #110 the week before +49 stars that week
  67. 98StartLuxLabs/StartLux-Decisiondown from #96 the week before +51 stars that week
  68. 99panxunying/ai-coding-welfaredown from #84 the week before +42 stars that week
  69. 100Prefrontal-AI/latent-sparse-attentiondown from #1 the week before +24 stars that week
  70. 101Calcium-Ion/AstrLinkup from #113 the week before +26 stars that week
  71. 102magnitudedev/magnitudeup from #107 the week before +96 stars that week
  72. 103verl-project/verl-omniup from #108 the week before +41 stars that week
  73. 104rednote-machine-learning/RedKnotdown from #66 the week before +59 stars that week
  74. 105Alice-Marx/dsh-model-routerdown from #13 the week before +32 stars that week
  75. 106v-modal/awesome-jev-toolsnot ranked the week before +27 stars that week
  76. 107drumih/turbo-fieldfaredown from #62 the week before +82 stars that week
  77. 108AtomicBot-ai/Atomic-Chatdown from #106 the week before +42 stars that week
  78. 109exo-explore/exoup from #133 the week before +194 stars that week
  79. 110lemonade-sdk/lemonadedown from #97 the week before +65 stars that week
  80. 111seakee/CPA-Manager-Plusup from #123 the week before +47 stars that week
  81. 112IBM/mcp-context-forgeup from #135 the week before +51 stars that week
  82. 113SemiAnalysisAI/InferenceXdown from #112 the week before +33 stars that week
  83. 114pallavi-shekhar/ai-engineering-interview-questions-company-wisedown from #109 the week before +32 stars that week
  84. 115skyzh/tiny-llmdown from #65 the week before +52 stars that week
  85. 116lightseekorg/tokenspeedup from #118 the week before +37 stars that week
  86. 117superlinked/sieup from #147 the week before +40 stars that week
  87. 118alibaba/MNNup from #119 the week before +86 stars that week
  88. 119casdoor/casdoorup from #142 the week before +79 stars that week
  89. 120vllm-project/semantic-routerup from #126 the week before +52 stars that week
  90. 121antirez/ds4up from #127 the week before +100 stars that week
  91. 122musistudio/claude-code-routerup from #130 the week before +124 stars that week
  92. 123raullenchai/Rapid-MLXup from #144 the week before +40 stars that week
  93. 124ngxson/wllamanot ranked the week before +22 stars that week
  94. 125flashinfer-ai/flashinferup from #131 the week before +49 stars that week
  95. 126LMCache/LMCacheup from #134 the week before +62 stars that week
  96. 127gpustack/gpustackdown from #121 the week before +43 stars that week
  97. 128algorithmicsuperintelligence/openevolveup from #132 the week before +48 stars that week
  98. 129antirez/h3.cdown from #128 the week before +30 stars that week
  99. 130amitshekhariitbhu/ai-engineering-interview-questionsup from #136 the week before +32 stars that week
  100. 131future-agi/future-agiup from #143 the week before +25 stars that week
  101. 132Luce-Org/luceboxnot ranked the week before +28 stars that week
  102. 133youssofal/MTPLXup from #138 the week before +26 stars that week
  103. 134vllm-project/vllm-metaldown from #120 the week before +22 stars that week
  104. 135kvcache-ai/Mooncakedown from #125 the week before +41 stars that week
  105. 136spiceai/spiceainot ranked the week before +24 stars that week
  106. 137ai-dynamo/dynamoup from #141 the week before +37 stars that week
  107. 138vllm-project/vllm-ascendup from #139 the week before +22 stars that week
  108. 139kserve/kserveup from #152 the week before +31 stars that week
  109. 140NVIDIA/TensorRT-LLMdown from #137 the week before +42 stars that week
  110. 141octelium/octeliumnot ranked the week before +22 stars that week
  111. 142ruvnet/RuVectornot ranked the week before +23 stars that week
  112. 143skypilot-org/skypilotup from #151 the week before +34 stars that week
  113. 144Portkey-AI/gatewaydown from #140 the week before +37 stars that week
  114. 145looplj/axonhubup from #149 the week before +22 stars that week
  115. 146ray-project/raynot ranked the week before +59 stars that week
  116. 147InsForge/InsForgeup from #148 the week before +32 stars that week
  117. 148openvinotoolkit/openvinoup from #150 the week before +29 stars that week
  118. 149EricLBuehler/mistral.rsdown from #146 the week before +24 stars that week
  119. 150budtmo/docker-androidup from #155 the week before +34 stars that week
  120. 151Wei-Shaw/claude-relay-servicenot ranked the week before +24 stars that week
  121. 152deepseek-ai/FlashMLAup from #153 the week before +21 stars that week
  122. 153mlc-ai/web-llmup from #158 the week before +24 stars that week
  123. 154apache/apisixup from #157 the week before +22 stars that week
  124. 155kvcache-ai/ktransformersup from #159 the week before +22 stars that week