#llm-serving
LLM serving on GitHub, November 9–15, 2026
In LLM serving, 155 repos ranked the week of November 9 and gained 39,606 stars between them, 9% more than the week before. RunanywhereAI/trnrt, new to the topic, went straight to #1 with 1,570 stars gained. The top 10 had 8 repos that were not in it the week before, among them OmniJev/Flide at #2, up from #76. basetenlabs/deepseek-ultrafast, at #3, was one of the 30 repos ranked in the topic for the first time that week.
The ranking as the week’s last hourly run left it, on November 16 at 00:00 UTC. It does not change.
- repos ranked
- 155
- stars gained +9% vs the week before
- 39,606
- new in the top 10
- 8 of 10
- ranked in #llm-serving for the first time
- 30
The top 10
Ordered by stars gained over the seven days relative to each repo’s size, which is why a repo can rank above one that gained more.
- 1RunanywhereAI/trnrt The open LLM inference engine for AWS Trainium: NKI megakernels, 1M-token context, OpenAI-compatible API. By RunAnywhere.stars that week +1.6k
- 2OmniJev/Flide 🔥🔥 The extremely fast inference engine for decision modelstars that week +471
- 3stars that week +407
- 5huawei-csl/MACaQ SOTA model-agnostic quantization for GGUF, local inference and beyond. Quantize and run text, image, video and audio models with llama.cpp, vLLM, Diffusers and PyTorch.stars that week +311
- 6synchopate/llama-modchip Run 284B DeepSeek-V4-Flash (<59GiB RAM: 41.1 cold pp, 9.1 N=1 tg, up to 25.3 spec tok/s) & 30B MoEs (22.4 N=1 / 111.6 spec tok/s) on 64GB CPU (0 GPUs).stars that week +691
- 8Continuum-AI-Corp/OrcaRouter-Lite Self-hosted LLM router with a managed safety net. OpenAI-compatible. BYOK. Single-workspace. Streaming. For more advanced routing choose hosted OrcaRouterstars that week +1.1k
- 9yetone/magpie Every agent's model. One place. Codex on DeepSeek, Claude Code on Kimi, from the menu bar.stars that week +4.3k
- 10yanstd888/9routerx 9RouterX (9R Next Go Generation): Single-binary Go AI router, LLM gateway & 20-40% token saver. Route Claude Code, Cursor & Codex across 155 providers, 28 OAuth & 248 free models (24 keyless) — OpenAI, Claude, Gemini, DeepSeek, Groq, Ollama & MCP.stars that week +199
6 repos of this ranking were removed since and are not shown: deleted from GitHub or taken out by Upstar’s review. Their ranks stay empty.
Ranks 11 to 30
- 11affifuddin-hazam/ghost-inferup from #34 the week before +191 stars that week
- 12Zyphra/ZONOS3-Mininot ranked the week before +165 stars that week
- 13tashfeenahmed/freellmapidown from #8 the week before +3.6k stars that week
- 14ashhart/TensorFoldup from #55 the week before +542 stars that week
- 15RainBowLuoCS/Gamernot ranked the week before +123 stars that week
- 16Niko1221/Stratadown from #5 the week before +2.4k stars that week
- 19jesdga95/basaltdown from #7 the week before +275 stars that week
- 20datawhalechina/zero-to-sglangup from #95 the week before +400 stars that week
- 21respanai/respan-gatewayup from #25 the week before +219 stars that week
- 22ShawnZhuge/aiottodown from #6 the week before +161 stars that week
- 23RustingStudio/RustingStratadown from #11 the week before +101 stars that week
- 24StartLuxLabs/StartLux-Prismdown from #19 the week before +158 stars that week
- 25adventists-ai/duplexjevnot ranked the week before +75 stars that week
- 26FareedKhan-dev/kimi-k3-in-cdown from #4 the week before +795 stars that week
- 27cheaper-inference/OmniRoutedown from #20 the week before +2.1k stars that week
- 28davide-troiani/moeshiftup from #56 the week before +71 stars that week
- 30afdEP/afdEP-commnot ranked the week before +70 stars that week
Show the other 124 repos
- 31xiaodou-official/xiaodou-open-platformnot ranked the week before +119 stars that week
- 32bitcloud-ai/Bittuneup from #40 the week before +89 stars that week
- 33mnfst/awesome-free-llm-apisnot ranked the week before +645 stars that week
- 34ThinkWatchProject/ThinkWatch-Litedown from #18 the week before +171 stars that week
- 35Lowaltitudeflight/local-llm-tuning-guideup from #47 the week before +53 stars that week
- 36christopherowen/spark-ds41fdown from #21 the week before +65 stars that week
- 37JakeATX/llamAmperedown from #29 the week before +84 stars that week
- 38bojieli/ai-infra-bookup from #85 the week before +416 stars that week
- 39WizisCool/oh-my-cpaup from #52 the week before +90 stars that week
- 40simplexai-labs/PolyStratadown from #24 the week before +146 stars that week
- 41openlake-project/openlakedown from #38 the week before +242 stars that week
- 42OpenBitSys/BitDecoding-FP4not ranked the week before +44 stars that week
- 43mw00/project-mayadown from #27 the week before +225 stars that week
- 44ggml-org/llama.cppup from #78 the week before +1.5k stars that week
- 45eagle-hq/EAGLE-4up from #93 the week before +137 stars that week
- 46yanstd888/node2mintnot ranked the week before +36 stars that week
- 47Tencent-Hunyuan/FlashTopKnot ranked the week before +33 stars that week
- 48drawthingsai/local-code-communitydown from #39 the week before +37 stars that week
- 49nace-ai/kapitsadown from #32 the week before +85 stars that week
- 50simranjeet97/AI_Engineer_Roadmap_2027not ranked the week before +31 stars that week
- 51incoai/splashdown from #50 the week before +142 stars that week
- 52Magnvs7/Promethevsdown from #12 the week before +37 stars that week
- 53martian56/redcellnot ranked the week before +55 stars that week
- 54FlashML-org/FreeTokendown from #16 the week before +369 stars that week
- 55shuishuipingan/qoder2api-hubup from #72 the week before +64 stars that week
- 56thenabbu/BharatCode-VSCode-Extensionnot ranked the week before +27 stars that week
- 57yqing004-boop/magpie-androidnot ranked the week before +26 stars that week
- 58amitshekhariitbhu/ai-engineering-courseup from #86 the week before +66 stars that week
- 59fosrl/pangolinup from #129 the week before +381 stars that week
- 60peonist-ai/halogen-flash-serverup from #70 the week before +88 stars that week
- 61deepseek-ai/DeepInferdown from #31 the week before +392 stars that week
- 62san-digital/tokspurnot ranked the week before +24 stars that week
- 63sii-nex/Nex-N2.6not ranked the week before +24 stars that week
- 64lyogavin/airllmdown from #63 the week before +474 stars that week
- 65ProprietaryLegal/Volta-sPLIt-DeepSeek-V4.1-Flash-1017-8xV100-SXM2-PP2xTP4not ranked the week before +23 stars that week
- 66ShawTim/gemini-app2apinot ranked the week before +23 stars that week
- 67lidge-jun/opencodexup from #98 the week before +295 stars that week
- 68zexadev/gemini-web2api-goup from #73 the week before +62 stars that week
- 69kindlingai/gr8not ranked the week before +21 stars that week
- 70Zihao-Wu06/distillopsdown from #22 the week before +21 stars that week
- 71higress-group/HiRoutedown from #59 the week before +43 stars that week
- 72agentgateway/agentgatewaydown from #71 the week before +159 stars that week
- 73decolua/9routerup from #82 the week before +362 stars that week
- 74patchy631/time-to-first-tokendown from #46 the week before +68 stars that week
- 750xShug0/audio.cppdown from #51 the week before +129 stars that week
- 76iffiX/neutrinonot ranked the week before +20 stars that week
- 77Wei-Shaw/sub2apinot ranked the week before +411 stars that week
- 78syv-ai/HyperQwendown from #54 the week before +98 stars that week
- 79trymirai/uzuup from #102 the week before +108 stars that week
- 80sgl-project/sglang-omniup from #104 the week before +77 stars that week
- 81QuantumNous/new-apisame rank as the week before +405 stars that week
- 82mozilla-ai/otaridown from #60 the week before +52 stars that week
- 83Orchestra-Research/AI-Research-SKILLsup from #92 the week before +193 stars that week
- 85vllm-project/vllm-omniup from #87 the week before +136 stars that week
- 86prabanta-dev/janasdown from #36 the week before +40 stars that week
- 87ForceInjection/AI-fundamentalsnot ranked the week before +89 stars that week
- 88BerriAI/litellmsame rank as the week before +385 stars that week
- 89langfuse/langfusenot ranked the week before +290 stars that week
- 90Indras-Mirror/Xolotldown from #69 the week before +33 stars that week
- 91gitleaks/gitleaksup from #100 the week before +254 stars that week
- 92maximhq/bifrostdown from #89 the week before +136 stars that week
- 93lbjlaq/Antigravity-Managerup from #111 the week before +247 stars that week
- 94vllm-project/vllmdown from #90 the week before +418 stars that week
- 95ddalcu/mlx-servedown from #75 the week before +65 stars that week
- 96jundot/omlxup from #99 the week before +195 stars that week
- 971CatAI/1Cat-vLLMup from #110 the week before +49 stars that week
- 98StartLuxLabs/StartLux-Decisiondown from #96 the week before +51 stars that week
- 99panxunying/ai-coding-welfaredown from #84 the week before +42 stars that week
- 100Prefrontal-AI/latent-sparse-attentiondown from #1 the week before +24 stars that week
- 101Calcium-Ion/AstrLinkup from #113 the week before +26 stars that week
- 102magnitudedev/magnitudeup from #107 the week before +96 stars that week
- 103verl-project/verl-omniup from #108 the week before +41 stars that week
- 104rednote-machine-learning/RedKnotdown from #66 the week before +59 stars that week
- 105Alice-Marx/dsh-model-routerdown from #13 the week before +32 stars that week
- 106v-modal/awesome-jev-toolsnot ranked the week before +27 stars that week
- 107drumih/turbo-fieldfaredown from #62 the week before +82 stars that week
- 108AtomicBot-ai/Atomic-Chatdown from #106 the week before +42 stars that week
- 109exo-explore/exoup from #133 the week before +194 stars that week
- 110lemonade-sdk/lemonadedown from #97 the week before +65 stars that week
- 111seakee/CPA-Manager-Plusup from #123 the week before +47 stars that week
- 112IBM/mcp-context-forgeup from #135 the week before +51 stars that week
- 113SemiAnalysisAI/InferenceXdown from #112 the week before +33 stars that week
- 114pallavi-shekhar/ai-engineering-interview-questions-company-wisedown from #109 the week before +32 stars that week
- 115skyzh/tiny-llmdown from #65 the week before +52 stars that week
- 116lightseekorg/tokenspeedup from #118 the week before +37 stars that week
- 117superlinked/sieup from #147 the week before +40 stars that week
- 118alibaba/MNNup from #119 the week before +86 stars that week
- 119casdoor/casdoorup from #142 the week before +79 stars that week
- 120vllm-project/semantic-routerup from #126 the week before +52 stars that week
- 121antirez/ds4up from #127 the week before +100 stars that week
- 122musistudio/claude-code-routerup from #130 the week before +124 stars that week
- 123raullenchai/Rapid-MLXup from #144 the week before +40 stars that week
- 124ngxson/wllamanot ranked the week before +22 stars that week
- 125flashinfer-ai/flashinferup from #131 the week before +49 stars that week
- 126LMCache/LMCacheup from #134 the week before +62 stars that week
- 127gpustack/gpustackdown from #121 the week before +43 stars that week
- 128algorithmicsuperintelligence/openevolveup from #132 the week before +48 stars that week
- 129antirez/h3.cdown from #128 the week before +30 stars that week
- 130amitshekhariitbhu/ai-engineering-interview-questionsup from #136 the week before +32 stars that week
- 131future-agi/future-agiup from #143 the week before +25 stars that week
- 132Luce-Org/luceboxnot ranked the week before +28 stars that week
- 133youssofal/MTPLXup from #138 the week before +26 stars that week
- 134vllm-project/vllm-metaldown from #120 the week before +22 stars that week
- 135kvcache-ai/Mooncakedown from #125 the week before +41 stars that week
- 136spiceai/spiceainot ranked the week before +24 stars that week
- 137ai-dynamo/dynamoup from #141 the week before +37 stars that week
- 138vllm-project/vllm-ascendup from #139 the week before +22 stars that week
- 139kserve/kserveup from #152 the week before +31 stars that week
- 140NVIDIA/TensorRT-LLMdown from #137 the week before +42 stars that week
- 141octelium/octeliumnot ranked the week before +22 stars that week
- 142ruvnet/RuVectornot ranked the week before +23 stars that week
- 143skypilot-org/skypilotup from #151 the week before +34 stars that week
- 144Portkey-AI/gatewaydown from #140 the week before +37 stars that week
- 145looplj/axonhubup from #149 the week before +22 stars that week
- 146ray-project/raynot ranked the week before +59 stars that week
- 147InsForge/InsForgeup from #148 the week before +32 stars that week
- 148openvinotoolkit/openvinoup from #150 the week before +29 stars that week
- 149EricLBuehler/mistral.rsdown from #146 the week before +24 stars that week
- 150budtmo/docker-androidup from #155 the week before +34 stars that week
- 151Wei-Shaw/claude-relay-servicenot ranked the week before +24 stars that week
- 152deepseek-ai/FlashMLAup from #153 the week before +21 stars that week
- 153mlc-ai/web-llmup from #158 the week before +24 stars that week
- 154apache/apisixup from #157 the week before +22 stars that week
- 155kvcache-ai/ktransformersup from #159 the week before +22 stars that week