Upstar existe aussi en français.

Voir cette page en français

Upstar ranks the fastest-rising GitHub projects every hour, across 69 topics. Browse topics

#llm-serving · AI & ML

LLM serving

Inference engines, model servers and the gateways that route requests across model APIs.

This month (Oct 4 – Nov 2), the top-ranked are DeepInfer (+24,947), Strata (+29,321) and project-maya (+2,394). The 332 ranked repos gained 152,190 stars.

Updated Nov 2, 12:33 UTC · ranked every hour from GitHub’s daily star counts

Updated 51 min ago

GitHub topic ↗ (opens in new tab)

This month’s ranking

Showing 10 of 334

How Upstar ranks

Full ranking, with the repositories hidden by default. Back to the ranking

  1. 1
    deepseek-ai/DeepInfer DeepInfer: High-performance, large-scale inference framework for DeepSeek models Python Python · 24.9k total
    Gained in 30 d +24.9k Score 2,494.7 Total 24.9k
  2. 2
    Niko1221/Strata Qwen3.8-Flash-Next on any consumer hardware: one-click install for Windows / Linux. Strata inference engine, OpenAI/Anthropic API on localhost, optional image input. C++ C++ · 38.1k total
    Gained in 30 d +29.3k Score 313.0 Total 38.1k
  3. 3
    mw00/project-maya Project Maya - run GLM-5.3-Flash (321B MoE), DeepSeek-V4.1-Flash-1017 (748B MoE) and MiniMax-M3.1-Flash (428B MoE) privately on your own GPU(s), from one card to 16, NVIDIA or AMD, Linux or Windows. Engine, server, dashboard, OpenAI- and Anthropic-compatible API, quant tools. Cuda Cuda · 2.4k total Spotted at 762 stars
    Gained in 30 d +2.4k Score 239.4 Total 2.4k
  4. 4
    StartLuxLabs/StartLux-Decision Open decision models from 0.8B to 27B: a calibrated probability for every option in one pass, and a short thought only when unsure. Engine for vLLM, llama.cpp and MLX. Python Python · 1.6k total Spotted at 644 stars
    Gained in 30 d +1.5k Score 118.0 Total 1.6k
  5. 5
    eagle-hq/EAGLE-4 Official Inference Code of EAGLE-4 Python Python · 1.1k total
    Gained in 30 d +1.1k Score 111.3 Total 1.1k
  6. 6
    VecSzn/PolyStrata Run large AI models on your own PC: Qwen3.8-Flash-Next on Strata's engine, and GLM 5.3 Flash, DeepSeek V4 Flash, LFM2.5, Qwen3.6, Ornith 1.5, Gemma 4, Tiel Coder and MiniCPM-V on a second engine written for PolyStrata. One-click install for Windows and Linux, OpenAI/Anthropic API on localhost. C++ C++ · 760 total Spotted at 196 stars
    Gained in 30 d +760 Score 76.0 Total 760
  7. 7
    NVIDIA/spark-local-inference Rust Rust · 743 total
    Gained in 30 d +743 Score 74.3 Total 743
  8. 8
    Alice-Marx/dsh-model-router Model Router and GALGame plugin for DeepSeek Harness JavaScript JavaScript · 623 total Healthy
    Gained in 30 d +623 Score 62.3 Total 623
  9. 9
    eliasbiondo/antirion 🕷️ The fastest open-source AI Gateway and LLM Gateway — one binary with built-in console to route, secure, budget and observe every LLM call across OpenAI, Anthropic, Gemini, Bedrock and more. Rust Rust · 622 total Spotted at 95 stars
    Gained in 30 d +622 Score 62.2 Total 622
  10. 10
    nace-ai/kapitsa Blazing fast Apple Silicon optimized inference engine built for Qwen & Nemotron. OpenAI + Anthropic API compatible. Built by folks from nace.ai C++ C++ · 595 total
    Gained in 30 d +595 Score 59.5 Total 595
Show more

Emerging in LLM serving Past weeks: Oct 26Oct 19