Upstar existe aussi en français.

Voir cette page en français

Upstar ranks the fastest-rising GitHub projects every hour, across 69 topics. Browse topics

#llm-serving · AI & ML

LLM serving

Inference engines, model servers and the gateways that route requests across model APIs.

This week (Oct 27 – Nov 2), the top-ranked are Strata (+4,688), resin (+212) and antirion (+296). The 151 ranked repos gained 27,425 stars, 49% fewer than the week before.

Updated Nov 2, 11:35 UTC · ranked every hour from GitHub’s daily star counts

Updated 38 min ago

GitHub topic ↗ (opens in new tab)

This week’s ranking

Showing 10 of 152

How Upstar ranks

Full ranking, with the repositories hidden by default. Back to the ranking

  1. 1
    Niko1221/Strata Qwen3.8-Flash-Next on any consumer hardware: one-click install for Windows / Linux. Strata inference engine, OpenAI/Anthropic API on localhost, optional image input. C++ C++ · 38.1k total
    Gained in 7 d +4.7k Score 25.7 Total 38.1k
  2. 2
    ekzhang/resin 🧱 Experimental library for building inference engines Python Python · 368 total Mixed signals
    Gained in 7 d +212 Score 17.0 Total 368
  3. 3
    eliasbiondo/antirion 🕷️ The fastest open-source AI Gateway and LLM Gateway — one binary with built-in console to route, secure, budget and observe every LLM call across OpenAI, Anthropic, Gemini, Bedrock and more. Rust Rust · 615 total Spotted at 95 stars
    Gained in 7 d +296 Score 16.6 Total 615
  4. 4
    StartLuxLabs/StartLux-Prism Fast, exact inference for StartLux-Decision models on NVIDIA GPUs: the released GGUF files on int8 and 4-bit tensor cores, behind the /v1/systemone API, with up to 5.3× lower latency than vLLM in FP8 and bit-identical answers. Python Python · 236 total
    Gained in 7 d +147 Score 14.7 Total 236
  5. 5
    jesdga95/basalt Local inference engine for Qwen3.8-Flash-Next on NVIDIA Blackwell C++ C++ · 442 total
    Gained in 7 d +215 Score 14.3 Total 442
  6. 6
    deepseek-ai/DeepInfer DeepInfer: High-performance, large-scale inference framework for DeepSeek models Python Python · 24.9k total
    Gained in 7 d +2.1k Score 13.9 Total 24.9k
  7. 7
    NerverDevs/nervecenter new-api / sub2api 中转站账号管理中心：余额、API Key、用量、倍率、模型比价 | https://nvcenter.cc TypeScript TypeScript · 198 total
    Gained in 7 d +137 Score 13.7 Total 198
  8. 8
    trymirai/uzu A high-performance inference engine for AI models Rust Rust · 3.2k total Healthy
    Gained in 7 d +597 Score 11.7 Total 3.2k
  9. 9
    Alice-Marx/dsh-model-router Model Router and GALGame plugin for DeepSeek Harness JavaScript JavaScript · 623 total Healthy
    Gained in 7 d +221 Score 11.0 Total 623
  10. 10
    skyzh/tiny-llm learn LLM inference system on Apple Silicon for systems engineers: build a tiny vLLM + Qwen Python Python · 5.5k total Healthy
    Gained in 7 d +730 Score 10.6 Total 5.5k
Show more

Emerging in LLM serving Past weeks: Oct 26Oct 19