Upstar existe aussi en français.

Voir cette page en français

Upstar ranks the fastest-rising GitHub projects every hour, across 69 topics. Browse topics

#llm-serving · AI & ML

LLM serving

Inference engines, model servers and the gateways that route requests across model APIs.

In the last 24 hours, the top-ranked are FreeToken (+400), Strata (+525) and antirion (+43). The 26 ranked repos gained 2,230 stars.

Updated Nov 2, 11:35 UTC · ranked every hour from GitHub’s daily star counts

Updated 37 min ago

GitHub topic ↗ (opens in new tab)

24-hour ranking

Showing 10 of 26

How Upstar ranks

  1. 1
    FlashML-org/FreeToken FreeToken brings datacenter-scale model serving to your desktop. Run massive models locally, fast and efficiently. Python Python · 15.7k total Healthy
    Gained in 24 h +400 Score 3.2 Total 15.7k
  2. 2
    Niko1221/Strata Qwen3.8-Flash-Next on any consumer hardware: one-click install for Windows / Linux. Strata inference engine, OpenAI/Anthropic API on localhost, optional image input. C++ C++ · 38.1k total
    Gained in 24 h +525 Score 2.7 Total 38.1k
  3. 3
    eliasbiondo/antirion 🕷️ The fastest open-source AI Gateway and LLM Gateway — one binary with built-in console to route, secure, budget and observe every LLM call across OpenAI, Anthropic, Gemini, Bedrock and more. Rust Rust · 615 total Spotted at 95 stars
    Gained in 24 h +43 Score 1.8 Total 615
  4. 4
    routerhubSI/uncensored-ai-api Uncensored AI API and models — one key for Claude, GPT, Gemini, Grok, DeepSeek, GLM and Qwen, with uncensored and abliterated variants where available. OpenAI- and Anthropic-compatible. Pay per token. 504 total
    Gained in 24 h +74 Score 3.6 Total 504
  5. 5
    jesdga95/basalt Local inference engine for Qwen3.8-Flash-Next on NVIDIA Blackwell C++ C++ · 442 total
    Gained in 24 h +26 Score 1.3 Total 442
  6. 6
    ddalcu/mlx-serve Native LLM inference server for Apple Silicon. OpenAI + Anthropic API compatible. No Python. Zig backend, Swift frontend macOS app with chat, music, voice, video generation. Zig Zig · 2.3k total Healthy
    Gained in 24 h +59 Score 1.2 Total 2.3k
  7. 7
    respanai/respan-gateway Open-source LLM gateway in Rust. One endpoint for OpenAI, Anthropic, Gemini and every other vendor. Any SDK, any model, any tool. Rust Rust · 487 total
    Gained in 24 h +26 Score 1.2 Total 487
  8. 8
    Alice-Marx/dsh-model-router Model Router and GALGame plugin for DeepSeek Harness JavaScript JavaScript · 623 total Healthy
    Gained in 24 h +27 Score 1.1 Total 623
  9. 9
    deepseek-ai/DeepInfer DeepInfer: High-performance, large-scale inference framework for DeepSeek models Python Python · 24.9k total
    Gained in 24 h +153 Score 1.0 Total 24.9k
  10. 10
    cheaper-inference/OmniRoute Never stop coding. Free MIT AI gateway: one endpoint, 375 providers (150+ free), 1,400+ models Kimi, Claude, GPT, Gemini, GLM, DeepSeek, MiniMax. Works with Claude Code, Codex, Cursor, OpenCode, Cline & Copilot. Quota-aware auto-fallback, RTK+Caveman compression saves 15-95% tokens, MCP/A2A… TypeScript TypeScript · 83.7k total Healthy
    Gained in 24 h +259 Score 0.9 Total 83.7k
Show more

Emerging in LLM serving Past weeks: Oct 26Oct 19