Upstar existe aussi en français.

Voir cette page en français

Upstar ranks the fastest-rising GitHub projects every hour, across 69 topics. Browse topics

#llm-serving · AI & ML

LLM serving

Inference engines, model servers and the gateways that route requests across model APIs.

In the last 24 hours, the top-ranked are FreeToken (+376), Infernix (+37) and Strata (+520). The 28 ranked repos gained 2,211 stars.

Updated Nov 2, 12:33 UTC · ranked every hour from GitHub’s daily star counts

Updated 19 min ago

GitHub topic ↗ (opens in new tab)

24-hour ranking

Showing 28 of 28

How Upstar ranks

  1. 1
    FlashML-org/FreeToken FreeToken brings datacenter-scale model serving to your desktop. Run massive models locally, fast and efficiently. Python Python · 15.7k total Healthy
    Gained in 24 h +376 Score 3.0 Total 15.7k
  2. 2
    Wallawalla47/Infernix C++/CUDA single-GPU inference engine for Qwen3.8 (incl. Qwen3.8-Flash-Next with offloaded experts) on the RTX 5090; grew from NInfer C++ C++ · 218 total
    Gained in 24 h +37 Score 2.8 Total 218
  3. 3
    Niko1221/Strata Qwen3.8-Flash-Next on any consumer hardware: one-click install for Windows / Linux. Strata inference engine, OpenAI/Anthropic API on localhost, optional image input. C++ C++ · 38.1k total
    Gained in 24 h +520 Score 2.7 Total 38.1k
  4. 4
    routerhubSI/uncensored-ai-api Uncensored AI API and models — one key for Claude, GPT, Gemini, Grok, DeepSeek, GLM and Qwen, with uncensored and abliterated variants where available. OpenAI- and Anthropic-compatible. Pay per token. 504 total
    Gained in 24 h +69 Score 3.3 Total 504
  5. 5
    eliasbiondo/antirion 🕷️ The fastest open-source AI Gateway and LLM Gateway — one binary with built-in console to route, secure, budget and observe every LLM call across OpenAI, Anthropic, Gemini, Bedrock and more. Rust Rust · 622 total Spotted at 95 stars
    Gained in 24 h +47 Score 2.0 Total 622
  6. 6
    jesdga95/basalt Local inference engine for Qwen3.8-Flash-Next on NVIDIA Blackwell C++ C++ · 442 total
    Gained in 24 h +24 Score 1.2 Total 442
  7. 7
    respanai/respan-gateway Open-source LLM gateway in Rust. One endpoint for OpenAI, Anthropic, Gemini and every other vendor. Any SDK, any model, any tool. Rust Rust · 487 total
    Gained in 24 h +25 Score 1.2 Total 487
  8. 8
    ddalcu/mlx-serve Native LLM inference server for Apple Silicon. OpenAI + Anthropic API compatible. No Python. Zig backend, Swift frontend macOS app with chat, music, voice, video generation. Zig Zig · 2.3k total Healthy
    Gained in 24 h +55 Score 1.2 Total 2.3k
  9. 9
    Alice-Marx/dsh-model-router Model Router and GALGame plugin for DeepSeek Harness JavaScript JavaScript · 623 total Healthy
    Gained in 24 h +25 Score 1.0 Total 623
  10. 10
    deepseek-ai/DeepInfer DeepInfer: High-performance, large-scale inference framework for DeepSeek models Python Python · 24.9k total
    Gained in 24 h +144 Score 0.9 Total 24.9k
  11. 11
    cheaper-inference/OmniRoute Never stop coding. Free MIT AI gateway: one endpoint, 375 providers (150+ free), 1,400+ models Kimi, Claude, GPT, Gemini, GLM, DeepSeek, MiniMax. Works with Claude Code, Codex, Cursor, OpenCode, Cline & Copilot. Quota-aware auto-fallback, RTK+Caveman compression saves 15-95% tokens, MCP/A2A… TypeScript TypeScript · 83.7k total Healthy
    Gained in 24 h +242 Score 0.8 Total 83.7k
  12. 12
    NVIDIA/spark-local-inference Rust Rust · 743 total
    Gained in 24 h +22 Score 0.8 Total 743
  13. 13
    VecSzn/PolyStrata Run large AI models on your own PC: Qwen3.8-Flash-Next on Strata's engine, and GLM 5.3 Flash, DeepSeek V4 Flash, LFM2.5, Qwen3.6, Ornith 1.5, Gemma 4, Tiel Coder and MiniCPM-V on a second engine written for PolyStrata. One-click install for Windows and Linux, OpenAI/Anthropic API on localhost. C++ C++ · 760 total Spotted at 196 stars
    Gained in 24 h +21 Score 0.8 Total 760
  14. 14
    mnfst/awesome-free-llm-apis List of Permanent Free LLM API (API Keys) JavaScript JavaScript · 12k total Mixed signals
    Gained in 24 h +70 Score 0.6 Total 12k
  15. 15
    mw00/project-maya Project Maya - run GLM-5.3-Flash (321B MoE), DeepSeek-V4.1-Flash-1017 (748B MoE) and MiniMax-M3.1-Flash (428B MoE) privately on your own GPU(s), from one card to 16, NVIDIA or AMD, Linux or Windows. Engine, server, dashboard, OpenAI- and Anthropic-compatible API, quant tools. Cuda Cuda · 2.4k total Spotted at 762 stars
    Gained in 24 h +26 Score 0.5 Total 2.4k
  16. 16
    lyogavin/airllm AirLLM 2.8T LLM inference with single 4GB GPU Jupyter Notebook Jupyter Notebook · 41.6k total Healthy
    Gained in 24 h +79 Score 0.4 Total 41.6k
  17. 17
    agentgateway/agentgateway Next Generation Agentic Proxy for AI Agents and MCP servers Rust Rust · 5.9k total Healthy
    Gained in 24 h +20 Score 0.3 Total 5.9k
  18. 18
    ggml-org/llama.cpp LLM inference in C/C++ C++ C++ · 133k total Healthy
    Gained in 24 h +82 Score 0.2 Total 133k
  19. 19
    decolua/9router Unlimited FREE AI coding. Connect Claude Code, Codex, Cursor, Cline, Copilot, Antigravity to FREE Claude/GPT/Gemini via 40+ providers. Auto-fallback, RTK -40% tokens, never hit limits. JavaScript JavaScript · 31.8k total Healthy
    Gained in 24 h +40 Score 0.2 Total 31.8k
  20. 20
    QuantumNous/new-api Open-source AI gateway. Self-hosted LLM gateway with OpenAI-, Claude- and Gemini-compatible APIs, model routing, access control, usage tracking and cost accounting. Go Go · 51.2k total Healthy
    Gained in 24 h +50 Score 0.2 Total 51.2k
  21. 21
    maximhq/bifrost Open-source, high-performance AI gateway that works as your LLM gateway, MCP gateway and agent gateway. One OpenAI-compatible API for 10,000+ models, with failover, load balancing, semantic caching, virtual keys, budgets and MCP Code Mode. Works with any SDK or agent and adds under 200µs of… Go Go · 9.3k total Healthy
    Gained in 24 h +21 Score 0.2 Total 9.3k
  22. 22
    vllm-project/vllm A high-throughput and memory-efficient inference and serving engine for LLMs Python Python · 96.1k total Healthy
    Gained in 24 h +61 Score 0.2 Total 96.1k
  23. 23
    Orchestra-Research/AI-Research-SKILLs Comprehensive open-source library of AI research and engineering skills for any AI model. Package the skills and your claude code/codex/gemini agent will be an AI research agent with full horsepower. Maintained by Orchestra Research. TeX TeX · 14.2k total Low activity
    Gained in 24 h +21 Score 0.2 Total 14.2k
  24. 24
    lidge-jun/opencodex Universal provider proxy for OpenAI Codex & Claude Code — use any LLM (Claude, Gemini, Grok, DeepSeek, Ollama…) with Codex CLI, App, SDK, and Claude Code TypeScript TypeScript · 18.2k total Healthy
    Gained in 24 h +23 Score 0.2 Total 18.2k
  25. 25
    jundot/omlx LLM inference server with continuous batching & SSD caching for Apple Silicon — managed from the macOS menu bar Python Python · 23.3k total Healthy
    Gained in 24 h +25 Score 0.2 Total 23.3k
  26. 26
    BerriAI/litellm The fastest, litest AI Gateway. Rust core with Python SDK. Call 100+ LLM APIs in OpenAI (or native) format with cost tracking, guardrails, load balancing, and logging [Bedrock, Azure, OpenAI, Anthropic, OpenAI, VertexAI, vLLM, Nvidia NIM] Python Python · 62.5k total Healthy
    Gained in 24 h +40 Score 0.2 Total 62.5k
  27. 27
    gitleaks/gitleaks Find secrets with Gitleaks 🔑 Go Go · 30.6k total Low activity
    Gained in 24 h +24 Score 0.1 Total 30.6k
  28. 28
    lbjlaq/Antigravity-Manager Professional Antigravity Account Manager & Switcher. One-click seamless account switching for Antigravity Tools. Built with Tauri v2 + React (Rust).专业的 Antigravity 账号管理与切换工具。为 Antigravity 提供一键无缝账号切换功能。 Rust Rust · 32.8k total Healthy
    Gained in 24 h +22 Score 0.1 Total 32.8k

Emerging in LLM serving Past weeks: Oct 26Oct 19