AZ
azrtydxb/Fastllm-proxy
The lowest-overhead LLM router. Production-ready, highly available, one OpenAI-compatible endpoint in front of 80 providers and your own vLLM/SGLang — 0.76 µs per request, no I/O on the request path, cache-affinity routing, RBAC, budgets and a 13-screen UI in the binary.
Growth
- Last 24 hours
- +0
- stars
- Last 7 days
- +0
- stars
- Last 30 days
- +3
- stars
- Total stars
- 108
- 105 a month ago
- Forks
- 93
- 0 contributors
Star history
Last 12 weeks · weekly cumulative stars · created Aug 6, 2026, zero before · computed from public GitHub star events
Rank in its topics
| Topic | Today | This week | This month |
|---|---|---|---|
| Rust | – | – | – |
| Observability | – | – | – |
| Networking | – | – | – |
| LLM | – | – | – |
README
Fastllm-proxy
The lowest-overhead LLM router. Production-ready, highly available, one OpenAI-compatible endpoint in front of 80 providers and your own vLLM/SGLang — 0.76 µs per request, no I/O on the request path, cache-affinity routing, RBAC, budgets and a 13-screen UI in the binary.
Upstar hasn’t fetched this README yet. Read it on GitHub.