vllm-project /

vllm-metal

Community maintained hardware plugin for vLLM on Apple Silicon

#82 in Local LLMs Python 1,943 stars

Updated 2 min ago

+32 stars gained this week

Stars gained each day, last 30 days

Usual pace · 5 / day

Oct 4Oct 19Today

This week Before Usual pace

vllm-metal runs as a vLLM plugin with MLX as the compute backend, so you serve models through vLLM's usual interface and commands.

Summary written by AI from the repository’s description and README.

vllm-project / vllm-metal