vllm-mlx
High-performance OpenAI and Anthropic compatible LLM inference server for Apple Silicon. Native MLX, continuous batching, multimodal models, MCP tool calling, and Claude Code support.
- 1.6k stars
- 233 forks
- 101 open issues
- Language: Python
- License: Apache-2.0
- updated
Install
git clone https://github.com/waybarrios/vllm-mlx- Clone the repository.
- Follow the README for installation and usage instructions.
Tools overview
What people ask about vllm-mlx
What is waybarrios/vllm-mlx?
waybarrios/vllm-mlx is tools for the Claude AI ecosystem. High-performance OpenAI and Anthropic compatible LLM inference server for Apple Silicon. Native MLX, continuous batching, multimodal models, MCP tool calling, and Claude Code support. It has 1.6k GitHub stars and its last recorded update is dated 2026-10-20.
How do I install vllm-mlx?
You can install vllm-mlx by cloning the repository (https://github.com/waybarrios/vllm-mlx) or following the README instructions on GitHub. ClaudeWave also provides quick install blocks on this page.
Is waybarrios/vllm-mlx safe to use?
Our security agent has analyzed waybarrios/vllm-mlx and assigned a Trust Score of 97/100 (tier: Verified). See the full breakdown of passed checks and flags on this page.
Who maintains waybarrios/vllm-mlx?
waybarrios/vllm-mlx is maintained by waybarrios. The last recorded GitHub activity is dated 2026-10-20, with 101 open issues.
Are there alternatives to vllm-mlx?
Yes. On ClaudeWave you can browse similar tools at /categories/tools, sorted by popularity or recent activity.