System Level Intelligent Router for Mixture-of-Models at Cloud, Data Center and Edge
vLLM Semantic Router is a signal-driven routing layer, written in Go with Rust components via Hugging Face Candle, that directs incoming LLM workloads to the most appropriate model across cloud, data center, and edge deployments. It exposes an MCP server interface, allowing Claude and other MCP-compatible clients to interact with its routing infrastructure. The system performs real-time classification using BERT-based models to detect jailbreaks, PII leakage, and hallucinations before or after inference, and applies category-aware semantic caching to reduce redundant token generation. A LoRA-extensible architecture lets teams fine-tune routing classifiers for domain-specific workloads without retraining from scratch. Kubernetes-native deployment is supported alongside a Prompt Guard feature that intercepts unsafe inputs. The project targets platform engineers, MLOps teams, and enterprises running heterogeneous model fleets who need cost control, privacy boundary enforcement, and safety guardrails across a mixture-of-models setup rather than a single fixed endpoint.
- ✓Open-source license (Apache-2.0)
- ✓Actively maintained (<30d)
- ✓Healthy fork ratio
- ✓Clear description
- ✓Topics declared
- ✓Documented (README)
git clone https://github.com/vllm-project/semantic-router{
"mcpServers": {
"semantic-router": {
"command": "semantic-router"
}
}
}MCP Servers overview
What people ask about semantic-router
What is vllm-project/semantic-router?
+
vllm-project/semantic-router is mcp servers for the Claude AI ecosystem. System Level Intelligent Router for Mixture-of-Models at Cloud, Data Center and Edge It has 4.3k GitHub stars and was last updated today.
How do I install semantic-router?
+
You can install semantic-router by cloning the repository (https://github.com/vllm-project/semantic-router) or following the README instructions on GitHub. ClaudeWave also provides quick install blocks on this page.
Is vllm-project/semantic-router safe to use?
+
Our security agent has analyzed vllm-project/semantic-router and assigned a Trust Score of 100/100 (tier: Verified). See the full breakdown of passed checks and flags on this page.
Who maintains vllm-project/semantic-router?
+
vllm-project/semantic-router is maintained by vllm-project. The last recorded GitHub activity is from today, with 205 open issues.
Are there alternatives to semantic-router?
+
Yes. On ClaudeWave you can browse similar mcp servers at /categories/mcp, sorted by popularity or recent activity.
Deploy semantic-router to your cloud
Ship this repo to production in minutes. Each platform spins up its own environment with editable env vars.
Maintain this repo? Add a badge to your README
Drop the badge into your GitHub README to show it's tracked on ClaudeWave. Each badge links back to this page and reflects the live Trust Score.
[](https://claudewave.com/repo/vllm-project-semantic-router)<a href="https://claudewave.com/repo/vllm-project-semantic-router"><img src="https://claudewave.com/api/badge/vllm-project-semantic-router" alt="Featured on ClaudeWave: vllm-project/semantic-router" width="320" height="64" /></a>More MCP Servers
Fair-code workflow automation platform with native AI capabilities. Combine visual building with custom code, self-host or cloud, 400+ integrations.
User-friendly AI Interface (Supports Ollama, OpenAI API, ...)
An open-source AI agent that brings the power of Gemini directly into your terminal.
The fastest path to AI-powered full stack observability, even for lean teams.
🕷️ An adaptive Web Scraping framework that handles everything from a single request to a full-scale crawl!
⭐AI-driven public opinion & trend monitor with multi-platform aggregation, RSS, and smart alerts.🎯 告别信息过载，你的 AI 舆情监控助手与热点筛选工具！聚合多平台热点 + RSS 订阅，支持关键词精准筛选。AI 智能筛选新闻 + AI 翻译 + AI 分析简报直推手机，也支持接入 MCP 架构，赋能 AI 自然语言对话分析、情感洞察与趋势预测等。支持 Docker ，数据本地/云端自持。集成微信/飞书/钉钉/Telegram/邮件/ntfy/bark/slack 等渠道智能推送。