System Level Intelligent Router for Mixture-of-Models at Cloud, Data Center and Edge
vLLM Semantic Router is a signal-driven routing layer, written in Go with Rust components via Hugging Face Candle, that directs incoming LLM workloads to the most appropriate model across cloud, data center, and edge deployments. It exposes an MCP server interface, allowing Claude and other MCP-compatible clients to interact with its routing infrastructure. The system performs real-time classification using BERT-based models to detect jailbreaks, PII leakage, and hallucinations before or after inference, and applies category-aware semantic caching to reduce redundant token generation. A LoRA-extensible architecture lets teams fine-tune routing classifiers for domain-specific workloads without retraining from scratch. Kubernetes-native deployment is supported alongside a Prompt Guard feature that intercepts unsafe inputs. The project targets platform engineers, MLOps teams, and enterprises running heterogeneous model fleets who need cost control, privacy boundary enforcement, and safety guardrails across a mixture-of-models setup rather than a single fixed endpoint.
- ✓Open-source license (Apache-2.0)
- ✓Actively maintained (<30d)
- ✓Healthy fork ratio
- ✓Clear description
- ✓Topics declared
- ✓Documented (README)
git clone https://github.com/vllm-project/semantic-router{
"mcpServers": {
"semantic-router": {
"command": "semantic-router"
}
}
}Resumen de MCP Servers
Lo que la gente pregunta sobre semantic-router
¿Qué es vllm-project/semantic-router?
+
vllm-project/semantic-router es mcp servers para el ecosistema de Claude AI. System Level Intelligent Router for Mixture-of-Models at Cloud, Data Center and Edge Tiene 4.3k estrellas en GitHub y se actualizó por última vez today.
¿Cómo se instala semantic-router?
+
Puedes instalar semantic-router clonando el repositorio (https://github.com/vllm-project/semantic-router) o siguiendo las instrucciones del README en GitHub. ClaudeWave también te ofrece bloques de instalación rápida en esta misma página.
¿Es seguro usar vllm-project/semantic-router?
+
Nuestro agente de seguridad ha analizado vllm-project/semantic-router y le ha asignado un Trust Score de 100/100 (tier: Verified). Revisa el desglose completo de comprobaciones superadas y flags en esta página.
¿Quién mantiene vllm-project/semantic-router?
+
vllm-project/semantic-router es mantenido por vllm-project. La última actividad registrada en GitHub es de today, con 205 issues abiertos.
¿Hay alternativas a semantic-router?
+
Sí. En ClaudeWave puedes explorar mcp servers similares en /categories/mcp, ordenados por popularidad o actividad reciente.
Despliega semantic-router en tu cloud
Lleva este repo a producción en minutos. Cada plataforma genera su propio entorno con variables de entorno editables.
¿Mantienes este repo? Añade un badge a tu README
Pega el badge en tu README de GitHub para mostrar que está auditado por ClaudeWave. Cada badge enlaza de vuelta a esta página y muestra el Trust Score actual.
[](https://claudewave.com/repo/vllm-project-semantic-router)<a href="https://claudewave.com/repo/vllm-project-semantic-router"><img src="https://claudewave.com/api/badge/vllm-project-semantic-router" alt="Featured on ClaudeWave: vllm-project/semantic-router" width="320" height="64" /></a>Más MCP Servers
Fair-code workflow automation platform with native AI capabilities. Combine visual building with custom code, self-host or cloud, 400+ integrations.
User-friendly AI Interface (Supports Ollama, OpenAI API, ...)
An open-source AI agent that brings the power of Gemini directly into your terminal.
The fastest path to AI-powered full stack observability, even for lean teams.
🕷️ An adaptive Web Scraping framework that handles everything from a single request to a full-scale crawl!
⭐AI-driven public opinion & trend monitor with multi-platform aggregation, RSS, and smart alerts.🎯 告别信息过载，你的 AI 舆情监控助手与热点筛选工具！聚合多平台热点 + RSS 订阅，支持关键词精准筛选。AI 智能筛选新闻 + AI 翻译 + AI 分析简报直推手机，也支持接入 MCP 架构，赋能 AI 自然语言对话分析、情感洞察与趋势预测等。支持 Docker ，数据本地/云端自持。集成微信/飞书/钉钉/Telegram/邮件/ntfy/bark/slack 等渠道智能推送。