Intelligent Mixture-of-Models Router for Efficient Heterogeneous LLMs Inference
vLLM Semantic Router is a signal-driven routing layer, written in Go with Rust components via Hugging Face Candle, that directs incoming LLM workloads to the most appropriate model across cloud, data center, and edge deployments. It exposes an MCP server interface, allowing Claude and other MCP-compatible clients to interact with its routing infrastructure. The system performs real-time classification using BERT-based models to detect jailbreaks, PII leakage, and hallucinations before or after inference, and applies category-aware semantic caching to reduce redundant token generation. A LoRA-extensible architecture lets teams fine-tune routing classifiers for domain-specific workloads without retraining from scratch. Kubernetes-native deployment is supported alongside a Prompt Guard feature that intercepts unsafe inputs. The project targets platform engineers, MLOps teams, and enterprises running heterogeneous model fleets who need cost control, privacy boundary enforcement, and safety guardrails across a mixture-of-models setup rather than a single fixed endpoint.
- ✓Open-source license (Apache-2.0)
- ✓Actively maintained (<30d)
- ✓Healthy fork ratio
- ✓Clear description
- ✓Topics declared
- ✓Documented (README)
git clone https://github.com/vllm-project/semantic-router{
"mcpServers": {
"semantic-router": {
"command": "semantic-router"
}
}
}Resumen de MCP Servers
Lo que la gente pregunta sobre semantic-router
¿Qué es vllm-project/semantic-router?
+
vllm-project/semantic-router es mcp servers para el ecosistema de Claude AI. Intelligent Mixture-of-Models Router for Efficient Heterogeneous LLMs Inference Tiene 5.1k estrellas en GitHub y se actualizó por última vez today.
¿Cómo se instala semantic-router?
+
Puedes instalar semantic-router clonando el repositorio (https://github.com/vllm-project/semantic-router) o siguiendo las instrucciones del README en GitHub. ClaudeWave también te ofrece bloques de instalación rápida en esta misma página.
¿Es seguro usar vllm-project/semantic-router?
+
Nuestro agente de seguridad ha analizado vllm-project/semantic-router y le ha asignado un Trust Score de 100/100 (tier: Verified). Revisa el desglose completo de comprobaciones superadas y flags en esta página.
¿Quién mantiene vllm-project/semantic-router?
+
vllm-project/semantic-router es mantenido por vllm-project. La última actividad registrada en GitHub es de today, con 272 issues abiertos.
¿Hay alternativas a semantic-router?
+
Sí. En ClaudeWave puedes explorar mcp servers similares en /categories/mcp, ordenados por popularidad o actividad reciente.
Despliega semantic-router en tu cloud
Lleva este repo a producción en minutos. Cada plataforma genera su propio entorno con variables de entorno editables.
¿Mantienes este repo? Añade un badge a tu README
Pega el badge en tu README de GitHub para mostrar que está auditado por ClaudeWave. Cada badge enlaza de vuelta a esta página y muestra el Trust Score actual.
[](https://claudewave.com/repo/vllm-project-semantic-router)<a href="https://claudewave.com/repo/vllm-project-semantic-router"><img src="https://claudewave.com/api/badge/vllm-project-semantic-router" alt="Featured on ClaudeWave: vllm-project/semantic-router" width="320" height="64" /></a>Más MCP Servers
Fair-code workflow automation platform with native AI capabilities. Combine visual building with custom code, self-host or cloud, 400+ integrations.
User-friendly AI Interface (Supports Ollama, OpenAI API, ...)
An open-source AI agent that brings the power of Gemini directly into your terminal.
The fastest path to AI-powered full stack observability, even for lean teams.
Real-time global intelligence dashboard. AI-powered news aggregation, geopolitical monitoring, and infrastructure tracking in a unified situational awareness interface
🕷️ An adaptive Web Scraping framework that handles everything from a single request to a full-scale crawl!