smg
Engine-agnostic LLM gateway in Rust. Full OpenAI & Anthropic API compatibility across vLLM, TRT-LLM, TokenSpeed, SGLang, OpenAI, Gemini & more. Industry-first gRPC pipeline, KV cache-aware routing, chat history, tokenization caching, Responses API, embeddings, WASM plugins, MCP, and multi-tenant auth.
- 665 stars
- 199 forks
- 189 open issues
- Language: Rust
- License: Apache-2.0
- updated
Install
git clone https://github.com/smg-project/smg- Clone the repository.
- Follow the README for installation and usage instructions.
Tools overview
What people ask about smg
What is smg-project/smg?
smg-project/smg is tools for the Claude AI ecosystem. Engine-agnostic LLM gateway in Rust. Full OpenAI & Anthropic API compatibility across vLLM, TRT-LLM, TokenSpeed, SGLang, OpenAI, Gemini & more. Industry-first gRPC pipeline, KV cache-aware routing, chat history, tokenization caching, Responses API, embeddings, WASM plugins, MCP, and multi-tenant auth. It has 665 GitHub stars and its last recorded update is dated 2026-10-23.
How do I install smg?
You can install smg by cloning the repository (https://github.com/smg-project/smg) or following the README instructions on GitHub. ClaudeWave also provides quick install blocks on this page.
Is smg-project/smg safe to use?
Our security agent has analyzed smg-project/smg and assigned a Trust Score of 97/100 (tier: Verified). See the full breakdown of passed checks and flags on this page.
Who maintains smg-project/smg?
smg-project/smg is maintained by smg-project. The last recorded GitHub activity is dated 2026-10-23, with 189 open issues.
Are there alternatives to smg?
Yes. On ClaudeWave you can browse similar tools at /categories/tools, sorted by popularity or recent activity.