smg MCP Server
smg-project/smg
[](https://agentrank-ai.com/tool/smg-project--smg/?utm_source=badge&utm_medium=readme&utm_campaign=agentrank_badge) Engine-agnostic LLM gateway in Rust. Full OpenAI & Anthropic API compatibility across vLLM, TRT-LLM, TokenSpeed, SGLang, OpenAI, Gemini & more. Industry-first gRPC pipeline, KV cache-aware routing, chat history, tokenization caching, Responses API, embeddings, WASM plugins, MCP, and multi-tenant auth.
claude mcp add agentrank -- npx -y agentrank-mcp-server Overview
smg-project/smg is a Rust tool licensed under Apache-2.0. Engine-agnostic LLM gateway in Rust. Full OpenAI & Anthropic API compatibility across vLLM, TRT-LLM, TokenSpeed, SGLang, OpenAI, Gemini & more. Industry-first gRPC pipeline, KV cache-aware routing, chat history, tokenization caching, Responses API, embeddings, WASM plugins, MCP, and multi-tenant auth. Topics: anthropic, claude, gemini, inference-gateway, llm, openai, routing, sglang, vllm, tensorrtllm, anthropic-api, chat, mcp, responses-api, trtllm, lightseek, tokenspeed.
Ranked #379 out of 24846 indexed tools.
In the top 2% of all indexed tools.
Has 148 contributors.
Ecosystem
Score Breakdown
572 stars → growing community
Last commit 29d ago → recently updated
319/454 issues closed → decent issue management
148 contributors → active community
No dependents → no downstream usage
Weights: Freshness 20% · Issue Health 20% · Dependents 22% · Stars 10% · Contributors 8% · How we score →
Matched Queries
From the README
<p align="center">
<picture>
<source media="(prefers-color-scheme: dark)" srcset="https://raw.githubusercontent.com/smg-project/smg/main/assets/images/logomark-white.svg">
<source media="(prefers-color-scheme: light)" srcset="https://raw.githubusercontent.com/smg-project/smg/main/assets/images/logomark-black.svg">
</picture>
</p>
<h1 align="center">Shepherd Model Gateway</h1>
<p align="center">
<a href="https://github.com/smg-project/smg/releases/latest"></a>
<a href="https://hub.docker.com/r/lightseekorg/smg"></a>
<a href="https://pypi.org/project/smg/"></a>
<a href="LICENSE"></a>
<a href="https://lightseek.org/smg/"></a>
<a href="https://discord.lightseek.org"></a>
<a href="https://slack.lightseek.org"></a>
<a href="https://deepwiki.com/smg-project/smg"></a>
<a href="https://pytorch.org/blog/lightseek-smg/"></a>
</p>
Engine-agnostic, high-performance model-routing gateway for large-scale LLM deployments. SMG centralizes worker lifecycle managemen Read full README on GitHub → Get the weekly AgentRank digest
Top movers, new tools, ecosystem insights — straight to your inbox.