Best MCP Servers for LLM Client in 2026
455 tools indexed · avg score 89.4 · sorted by AgentRank score
The AgentRank index tracks 455 llm client tools. The top-ranked entry is agentic-community/mcp-gateway-registry at 94.6 points. Across the 10 shown here, the average AgentRank score is 89.4, and 10 had a commit in the last 30 days. The most common primary language is Rust.
LLM clients, gateways, and routers provide a unified interface for interacting with multiple AI model providers. These tools let developers and agents switch between OpenAI, Anthropic, Mistral, Google, and open-source models through a single API — enabling cost optimization, fallback routing, load balancing, and model comparison.
The category includes both SDK-level clients (thin wrappers around provider APIs) and full gateway deployments (proxy servers that add rate limiting, caching, cost tracking, and observability on top of raw model calls). LiteLLM is the dominant open-source option, with commercial alternatives like Portkey and Helicone for teams needing managed infrastructure.
Key features to evaluate: OpenAI-compatible API surface (so existing code works with zero changes), streaming support, token usage tracking, retry logic, and semantic caching. For production deployments, look for tools with Redis caching support to reduce costs on repeated queries.
Top 10 LLM Client MCP Servers
- #1agentic-community/mcp-gateway-registry94.6
Enterprise-ready MCP Gateway & Registry that centralizes AI development tools with secure OAuth authentication, dynamic tool discovery, and unified access for both autonomous AI agents and AI codin...
Ranks here on 942 GitHub stars and a commit within the last week, plus 83% of issues closed.Freshness 30.8Issue health 25.5Stars 15.3Contributors 12.3Description 6.2 - #2inference-gateway/inference-gateway92.0
An open-source, cloud-native, high-performance gateway unifying multiple LLM providers, from local solutions like Ollama to major cloud providers such as OpenAI, Groq, Cohere, Anthropic, Cloudflare...
Ranks here on 210 GitHub stars and a commit within the last week, plus 96% of issues closed.Freshness 30.8Issue health 29.7Stars 11.9Contributors 8.9Description 6.2 - #3smg-project/smg91.1
Engine-agnostic LLM gateway in Rust. Full OpenAI & Anthropic API compatibility across vLLM, TRT-LLM, TokenSpeed, SGLang, OpenAI, Gemini & more. Industry-first gRPC pipeline, KV cache-aware routing,...
Ranks here on 543 GitHub stars and a commit within the last week, plus 75% of issues closed.Freshness 30.8Issue health 23.2Stars 14.0Contributors 12.3Description 6.2 - #4ChronoAIProject/NyxID90.2
Connect AI agents to any API, anywhere. Securely. Open-source gateway that proxies requests, injects credentials automatically, punches through NAT to reach localhost services, and wraps REST APIs...
Ranks here on a commit within the last week and 92% of issues closed.Freshness 30.8Issue health 28.3Contributors 12.3Stars 8.0Description 6.2 - #5aliang-one/aliangboard90.0
An open-source, AI-native Kubernetes panel — full multi-cluster management via a Vue 3 + Node gateway, with a built-in Agent workbench and MCP server that lets LLMs read, write, and operate your cl...
Ranks here on a commit within the last week and 100% of issues closed.Freshness 30.8Issue health 30.8Stars 10.5Contributors 7.2Description 6.2 - #6soulteary/owlmail89.1
OwlMail is a self-hosted, AI-native email testing gateway for developers, CI pipelines, and coding agents. Capture, inspect, wait for, validate, and route application emails through REST, Webhooks,...
Ranks here on a commit within the last week and 100% of issues closed.Freshness 30.8Issue health 30.8Stars 9.6Contributors 7.2Description 6.2 - #7openmake/openmake_llm88.6
Open-source, self-hosted AI workspace for local and open-weight LLMs with vLLM, LiteLLM, autonomous agents, MCP tools, deep research, artifacts, and BYOK.
Ranks here on a commit within the last week and 100% of issues closed.Freshness 30.8Issue health 30.8Stars 8.4Contributors 7.9Description 6.2 - #8hwdsl2/self-hosted-ai-stack86.4
Deploy a complete self-hosted AI stack with Docker Compose: Ollama, LiteLLM, AnythingLLM, Whisper, WhisperLive, Kokoro, Embeddings, Docling and MCP Gateway. Local-first, private by default, with li...
Ranks here on a commit within the last week and 100% of issues closed.Freshness 30.8Issue health 30.8Stars 11.3Description 6.2License 4.6 - #9bitrouter/bitrouter86.3
The minimal interpretable model router that learns & adapts to your agent workflows
Ranks here on 230 GitHub stars and a commit within the last week, plus 83% of issues closed.Freshness 30.8Issue health 25.6Stars 12.1Contributors 8.9License 4.6 - #10Continuum-AI-Corp/OrcaReplay85.6
OrcaReplay — Time travel for AI agents. Record, replay, fork, and debug any agent run with any model. Built by the OrcaRouter.ai team.
Ranks here on 263 GitHub stars and a commit within the last week, plus 80% of issues closed.Freshness 30.8Issue health 24.6Stars 12.4Contributors 8.9License 4.6
More LLM Client MCP Servers
| # | Tool | Score | Stars | Last Commit | Language |
|---|---|---|---|---|---|
| 11 | emaspa/unraidclaw | 46 | 7d ago | TypeScript | |
| 12 | taichuy/1flowbase | 265 | today | Rust | |
| 13 | diegosouzapw/OmniRoute | 70k | today | TypeScript | |
| 14 | croit/aiplane | 23 | 2d ago | Rust | |
| 15 | engasnm111/lnwjud | 190 | today | TypeScript | |
| 16 | lianluo-esign/ferrogate | 23 | 6d ago | TypeScript | |
| 17 | TomLeeLive/openclaw-unity-plugin | 107 | 16d ago | C# | |
| 18 | gefsikatsinelou/MetaSearchMCP | 58 | today | Python | |
| 19 | Yinglianchun/Serein | 68 | today | Python | |
| 20 | ankitcharolia/kiro-gateway | 79 | 3d ago | Python | |
| 21 | agentgateway/agentgateway | 5.0k | today | Rust | |
| 22 | soapbucket/sbproxy | 53 | 14d ago | Rust | |
| 23 | stdapi-ai/stdapi.ai | 25 | 1d ago | Python | |
| 24 | stellar-experimental/stellar-raven | 8 | 4d ago | JavaScript | |
| 25 | 0xzr/freellmpool | 113 | 7d ago | Python | |
| 26 | nirholas/plugin.delivery | 25 | 10d ago | TypeScript | |
| 27 | alifanov/scopegate | 17 | 11d ago | TypeScript | |
| 28 | ferro-labs/ai-gateway | 265 | 4d ago | Go | |
| 29 | KochC/opencode-llm-proxy | 67 | today | JavaScript | |
| 30 | artcc/openclient-llm | 19 | 1d ago | Swift | |
| 31 | IBM/mcp-context-forge | 4.5k | today | Python | |
| 32 | TomLeeLive/openclaw-godot-plugin | 17 | 23d ago | GDScript | |
| 33 | perforce/perforce-agentic-gateway | 13 | 3d ago | — | |
| 34 | barbacane-dev/barbacane | 28 | today | Rust | |
| 35 | stabgan/openrouter-mcp-multimodal | 92 | 1d ago | TypeScript | |
| 36 | unrelated-ai/mcp-gateway | 25 | 5d ago | Rust | |
| 37 | ypollak2/llm-router | 88 | today | Python | |
| 38 | Azure-Samples/AI-Gateway | 990 | 9d ago | Jupyter Notebook | |
| 39 | cuihuan/awesome-ai-gateway | 115 | 1d ago | HTML | |
| 40 | archestra-ai/archestra | 4.3k | today | TypeScript | |
| 41 | hashangit/openfusion | 35 | 12d ago | TypeScript | |
| 42 | RelayPlane/proxy | 203 | 2d ago | TypeScript | |
| 43 | deltawi/deltallm | 19 | 1d ago | Python | |
| 44 | GhostXia/AIRP | 15 | 14d ago | Rust | |
| 45 | NateBJones-Projects/OB1 | 4.6k | 1d ago | TypeScript | |
| 46 | off-grid-ai/OGAD | 113 | today | TypeScript | |
| 47 | Shelpuk-AI-Technology-Consulting/lad_mcp_server | 22 | 1mo ago | Python | |
| 48 | zaber-dev/free-ai-gateway | 16 | 4d ago | TypeScript | |
| 49 | maximhq/bifrost | 8.3k | today | Go | |
| 50 | centralmind/gateway | 548 | 1y ago | Go |