inference-gateway MCP Server
inference-gateway/inference-gateway
[](https://agentrank-ai.com/tool/inference-gateway--inference-gateway/?utm_source=badge&utm_medium=readme&utm_campaign=agentrank_badge) An open-source, cloud-native, high-performance gateway unifying multiple LLM providers, from local solutions like Ollama to major cloud providers such as OpenAI, Groq, Cohere, Anthropic, Cloudflare and DeepSeek.
claude mcp add agentrank -- npx -y agentrank-mcp-server Overview
inference-gateway/inference-gateway is a Go tool licensed under Apache-2.0. An open-source, cloud-native, high-performance gateway unifying multiple LLM providers, from local solutions like Ollama to major cloud providers such as OpenAI, Groq, Cohere, Anthropic, Cloudflare and DeepSeek. Topics: agnostic, gateway, gateway-api, golang, inference-api, kubernetes, llm, proxy, proxy-server, api, opensource, opensource-projects, performance, opentelemetry, tracing, self-hosted, anthropic, openai, deepseek-v4-pro, mcp.
Ranked #188 out of 24842 indexed tools.
In the top 1% of all indexed tools.
Actively maintained with commits in the last week.
Ecosystem
Score Breakdown
214 stars → growing community
Last commit 1d ago → actively maintained
192/195 issues closed → responsive maintainer
8 contributors → small team
No dependents → no downstream usage
Weights: Freshness 20% · Issue Health 20% · Dependents 22% · Stars 10% · Contributors 8% · How we score →
Badge all embed codes →
[](https://agentrank-ai.com/tool/inference-gateway--inference-gateway/?utm_source=badge&utm_medium=readme&utm_campaign=agentrank_badge) <a href="https://agentrank-ai.com/tool/inference-gateway--inference-gateway/?utm_source=badge&utm_medium=readme&utm_campaign=agentrank_badge"><img src="https://agentrank-ai.com/api/v1/badge/inference-gateway--inference-gateway" alt="AgentRank"></a> Matched Queries
From the README
<div align="center"> # Inference Gateway <p><strong>An open-source, cloud-native, high-performance gateway unifying multiple LLM providers behind one OpenAI-compatible API</strong></p> <a href="https://github.com/inference-gateway/inference-gateway/actions/workflows/ci.yml?query=branch%3Amain"> </a> <a href="https://github.com/inference-gateway/inference-gateway/releases"> </a> <a href="https://github.com/inference-gateway/inference-gateway/blob/main/LICENSE"> </a> <a href="https://github.com/inference-gateway/inference-gateway/blob/main/go.mod"> </a> <a href="https://docs.inference-gateway.com"> </a> [📖 Documentation](https://docs.inference-gateway.com) · [🚀 Getting Started](https://docs.inference-gateway.com/getting-started) · [💬 Discussions](https://github.com/orgs/inference-gateway/discussions) · [🐛 Issues](https://github.com/inference-gateway/inference-gateway/issues) <br/> </div> The Inference Gateway is a proxy server designed to facilitate access to various languageRead full README on GitHub →
Get the weekly AgentRank digest
Top movers, new tools, ecosystem insights — straight to your inbox.