ai-gateway MCP Server
ferro-labs/ai-gateway
[](https://agentrank-ai.com/tool/ferro-labs--ai-gateway/?utm_source=badge&utm_medium=readme&utm_campaign=agentrank_badge) Unified AI Gateway for 30+ LLMs (OpenAI, Anthropic, Bedrock, Azure etc) with Caching, Guardrails, A/B test & cost controls. Go-native Fastest & Scalable AI Gateway LiteLLM & Kong AI Gateway alternative.
claude mcp add agentrank -- npx -y agentrank-mcp-server Overview
ferro-labs/ai-gateway is a Go tool licensed under Apache-2.0. Unified AI Gateway for 30+ LLMs (OpenAI, Anthropic, Bedrock, Azure etc) with Caching, Guardrails, A/B test & cost controls. Go-native Fastest & Scalable AI Gateway LiteLLM & Kong AI Gateway alternative. Topics: ai-gateway, ai-infrastructure, llm, llm-proxy, llmops, mcp, semantic-cache, guardrails, llm-cost, pii-detection, litellm, prompt-management, llm-strategy, llm-gateway, openai-compatible, token-saver.
Ranked #2511 out of 24846 indexed tools.
Ecosystem
Score Breakdown
266 stars → growing community
Last commit 1mo ago → moderate activity
119/195 issues closed → decent issue management
3 contributors → small team
No dependents → no downstream usage
Weights: Freshness 20% · Issue Health 20% · Dependents 22% · Stars 10% · Contributors 8% · How we score →
How to Improve
Matched Queries
From the README
<div align="center"> <p align="right"> <a href="README.md">English</a> | <a href="README.zh-CN.md">中文</a> </p> <table border="0" cellspacing="0" cellpadding="0"><tr> <td rowspan="2"></td> <td align="center"><h1>Ferro Labs AI Gateway</h1></td> </tr><tr> <td align="center"><strong>Open-Source, OpenAI-Compatible LLM Gateway</strong></td> </tr></table> **High-performance AI gateway in Go. Route LLM requests across 30 providers via a single OpenAI-compatible API.** 📖 **Documentation:** [docs.ferrolabs.ai](https://docs.ferrolabs.ai) 🔀 **30 providers, 2,500+ models — one API**<br/> ⚡ **13,925 RPS at 1,000 concurrent users** ([v1.0.0 benchmark](#performance))<br/> 📦 **Single static binary, no external services required, 32 MB base memory** </div> --- ## Quick Start Under two minutes from install to first response. | Platform / tool | Install | |:---|:---| | macOS, Linux | `curl -fsSL https://get.ferrolabs.ai \| sh` | | Windows | `irm https://get.ferrolabs.ai/install.ps1 \|Read full README on GitHub →
Get the weekly AgentRank digest
Top movers, new tools, ecosystem insights — straight to your inbox.