tokio-prompt-orchestrator MCP Server
Mattbusel/tokio-prompt-orchestrator
[](https://agentrank-ai.com/tool/Mattbusel--tokio-prompt-orchestrator/?utm_source=badge&utm_medium=readme&utm_campaign=agentrank_badge) Tokio pipeline for serving LLM requests: bounded five-stage flow with dedup, circuit breakers, retries, rate limits and a dead-letter queue in front of Anthropic, OpenAI, llama.cpp or vLLM. REST, SSE, MCP, TUI.
claude mcp add agentrank -- npx -y agentrank-mcp-server Overview
Mattbusel/tokio-prompt-orchestrator is a Rust tool licensed under MIT. Tokio pipeline for serving LLM requests: bounded five-stage flow with dedup, circuit breakers, retries, rate limits and a dead-letter queue in front of Anthropic, OpenAI, llama.cpp or vLLM. REST, SSE, MCP, TUI.
Ranked #7496 out of 24844 indexed tools.
Actively maintained with commits in the last week.
Ecosystem
Score Breakdown
57 stars → early stage
Last commit today → actively maintained
0/6 issues closed → many open issues
3 contributors → small team
No dependents → no downstream usage
Weights: Freshness 20% · Issue Health 20% · Dependents 22% · Stars 10% · Contributors 8% · How we score →
How to Improve
Matched Queries
Get the weekly AgentRank digest
Top movers, new tools, ecosystem insights — straight to your inbox.