Claim listing
Mattbusel/tokio-prompt-orchestrator
Tokio pipeline for serving LLM requests: bounded five-stage flow with dedup, circuit breakers, retries, rate limits and a dead-letter queue in front of Anthropic, OpenAI, llama.cpp or vLLM. REST, SSE, MCP, TUI.
Claim your listing to add a tagline, logo, and category. Verified maintainers get a Verified Publisher badge and priority placement on the AgentRank index.
Leave your email to claim this listing. GitHub verification coming soon.