self-hosted-ai-stack MCP Server
hwdsl2/self-hosted-ai-stack
[](https://agentrank-ai.com/tool/hwdsl2--self-hosted-ai-stack/?utm_source=badge&utm_medium=readme&utm_campaign=agentrank_badge) Deploy a self-hosted AI stack with Docker Compose: local LLMs, chat, document parsing, embeddings, transcription, text-to-speech and MCP tools. Powered by Ollama, LiteLLM, AnythingLLM and more. Local-first with auto-configured authentication, lightweight stacks, optional HTTPS and NVIDIA GPU support. MIT licensed. Multi-arch: amd64, arm64.
claude mcp add agentrank -- npx -y agentrank-mcp-server Overview
hwdsl2/self-hosted-ai-stack is a Shell tool licensed under MIT. Deploy a self-hosted AI stack with Docker Compose: local LLMs, chat, document parsing, embeddings, transcription, text-to-speech and MCP tools. Powered by Ollama, LiteLLM, AnythingLLM and more. Local-first with auto-configured authentication, lightweight stacks, optional HTTPS and NVIDIA GPU support. MIT licensed. Multi-arch: amd64, arm64. Topics: ai, ai-stack, docker, docker-compose, embeddings, linux, llm, local-ai, mcp, ollama, openai-compatible, private-ai, rag, self-hosted, speech-to-text, text-to-speech, whisper, cuda, docling, litellm.
Ranked #689 out of 24846 indexed tools.
In the top 3% of all indexed tools.
Ecosystem
Score Breakdown
165 stars → growing community
Last commit 29d ago → recently updated
3/3 issues closed → responsive maintainer
1 contributor → solo project
No dependents → no downstream usage
Weights: Freshness 20% · Issue Health 20% · Dependents 22% · Stars 10% · Contributors 8% · How we score →
Matched Queries
From the README
[English](README.md) | [简体中文](README-zh.md) | [繁體中文](README-zh-Hant.md) | [Русский](README-ru.md) # Self-Hosted AI Stack <p align="center"> </p> Includes InferCrate, GatewayCrate, AnythingLLM, ScribeCrate, ToolUplink, EmbedCrate, ParseCrate, and SpeakCrate — fully configured and ready to run with Docker Compose. > 📘 [The Self-Hosted AI Builder’s Guide](https://books2read.com/aiguide?store=amazon) is the hands-on companion to this stack, covering deployment, security, backups, and upgrades. **Features:** - **Zero-config:** all services auto-configure on first start. - **Secure by default:** AnythingLLM password protection is enabled, and bundled API services auto-generate keys. - **HTTPS-ready:** optional Caddy overlay provides automatic TLS and binds direct HTTP ports to localhost. - **Local by default:** runs locally, with optional external provider support via GatewayCrate. - **AI agent ready:** connect [goose](https://github.com/aaif-goose/goose) on your woRead full README on GitHub →
Get the weekly AgentRank digest
Top movers, new tools, ecosystem insights — straight to your inbox.