varunvasudeva1/llm-server-docs

Score: 56.9 Rank #151

End-to-end documentation to set up your own local & fully private LLM server on Debian. Equipped with chat, web search, RAG, model management, MCP servers, image generation, and TTS.

Overview

varunvasudeva1/llm-server-docs is a MCP server licensed under MIT. End-to-end documentation to set up your own local & fully private LLM server on Debian. Equipped with chat, web search, RAG, model management, MCP servers, image generation, and TTS. Topics: linux, llm, ollama, open-webui, debian, comfyui, vllm, llama-swap, llamacpp, mcp-proxy, kokoro-fastapi, mcpjungle, docker, huggingface.

Ranked #151 out of 25632 indexed tools.

In the top 1% of all indexed tools.

Ecosystem

MIT

linuxllmollamaopen-webuidebiancomfyuivllmllama-swapllamacppmcp-proxykokoro-fastapimcpjungledockerhuggingface

Signal Breakdown

Stars 720

Freshness 14d ago

Issue Health 80%

Contributors 2

Dependents 0

Forks 56

Description Detailed

License MIT

How to Improve

Dependents medium impact

No downstream dependents detected yet — adoption by other projects is the strongest trust signal

Badge

AgentRank score for varunvasudeva1/llm-server-docs

Markdown

[![AgentRank](https://agentrank-ai.com/api/badge/tool/varunvasudeva1--llm-server-docs)](https://agentrank-ai.com/tool/varunvasudeva1--llm-server-docs)

HTML

<a href="https://agentrank-ai.com/tool/varunvasudeva1--llm-server-docs"><img src="https://agentrank-ai.com/api/badge/tool/varunvasudeva1--llm-server-docs" alt="AgentRank"></a>

Details

Stars: 720
Forks: 56
Open Issues: 1
Closed Issues: 4
Contributors: 2
Dependents: —
Language: —
License: MIT
Last Commit: 14d ago

Matched Queries

"mcp server""mcp-server"

From the README

# Local LLaMA Server Setup Documentation

_TL;DR_: End-to-end documentation to set up your own local & fully private LLM server on Debian. Equipped with chat, web search, RAG, model management, MCP servers, image generation, and TTS, along with steps for configuring SSH, firewall, and secure remote access via Tailscale.

Software Stack:

- Inference Engine ([Ollama](https://github.com/ollama/ollama), [llama.cpp](https://github.com/ggml-org/llama.cpp), [vLLM](https://github.com/vllm-project/vllm))
- Search Engine ([SearXNG](https://github.com/searxng/searxng))
- Model Server ([llama-swap](https://github.com/mostlygeek/llama-swap), `systemd` service)
- Chat Platform ([Open WebUI](https://github.com/open-webui/open-webui))
- MCP Proxy Server ([mcp-proxy](https://github.com/sparfenyuk/mcp-proxy), [MCPJungle](https://github.com/mcpjungle/MCPJungle))
- Text-to-Speech Server ([Kokoro FastAPI](https://github.com/remsky/Kokoro-FastAPI))
- Image Generation Server ([ComfyUI](https://github.com/co

Read full README on GitHub →

View on GitHub →

Are you the maintainer? Claim this listing