Local AI MCP
Run, fit, and route work to local LLMs (Ollama, LM Studio, llama.cpp, MLX, vLLM, and more).
Open the source (opens github.com) https://github.com/tmhsdigital/local-ai-mcp
Before you use it
- Runs on your computer with your permissions. Read what it can do before connecting it to an agent.
- Needs credentials: MOONSHOT_API_KEY, OPENAI_COMPAT_API_KEY, VLLM_API_KEY. Use a key with the least access you can.
What it is
MCP servers from io.github.TMHSDigital.
The problem it solves and who it suits haven't been reviewed by InnerVault. The description above is the source's own.
How to get it
npm package (stdio)
@tmhs/local-ai-mcp@0.6.1
From the server's entry in the official MCP Registry
Settings it asks for
OLLAMA_HOST· Ollama base URLLMSTUDIO_HOST· LM Studio server base URLLLAMACPP_HOST· llama.cpp server (llama-server) base URLDOCKER_MODEL_RUNNER_HOST· Docker Model Runner host TCP endpointMLX_HOST· mlx_lm.server base URL (opt-in; Apple Silicon)VLLM_HOST· vLLM OpenAI server base URL (opt-in)VLLM_API_KEYsecret · Bearer token for VLLM_HOST (when vLLM runs with --api-key)FOUNDRY_LOCAL_HOST· Foundry Local service URL (opt-in; port from `foundry service status`)OPENAI_COMPAT_HOST· Any OpenAI-compatible /v1 server (opt-in)OPENAI_COMPAT_API_KEYsecret · Bearer token for OPENAI_COMPAT_HOSTMOONSHOT_API_KEYsecret · Moonshot AI (Kimi) key. Hosted: only used when named explicitly.LOCAL_AI_ALLOW_HOSTED_FALLBACK· Allow implicit routing to hosted providers (default: off)
Related
-
Connect MCP servers to Claude Code
MCP serversAnthropic's guide to adding MCP servers to Claude Code, with examples of local and remote servers.
-
GitHub MCP server
MCP serversGitHub's official MCP server. It lets an agent read and work with repositories, issues and pull requests.
https://api.githubcopilot.com/mcp/ -
Apify MCP server
MCP serversLets an agent run Apify's ready-made scrapers to pull data from websites, search engines, maps and social platforms.
-
nanobot
MCP serversYour lightweight open-source personal agent.
git clone https://github.com/HKUDS/nanobot.git -
lemonade
MCP serversLemonade helps users discover and run local AI apps by serving optimized LLMs right from their own GPUs and NPUs. Join our discord: https://discord.gg/5xXzkMu8Zk
git clone https://github.com/lemonade-sdk/lemonade.git -
FlyEnv
MCP serversNative local development environment for Windows, macOS & Linux. A modern alternative to XAMPP, MAMP, Laragon and Laravel Herd, with runtimes, databases, web servers, local sites, HTTPS, AI coding tools and MCP.
git clone https://github.com/xpf0000/FlyEnv.git