Library
85,340 resources from 11 public sources. 54 checked by hand; the rest are unreviewed.
Results
-
Bittune
Agents & frameworksLocal-first engineering agent that deploys, benchmarks and tunes vLLM/SGLang inference services on your own GPUs, with auditable run evidence.
git clone https://github.com/bitcloud-ai/Bittune.git -
hass_local_openai_llm
Agents & frameworksHome Assistant LLM integration for local OpenAI-compatible services (llamacpp, vllm, etc)
git clone https://github.com/skye-harris/hass_local_openai_llm.git -
Hyperloom
Agents & frameworksAn agentic system that auto-optimizes LLM workloads on AMD GPUs.
git clone https://github.com/AMD-AGI/Hyperloom.git -
BambooAI
Agents & frameworksAI-powered data analysis workbench built for transparency, reproducibility and user control. Inspect the code and evidence behind results, verify calculations through replay, and choose from a wide range of models, including local open-weight models.
git clone https://github.com/pgalko/BambooAI.git -
imp
Agents & frameworksRun large AI chat models privately on your own NVIDIA RTX 50 or RTX PRO graphics card. On one RTX 5090, Qwen3.8-27B writes about 70 words per second, 1.4x faster than vLLM. Even a model almost four times larger than the card's memory runs. Works with apps made for ChatGPT or Claude. Starts with one docker command.
git clone https://github.com/kekzl/imp.git -
alzeo
Agents & frameworksAlzeo is an open-source installer that turns an NVIDIA DGX Spark, or any GB10 machine (ASUS, Dell, HP, Lenovo, MSI, GIGABYTE, Acer), into a private AI server in one command: measured model lanes, OpenAI and Anthropic APIs, and a local cockpit.
git clone https://github.com/hasso5703/alzeo.git -
taOS
Agents & frameworksSelf-hosted AI agent OS. Your memory, chat, agents, and files stay on hardware you own, offline by default, cloud by choice. Offline AI memory (taOSmd), self-hosted multi-framework group chat, a full web desktop + app store, and auto-clustering across the consumer hardware you already have (Orange/Raspberry Pi, Mac mini, gaming PC).
git clone https://github.com/jaylfc/taOS.git -
localharness
Agents & frameworksAn open-source, coding agent harness designed specifically for local LLMs. Designed as everything a user needs to jumpstart their own harness (detailed event steams, logs, and performance data) or quickly replace closed source one (featuring out of the box plugins for web search, image gen, memory, auto research and more in dev).
git clone https://github.com/ahwurm/localharness.git
Indexed entries aren't reviewed or tested by InnerVault. Details come straight from each source. Anything that can reach your accounts, files or browser can do damage, so read the source before you install it.