Library
85,762 resources from 11 public sources. 53 checked by hand; the rest are unreviewed.
Results
-
OpenLLM
AI repositoriesRun any open-source LLMs, such as DeepSeek and Llama, as OpenAI compatible API endpoint in the cloud.
git clone https://github.com/bentoml/OpenLLM.git -
gpustack
AI repositoriesA GPU cluster manager for high-performance AI model serving (vLLM, SGLang) and on-demand SSH-accessible GPU instances.
git clone https://github.com/gpustack/gpustack.git -
incognide
Agents & frameworksExplore the unknown, build the future, own your data.
git clone https://github.com/NPC-Worldwide/incognide.git -
mistral-inference
AI repositoriesOfficial inference library for Mistral models
git clone https://github.com/mistralai/mistral-inference.git -
omlx
AI repositoriesLLM inference server with continuous batching & SSD caching for Apple Silicon — managed from the macOS menu bar
git clone https://github.com/jundot/omlx.git -
optillm
PromptsOptimizing inference proxy for LLMs
git clone https://github.com/algorithmicsuperintelligence/optillm.git -
wllama
AI repositoriesWebAssembly binding for llama.cpp - Enabling on-browser LLM inference
git clone https://github.com/ngxson/wllama.git -
kvcached
AI repositoriesVirtualized Elastic KV Cache for Dynamic GPU Sharing and Beyond
git clone https://github.com/ovg-project/kvcached.git -
LLM-VM
Agents & frameworksirresponsible innovation. Try now at https://chat.dev/
git clone https://github.com/anarchy-ai/LLM-VM.git -
BentoML
AI repositoriesThe easiest way to serve AI apps and models - Build Model Inference APIs, Job queues, LLM apps, Multi-model pipelines, and more!
git clone https://github.com/bentoml/BentoML.git -
airllm
AI repositoriesAirLLM 2.8T LLM inference with single 4GB GPU
git clone https://github.com/lyogavin/airllm.git -
bespoke_automata
Tools & appsBespoke Automata is a GUI and deployment pipline for making complex AI agents locally and offline
git clone https://github.com/C0deMunk33/bespoke_automata.git -
AI-Engineer-Headquarters
AI repositoriesA collection of scientific methods, processes, algorithms, and systems to build stories & models.
git clone https://github.com/hemansnation/AI-Engineer-Headquarters.git -
ecologits
AI repositories🌱 EcoLogits tracks the energy consumption and environmental footprint of using generative AI models through APIs.
git clone https://github.com/mlco2/ecologits.git -
llmspeed
Datasets & benchmarksFeel how fast a local LLM runs before you buy the hardware
git clone https://github.com/nicorobinreal/llmspeed.git -
beta9
AI repositoriesUltrafast serverless GPU inference, sandboxes, and background jobs
git clone https://github.com/beam-cloud/beta9.git -
LLM-TPU
AI repositoriesRun generative AI models in sophgo BM1684X/BM1688
git clone https://github.com/sophgo/LLM-TPU.git -
Context-Engine
MCP serversContext-Engine MCP - Agentic Context Compression Suite
git clone https://github.com/Context-Engine-AI/Context-Engine.git -
cave-agent
Agents & frameworksStateful runtime management for LLM agents—inject, manipulate, and retrieve Python objects across turns.
git clone https://github.com/acodercat/cave-agent.git -
lemonade
MCP serversLemonade helps users discover and run local AI apps by serving optimized LLMs right from their own GPUs and NPUs. Join our discord: https://discord.gg/5xXzkMu8Zk
git clone https://github.com/lemonade-sdk/lemonade.git -
tiny-llm
AI repositorieslearn LLM inference system on Apple Silicon for systems engineers: build a tiny vLLM + Qwen
git clone https://github.com/skyzh/tiny-llm.git -
nanocoder
AI repositoriesAn open coding agent for your terminal, built by a community collective rather than a company. Bring your own model, keep your code on your machine, and owe nothing to anyone.
git clone https://github.com/Nano-Collective/nanocoder.git -
eko
PromptsEko (Eko Keeps Operating) - Build Production-ready Agentic Workflow with Natural Language - eko.fellou.ai
git clone https://github.com/FellouAI/eko.git -
Bittune
Agents & frameworksLocal-first engineering agent that deploys, benchmarks and tunes vLLM/SGLang inference services on your own GPUs, with auditable run evidence.
git clone https://github.com/bitcloud-ai/Bittune.git
Indexed entries aren't reviewed or tested by InnerVault. Details come straight from each source. Anything that can reach your accounts, files or browser can do damage, so read the source before you install it.