Library
85,340 resources from 11 public sources. 54 checked by hand; the rest are unreviewed.
Results
-
gpustack
AI repositoriesA GPU cluster manager for high-performance AI model serving (vLLM, SGLang) and on-demand SSH-accessible GPU instances.
git clone https://github.com/gpustack/gpustack.git -
nvidia_gpu_exporter
AI repositoriesNvidia GPU exporter for prometheus using nvidia-smi binary OR using NVML
git clone https://github.com/utkuozdemir/nvidia_gpu_exporter.git -
kvcached
AI repositoriesVirtualized Elastic KV Cache for Dynamic GPU Sharing and Beyond
git clone https://github.com/ovg-project/kvcached.git -
deepflow
AI repositorieseBPF Observability - Distributed Tracing and Profiling
git clone https://github.com/deepflowio/deepflow.git -
openlake
AI repositoriesOpenLake is a high performance storage engine for efficient LLM inference and GPU Training
git clone https://github.com/openlake-project/openlake.git -
Soup
AI repositoriesFine-tune LLMs from one YAML. Layer streaming trains an 8B model on a 4 GB laptop GPU.
git clone https://github.com/MakazhanAlpamys/Soup.git -
ml-engineering
AI repositoriesMachine Learning Engineering Open Book
git clone https://github.com/stas00/ml-engineering.git -
uccl
AI repositoriesUCCL is an efficient communication library for GPUs, covering collectives, P2P (e.g., KV cache transfer, RL weight transfer), and EP (e.g., GPU-driven)
git clone https://github.com/uccl-project/uccl.git -
llm-d
AI repositoriesState of the art inference performance with modern accelerators on Kubernetes
git clone https://github.com/llm-d/llm-d.git -
chitu
AI repositoriesHigh-performance inference framework for large language models, focusing on efficiency, flexibility, and availability.
git clone https://github.com/thu-pacman/chitu.git -
beta9
AI repositoriesUltrafast serverless GPU inference, sandboxes, and background jobs
git clone https://github.com/beam-cloud/beta9.git -
cuvs
AI repositoriescuVS - a library for vector search and clustering on the GPU
git clone https://github.com/NVIDIA/cuvs.git -
oneDNN
AI repositoriesOpen-source library of optimized deep learning operations (matmul, convolution, attention) for CPUs (x64, AArch64, RISC-V) and Intel GPUs. Used by PyTorch, TensorFlow, OpenVINO, and ONNX Runtime.
git clone https://github.com/uxlfoundation/oneDNN.git -
GenerativeAIExamples
AI repositoriesGenerative AI reference workflows optimized for accelerated infrastructure and microservice architecture.
git clone https://github.com/NVIDIA/GenerativeAIExamples.git -
trainer
AI repositoriesDistributed AI Model Training and LLM Fine-Tuning on Kubernetes
git clone https://github.com/kubeflow/trainer.git -
production-ai-agents-for-media-generation
AI repositoriesBuild production AI agents that generate images, video and audio on serverless GPUs. Free course. Apply 👇🏼
git clone https://github.com/DataTalksClub/production-ai-agents-for-media-generation.git -
surogate
AI repositoriesTrain and serve LLMs at extreme speed and massive throughput.
git clone https://github.com/invergent-ai/surogate.git -
ai-infra-book
AI repositories《深入理解 AI Infra:量化分析与系统设计》(李博杰 著)开源书稿:从硬件约束和模型架构出发,量化推导 LLM 推理与训练系统设计。含全书正文、PDF、配套计算工具与实验
git clone https://github.com/bojieli/ai-infra-book.git -
tt-metal
AI repositories:metal: TT-NN operator library, and TT-Metalium low level kernel programming model.
git clone https://github.com/tenstorrent/tt-metal.git -
LoongForge
AI repositoriesA high-performance framework for training LLMs, VLMs, diffusion, and embodied models on NVIDIA GPUs and Kunlun XPUs. Supports Pi0.5, GR00T-N1.7, FastWAM, Cosmos3, DreamZero, DeepSeek-V4, GLM-5.3, Kimi-K3 and more.
git clone https://github.com/baidu-baige/LoongForge.git -
airllm
AI repositoriesAirLLM 2.8T LLM inference with single 4GB GPU
git clone https://github.com/lyogavin/airllm.git -
Chinese-LLaMA-Alpaca
AI repositories中文LLaMA&Alpaca大语言模型+本地CPU/GPU训练部署 (Chinese LLaMA & Alpaca LLMs)
git clone https://github.com/ymcui/Chinese-LLaMA-Alpaca.git -
oxideterm
AI repositoriesAI-native workspace for local shells and remote machines in Rust+GPUI. Combines split-pane SSH, SFTP, remote file editing, and MCP tools with the semantic coloring and free-type input ergonomics familiar from WindTerm. Zero WebView, zero OpenSSL, zero telemetry, and no app subscription.
git clone https://github.com/AnalyseDeCircuit/oxideterm.git -
awsome-distributed-ai
AI repositoriesBest practices, reference architectures, and examples for distributed AI training and inference on AWS.
git clone https://github.com/awslabs/awsome-distributed-ai.git
Indexed entries aren't reviewed or tested by InnerVault. Details come straight from each source. Anything that can reach your accounts, files or browser can do damage, so read the source before you install it.