InnerVault

Library

85,340 resources from 11 public sources. 54 checked by hand; the rest are unreviewed.

Results

  1. gpustack

    AI repositories

    A GPU cluster manager for high-performance AI model serving (vLLM, SGLang) and on-demand SSH-accessible GPU instances.

    Indexed GitHub, gpustack 6,039 ★Apache-2.0Updated 3 days ago

    git clone https://github.com/gpustack/gpustack.git
  2. nvidia_gpu_exporter

    AI repositories

    Nvidia GPU exporter for prometheus using nvidia-smi binary OR using NVML

    Stale GitHub, utkuozdemir 1,584 ★MITUpdated 6 days ago

    git clone https://github.com/utkuozdemir/nvidia_gpu_exporter.git
  3. kvcached

    AI repositories

    Virtualized Elastic KV Cache for Dynamic GPU Sharing and Beyond

    Stale GitHub, ovg-project 2,033 ★Apache-2.0Updated 8 days ago

    git clone https://github.com/ovg-project/kvcached.git
  4. deepflow

    AI repositories

    eBPF Observability - Distributed Tracing and Profiling

    Stale GitHub, deepflowio 4,310 ★Apache-2.0Updated 17 days ago

    git clone https://github.com/deepflowio/deepflow.git
  5. openlake

    AI repositories

    OpenLake is a high performance storage engine for efficient LLM inference and GPU Training

    Stale GitHub, openlake-project 2,851 ★Apache-2.0Updated 7 days ago

    git clone https://github.com/openlake-project/openlake.git
  6. Soup

    AI repositories

    Fine-tune LLMs from one YAML. Layer streaming trains an 8B model on a 4 GB laptop GPU.

    Stale GitHub, MakazhanAlpamys 10.3k ★Apache-2.0Updated 9 days ago

    git clone https://github.com/MakazhanAlpamys/Soup.git
  7. ml-engineering

    AI repositories

    Machine Learning Engineering Open Book

    Stale GitHub, stas00 19.7k ★CC-BY-SA-4.0Updated 12 days ago

    git clone https://github.com/stas00/ml-engineering.git
  8. uccl

    AI repositories

    UCCL is an efficient communication library for GPUs, covering collectives, P2P (e.g., KV cache transfer, RL weight transfer), and EP (e.g., GPU-driven)

    Indexed GitHub, uccl-project 1,585 ★Apache-2.0Updated yesterday

    git clone https://github.com/uccl-project/uccl.git
  9. llm-d

    AI repositories

    State of the art inference performance with modern accelerators on Kubernetes

    Indexed GitHub, llm-d 5,274 ★Apache-2.0Updated today

    git clone https://github.com/llm-d/llm-d.git
  10. chitu

    AI repositories

    High-performance inference framework for large language models, focusing on efficiency, flexibility, and availability.

    Stale GitHub, thu-pacman 2,998 ★Apache-2.0Updated 11 days ago

    git clone https://github.com/thu-pacman/chitu.git
  11. beta9

    AI repositories

    Ultrafast serverless GPU inference, sandboxes, and background jobs

    Indexed GitHub, beam-cloud 1,852 ★AGPL-3.0Updated today

    git clone https://github.com/beam-cloud/beta9.git
  12. cuvs

    AI repositories

    cuVS - a library for vector search and clustering on the GPU

    Indexed GitHub, NVIDIA 895 ★Apache-2.0Updated 2 days ago

    git clone https://github.com/NVIDIA/cuvs.git
  13. oneDNN

    AI repositories

    Open-source library of optimized deep learning operations (matmul, convolution, attention) for CPUs (x64, AArch64, RISC-V) and Intel GPUs. Used by PyTorch, TensorFlow, OpenVINO, and ONNX Runtime.

    Indexed GitHub, uxlfoundation 4,094 ★Apache-2.0Updated today

    git clone https://github.com/uxlfoundation/oneDNN.git
  14. GenerativeAIExamples

    AI repositories

    Generative AI reference workflows optimized for accelerated infrastructure and microservice architecture.

    Stale GitHub, NVIDIA 4,210 ★Apache-2.0Updated 2 months ago

    git clone https://github.com/NVIDIA/GenerativeAIExamples.git
  15. trainer

    AI repositories

    Distributed AI Model Training and LLM Fine-Tuning on Kubernetes

    Stale GitHub, kubeflow 2,273 ★Apache-2.0Updated 10 days ago

    git clone https://github.com/kubeflow/trainer.git
  16. Build production AI agents that generate images, video and audio on serverless GPUs. Free course. Apply 👇🏼

    Indexed GitHub, DataTalksClub 353 ★MITUpdated yesterday

    git clone https://github.com/DataTalksClub/production-ai-agents-for-media-generation.git
  17. surogate

    AI repositories

    Train and serve LLMs at extreme speed and massive throughput.

    Stale GitHub, invergent-ai 885 ★Apache-2.0Updated 11 days ago

    git clone https://github.com/invergent-ai/surogate.git
  18. ai-infra-book

    AI repositories

    《深入理解 AI Infra:量化分析与系统设计》(李博杰 著)开源书稿:从硬件约束和模型架构出发,量化推导 LLM 推理与训练系统设计。含全书正文、PDF、配套计算工具与实验

    Stale GitHub, bojieli 6,489 ★Apache-2.0Updated 46 days ago

    git clone https://github.com/bojieli/ai-infra-book.git
  19. tt-metal

    AI repositories

    :metal: TT-NN operator library, and TT-Metalium low level kernel programming model.

    Stale GitHub, tenstorrent 1,747 ★Apache-2.0Updated 8 days ago

    git clone https://github.com/tenstorrent/tt-metal.git
  20. LoongForge

    AI repositories

    A high-performance framework for training LLMs, VLMs, diffusion, and embodied models on NVIDIA GPUs and Kunlun XPUs. Supports Pi0.5, GR00T-N1.7, FastWAM, Cosmos3, DreamZero, DeepSeek-V4, GLM-5.3, Kimi-K3 and more.

    Stale GitHub, baidu-baige 836 ★Apache-2.0Updated 5 days ago

    git clone https://github.com/baidu-baige/LoongForge.git
  21. airllm

    AI repositories

    AirLLM 2.8T LLM inference with single 4GB GPU

    Indexed GitHub, lyogavin 42.5k ★Apache-2.0Updated today

    git clone https://github.com/lyogavin/airllm.git
  22. Chinese-LLaMA-Alpaca

    AI repositories

    中文LLaMA&Alpaca大语言模型+本地CPU/GPU训练部署 (Chinese LLaMA & Alpaca LLMs)

    Stale GitHub, ymcui 18.9k ★Apache-2.0Updated 7 months ago

    git clone https://github.com/ymcui/Chinese-LLaMA-Alpaca.git
  23. oxideterm

    AI repositories

    AI-native workspace for local shells and remote machines in Rust+GPUI. Combines split-pane SSH, SFTP, remote file editing, and MCP tools with the semantic coloring and free-type input ergonomics familiar from WindTerm. Zero WebView, zero OpenSSL, zero telemetry, and no app subscription.

    Indexed GitHub, AnalyseDeCircuit 1,874 ★GPL-3.0Updated yesterday

    git clone https://github.com/AnalyseDeCircuit/oxideterm.git
  24. awsome-distributed-ai

    AI repositories

    Best practices, reference architectures, and examples for distributed AI training and inference on AWS.

    Indexed GitHub, awslabs 498 ★MIT-0Updated 2 days ago

    git clone https://github.com/awslabs/awsome-distributed-ai.git

Indexed entries aren't reviewed or tested by InnerVault. Details come straight from each source. Anything that can reach your accounts, files or browser can do damage, so read the source before you install it.