Library
85,340 resources from 11 public sources. 54 checked by hand; the rest are unreviewed.
Results
-
awsome-distributed-ai
AI repositoriesBest practices, reference architectures, and examples for distributed AI training and inference on AWS.
git clone https://github.com/awslabs/awsome-distributed-ai.git -
mesh-llm
AI repositoriesDistributed AI/LLM for the people. Share compute privately or publicly to power your agents and chat.
git clone https://github.com/Mesh-LLM/mesh-llm.git -
ray
AI repositoriesRay is an AI compute engine. Ray consists of a core distributed runtime and a set of AI Libraries for accelerating ML workloads.
git clone https://github.com/ray-project/ray.git -
trainer
AI repositoriesDistributed AI Model Training and LLM Fine-Tuning on Kubernetes
git clone https://github.com/kubeflow/trainer.git -
llm-d
AI repositoriesState of the art inference performance with modern accelerators on Kubernetes
git clone https://github.com/llm-d/llm-d.git -
LocalAI
AI repositoriesLocalAI is the open-source AI engine. Run any model - LLMs, vision, voice, image, video - on any hardware. No GPU required.
git clone https://github.com/mudler/LocalAI.git -
milvus
AI repositoriesMilvus is a high-performance, cloud-native vector database built for scalable vector ANN search
git clone https://github.com/milvus-io/milvus.git -
metaflow
AI repositoriesBuild, Manage and Deploy AI/ML Systems
git clone https://github.com/Netflix/metaflow.git -
higgsfield
AI repositoriesFault-tolerant, highly scalable GPU orchestration, and a machine learning framework designed for training models with billions to trillions of parameters
git clone https://github.com/higgsfield-ai/higgsfield.git -
agi
AI repositoriesThe first distributed AGI system. Thousands of autonomous AI agents collaboratively train models, share experiments via P2P gossip, and push breakthroughs here. Fully peer-to-peer. Join from your browser or CLI.
git clone https://github.com/hyperspaceai/agi.git -
deepflow
AI repositorieseBPF Observability - Distributed Tracing and Profiling
git clone https://github.com/deepflowio/deepflow.git -
PaddleNLP
AI repositoriesEasy-to-use and powerful LLM and SLM library with awesome model zoo.
git clone https://github.com/PaddlePaddle/PaddleNLP.git -
superduper
AI repositoriesSuperduper: End-to-end framework for building custom AI applications and agents.
git clone https://github.com/superduper-io/superduper.git -
curvine
AI repositoriesAI-native, cloud-native file system in Rust. Full POSIX on object storage with a multi-tier distributed cache, for AI training, inference, and agents. CNCF Sandbox project.
git clone https://github.com/CurvineIO/curvine.git -
ai-infra-book
AI repositories《深入理解 AI Infra:量化分析与系统设计》(李博杰 著)开源书稿:从硬件约束和模型架构出发,量化推导 LLM 推理与训练系统设计。含全书正文、PDF、配套计算工具与实验
git clone https://github.com/bojieli/ai-infra-book.git -
gpustack
AI repositoriesA GPU cluster manager for high-performance AI model serving (vLLM, SGLang) and on-demand SSH-accessible GPU instances.
git clone https://github.com/gpustack/gpustack.git -
awesome-architecture
AI repositories🧭 Architecture-first system design: 26 bilingual tutorials, 25 architecture templates, and 6 end-to-end cases covering distributed systems, AI-native systems, RAG, coding Agents, and production trade-offs.
git clone https://github.com/study8677/awesome-architecture.git -
beta9
AI repositoriesUltrafast serverless GPU inference, sandboxes, and background jobs
git clone https://github.com/beam-cloud/beta9.git -
pooled
AI repositoriesPeer-to-peer LLM inference in the browser: pool your devices to run big open models, for chat and coding agents.
git clone https://github.com/Nehanth/pooled.git -
seatunnel
AI repositoriesSeaTunnel is a multimodal, high-performance, distributed, massive data integration tool.
git clone https://github.com/apache/seatunnel.git -
distrifuser
AI repositories[CVPR 2024 Highlight] DistriFusion: Distributed Parallel Inference for High-Resolution Diffusion Models
git clone https://github.com/mit-han-lab/distrifuser.git -
vearch
AI repositoriesDistributed vector search for AI-native applications
git clone https://github.com/vearch/vearch.git -
susanSayJava
AI repositoriesJava 面试八股文 + 企业级项目实战:Spring、Spring Boot、Spring Cloud、JVM、Redis、MySQL、分布式、微服务、AI Agent,附详细答案与学习路线。
git clone https://github.com/dvsusan/susanSayJava.git -
nodedb
AI repositoriesThe memory & storage database engine for AI agents. Multi-model, edge-to-cloud, PostgreSQL-compatible. Supports graph, vector, array, timeseries.
git clone https://github.com/NodeDB-Lab/nodedb.git
Indexed entries aren't reviewed or tested by InnerVault. Details come straight from each source. Anything that can reach your accounts, files or browser can do damage, so read the source before you install it.