InnerVault

Library

85,340 resources from 11 public sources. 54 checked by hand; the rest are unreviewed.

Results

  1. awsome-distributed-ai

    AI repositories

    Best practices, reference architectures, and examples for distributed AI training and inference on AWS.

    Indexed GitHub, awslabs 498 ★MIT-0Updated 2 days ago

    git clone https://github.com/awslabs/awsome-distributed-ai.git
  2. mesh-llm

    AI repositories

    Distributed AI/LLM for the people. Share compute privately or publicly to power your agents and chat.

    Indexed GitHub, Mesh-LLM 4,130 ★Apache-2.0Updated today

    git clone https://github.com/Mesh-LLM/mesh-llm.git
  3. ray

    AI repositories

    Ray is an AI compute engine. Ray consists of a core distributed runtime and a set of AI Libraries for accelerating ML workloads.

    Indexed GitHub, ray-project 44.3k ★Apache-2.0Updated today

    git clone https://github.com/ray-project/ray.git
  4. trainer

    AI repositories

    Distributed AI Model Training and LLM Fine-Tuning on Kubernetes

    Stale GitHub, kubeflow 2,273 ★Apache-2.0Updated 10 days ago

    git clone https://github.com/kubeflow/trainer.git
  5. llm-d

    AI repositories

    State of the art inference performance with modern accelerators on Kubernetes

    Indexed GitHub, llm-d 5,274 ★Apache-2.0Updated today

    git clone https://github.com/llm-d/llm-d.git
  6. LocalAI

    AI repositories

    LocalAI is the open-source AI engine. Run any model - LLMs, vision, voice, image, video - on any hardware. No GPU required.

    Indexed GitHub, mudler 50.4k ★MITUpdated today

    git clone https://github.com/mudler/LocalAI.git
  7. milvus

    AI repositories

    Milvus is a high-performance, cloud-native vector database built for scalable vector ANN search

    Indexed GitHub, milvus-io 46.7k ★Apache-2.0Updated today

    git clone https://github.com/milvus-io/milvus.git
  8. metaflow

    AI repositories

    Build, Manage and Deploy AI/ML Systems

    Stale GitHub, Netflix 10.3k ★Apache-2.0Updated 7 days ago

    git clone https://github.com/Netflix/metaflow.git
  9. higgsfield

    AI repositories

    Fault-tolerant, highly scalable GPU orchestration, and a machine learning framework designed for training models with billions to trillions of parameters

    Stale GitHub, higgsfield-ai 6,021 ★Apache-2.0Updated 40 days ago

    git clone https://github.com/higgsfield-ai/higgsfield.git
  10. agi

    AI repositories

    The first distributed AGI system. Thousands of autonomous AI agents collaboratively train models, share experiments via P2P gossip, and push breakthroughs here. Fully peer-to-peer. Join from your browser or CLI.

    Stale GitHub, hyperspaceai 2,071 ★MITUpdated 32 days ago

    git clone https://github.com/hyperspaceai/agi.git
  11. deepflow

    AI repositories

    eBPF Observability - Distributed Tracing and Profiling

    Stale GitHub, deepflowio 4,310 ★Apache-2.0Updated 17 days ago

    git clone https://github.com/deepflowio/deepflow.git
  12. PaddleNLP

    AI repositories

    Easy-to-use and powerful LLM and SLM library with awesome model zoo.

    Stale GitHub, PaddlePaddle 13.0k ★Apache-2.0Updated 5 months ago

    git clone https://github.com/PaddlePaddle/PaddleNLP.git
  13. superduper

    AI repositories

    Superduper: End-to-end framework for building custom AI applications and agents.

    Stale GitHub, superduper-io 5,327 ★Apache-2.0Updated 14 months ago

    git clone https://github.com/superduper-io/superduper.git
  14. curvine

    AI repositories

    AI-native, cloud-native file system in Rust. Full POSIX on object storage with a multi-tier distributed cache, for AI training, inference, and agents. CNCF Sandbox project.

    Indexed GitHub, CurvineIO 1,068 ★Apache-2.0Updated yesterday

    git clone https://github.com/CurvineIO/curvine.git
  15. ai-infra-book

    AI repositories

    《深入理解 AI Infra:量化分析与系统设计》(李博杰 著)开源书稿:从硬件约束和模型架构出发,量化推导 LLM 推理与训练系统设计。含全书正文、PDF、配套计算工具与实验

    Stale GitHub, bojieli 6,489 ★Apache-2.0Updated 46 days ago

    git clone https://github.com/bojieli/ai-infra-book.git
  16. gpustack

    AI repositories

    A GPU cluster manager for high-performance AI model serving (vLLM, SGLang) and on-demand SSH-accessible GPU instances.

    Indexed GitHub, gpustack 6,039 ★Apache-2.0Updated 3 days ago

    git clone https://github.com/gpustack/gpustack.git
  17. awesome-architecture

    AI repositories

    🧭 Architecture-first system design: 26 bilingual tutorials, 25 architecture templates, and 6 end-to-end cases covering distributed systems, AI-native systems, RAG, coding Agents, and production trade-offs.

    Stale GitHub, study8677 2,526 ★MITUpdated 5 days ago

    git clone https://github.com/study8677/awesome-architecture.git
  18. beta9

    AI repositories

    Ultrafast serverless GPU inference, sandboxes, and background jobs

    Indexed GitHub, beam-cloud 1,852 ★AGPL-3.0Updated today

    git clone https://github.com/beam-cloud/beta9.git
  19. pooled

    AI repositories

    Peer-to-peer LLM inference in the browser: pool your devices to run big open models, for chat and coding agents.

    Stale GitHub, Nehanth 589 ★MITUpdated 31 days ago

    git clone https://github.com/Nehanth/pooled.git
  20. seatunnel

    AI repositories

    SeaTunnel is a multimodal, high-performance, distributed, massive data integration tool.

    Stale GitHub, apache 9,795 ★Apache-2.0Updated 6 days ago

    git clone https://github.com/apache/seatunnel.git
  21. distrifuser

    AI repositories

    [CVPR 2024 Highlight] DistriFusion: Distributed Parallel Inference for High-Resolution Diffusion Models

    Stale GitHub, mit-han-lab 732 ★MITUpdated 23 months ago

    git clone https://github.com/mit-han-lab/distrifuser.git
  22. vearch

    AI repositories

    Distributed vector search for AI-native applications

    Stale GitHub, vearch 2,331 ★Apache-2.0Updated 3 months ago

    git clone https://github.com/vearch/vearch.git
  23. susanSayJava

    AI repositories

    Java 面试八股文 + 企业级项目实战:Spring、Spring Boot、Spring Cloud、JVM、Redis、MySQL、分布式、微服务、AI Agent,附详细答案与学习路线。

    Indexed GitHub, dvsusan 484 ★Updated today

    git clone https://github.com/dvsusan/susanSayJava.git
  24. nodedb

    AI repositories

    The memory & storage database engine for AI agents. Multi-model, edge-to-cloud, PostgreSQL-compatible. Supports graph, vector, array, timeseries.

    Indexed GitHub, NodeDB-Lab 247 ★Custom licence (see repository)Updated today

    git clone https://github.com/NodeDB-Lab/nodedb.git

Indexed entries aren't reviewed or tested by InnerVault. Details come straight from each source. Anything that can reach your accounts, files or browser can do damage, so read the source before you install it.