InnerVault

awsome-distributed-ai

IndexedGitHub, awslabs

Best practices, reference architectures, and examples for distributed AI training and inference on AWS.

Open the source (opens github.com) https://github.com/awslabs/awsome-distributed-ai

What it is

AI repositories from awslabs.

The problem it solves and who it suits haven't been reviewed by InnerVault. The description above is the source's own.

How to get it

Get the code

git clone https://github.com/awslabs/awsome-distributed-ai.git

Standard git access to a public repository

Setup steps: not provided by the source. Follow the instructions on the source.

Related

  1. metaflow

    AI repositories

    Build, Manage and Deploy AI/ML Systems

    Stale GitHub, Netflix 10.3k ★Apache-2.0Updated 7 days ago

    git clone https://github.com/Netflix/metaflow.git
  2. llm-d

    AI repositories

    State of the art inference performance with modern accelerators on Kubernetes

    Indexed GitHub, llm-d 5,274 ★Apache-2.0Updated today

    git clone https://github.com/llm-d/llm-d.git
  3. gpustack

    AI repositories

    A GPU cluster manager for high-performance AI model serving (vLLM, SGLang) and on-demand SSH-accessible GPU instances.

    Indexed GitHub, gpustack 6,039 ★Apache-2.0Updated 3 days ago

    git clone https://github.com/gpustack/gpustack.git
  4. pooled

    AI repositories

    Peer-to-peer LLM inference in the browser: pool your devices to run big open models, for chat and coding agents.

    Stale GitHub, Nehanth 589 ★MITUpdated 31 days ago

    git clone https://github.com/Nehanth/pooled.git
  5. PaddleNLP

    AI repositories

    Easy-to-use and powerful LLM and SLM library with awesome model zoo.

    Stale GitHub, PaddlePaddle 13.0k ★Apache-2.0Updated 5 months ago

    git clone https://github.com/PaddlePaddle/PaddleNLP.git
  6. diy-llm

    AI repositories

    Covers pre-training data, Tokenizer, Transformer, MoE,distributed training, Scaling Laws, inference & alignment .6 progressive code assignments for full-stack LLM learning | 涵盖预训练数据、分词器、Transformer、MoE、分布式训练、缩放定律、推理与对齐,6 项渐进代码作业,掌握 LLM 全栈知识

    Stale GitHub, datawhalechina 2,648 ★Updated 14 days ago

    git clone https://github.com/datawhalechina/diy-llm.git