InnerVault

nano-vllm

Stale GitHub, GeeeekExplorer

Nano vLLM

Open the source (opens github.com) https://github.com/geeeekexplorer/nano-vllm

What it is

AI repositories from GeeeekExplorer.

The problem it solves and who it suits haven't been reviewed by InnerVault. The description above is the source's own.

How to get it

Get the code

git clone https://github.com/GeeeekExplorer/nano-vllm.git

Standard git access to a public repository

Setup steps: not provided by the source. Follow the instructions on the source.

Related

  1. openvino

    AI repositories

    OpenVINO™ is an open source toolkit for optimizing and deploying AI inference

    Indexed GitHub, openvinotoolkit 11.2k ★Apache-2.0Updated today

    git clone https://github.com/openvinotoolkit/openvino.git
  2. sie

    AI repositories

    Open-source inference server and production cluster for all the models your agent needs.

    Indexed GitHub, superlinked 3,517 ★Apache-2.0Updated yesterday

    git clone https://github.com/superlinked/sie.git
  3. LightLLM

    AI repositories

    LightLLM is a Python-based LLM (Large Language Model) inference and serving framework, notable for its lightweight design, easy scalability, and high-speed performance.

    Indexed GitHub, ModelTC 4,362 ★Apache-2.0Updated today

    git clone https://github.com/ModelTC/LightLLM.git
  4. nncf

    AI repositories

    Neural Network Compression Framework for enhanced OpenVINO™ inference

    Stale GitHub, openvinotoolkit 1,217 ★Apache-2.0Updated 12 days ago

    git clone https://github.com/openvinotoolkit/nncf.git
  5. transformers

    AI repositories

    🤗 Transformers: the model-definition framework for state-of-the-art machine learning models in text, vision, audio, and multimodal models, for both inference and training.

    Indexed GitHub, huggingface 169.0k ★Apache-2.0Updated today

    git clone https://github.com/huggingface/transformers.git
  6. llm-foundry

    AI repositories

    LLM training code for Databricks foundation models

    Stale GitHub, mosaicml 4,455 ★Apache-2.0Updated 7 months ago

    git clone https://github.com/mosaicml/llm-foundry.git