InnerVault

LightLLM

IndexedGitHub, ModelTC

LightLLM is a Python-based LLM (Large Language Model) inference and serving framework, notable for its lightweight design, easy scalability, and high-speed performance.

Open the source (opens github.com) https://github.com/modeltc/lightllm

What it is

AI repositories from ModelTC.

The problem it solves and who it suits haven't been reviewed by InnerVault. The description above is the source's own.

How to get it

Get the code

git clone https://github.com/ModelTC/LightLLM.git

Standard git access to a public repository

Setup steps: not provided by the source. Follow the instructions on the source.

Related

  1. vectordb-recipes

    AI repositories

    Resource, examples & tutorials for multimodal AI, RAG and agents using vector search and LLMs

    Stale GitHub, lancedb 986 ★Apache-2.0Updated 12 days ago

    git clone https://github.com/lancedb/vectordb-recipes.git
  2. AITreasureBox

    AI repositories

    🤖 Automatically collected AI repos, tools, websites, papers & tutorials. 实用AI百宝箱 💎

    Indexed GitHub, superiorlu 927 ★GPL-3.0Updated today

    git clone https://github.com/superiorlu/AITreasureBox.git
  3. xTuring

    AI repositories

    Build, personalize and control your own LLMs. From data pre-processing to fine-tuning, xTuring provides an easy way to personalize open-source LLMs. Join our discord community: https://discord.gg/TgHXuSJEk6

    Stale GitHub, stochasticai 2,679 ★Apache-2.0Updated 11 days ago

    git clone https://github.com/stochasticai/xTuring.git
  4. tensorzero

    AI repositories

    TensorZero is an open-source LLMOps platform that unifies an LLM gateway, observability, evaluation, optimization, and experimentation.

    Stale Archived GitHub, tensorzero 11.7k ★Apache-2.0Updated 5 months ago 1 note

    git clone https://github.com/tensorzero/tensorzero.git
  5. transformer-explainer

    AI repositories

    Transformer Explained Visually: Learn How LLM Transformer Models Work with Interactive Visualization

    Stale GitHub, poloclub 8,973 ★MITUpdated 5 months ago

    git clone https://github.com/poloclub/transformer-explainer.git
  6. llama-gpt

    AI repositories

    A self-hosted, offline, ChatGPT-like chatbot. Powered by Llama 2. 100% private, with no data leaving your device. New: Code Llama support!

    Stale GitHub, getumbrel 10.9k ★MITUpdated 2 years ago

    git clone https://github.com/getumbrel/llama-gpt.git