LightLLM
LightLLM is a Python-based LLM (Large Language Model) inference and serving framework, notable for its lightweight design, easy scalability, and high-speed performance.
Open the source (opens github.com) https://github.com/modeltc/lightllm
What it is
AI repositories from ModelTC.
The problem it solves and who it suits haven't been reviewed by InnerVault. The description above is the source's own.
How to get it
Get the code
git clone https://github.com/ModelTC/LightLLM.git
Standard git access to a public repository
Setup steps: not provided by the source. Follow the instructions on the source.
Related
-
vectordb-recipes
AI repositoriesResource, examples & tutorials for multimodal AI, RAG and agents using vector search and LLMs
git clone https://github.com/lancedb/vectordb-recipes.git -
AITreasureBox
AI repositories🤖 Automatically collected AI repos, tools, websites, papers & tutorials. 实用AI百宝箱 💎
git clone https://github.com/superiorlu/AITreasureBox.git -
xTuring
AI repositoriesBuild, personalize and control your own LLMs. From data pre-processing to fine-tuning, xTuring provides an easy way to personalize open-source LLMs. Join our discord community: https://discord.gg/TgHXuSJEk6
git clone https://github.com/stochasticai/xTuring.git -
tensorzero
AI repositoriesTensorZero is an open-source LLMOps platform that unifies an LLM gateway, observability, evaluation, optimization, and experimentation.
git clone https://github.com/tensorzero/tensorzero.git -
transformer-explainer
AI repositoriesTransformer Explained Visually: Learn How LLM Transformer Models Work with Interactive Visualization
git clone https://github.com/poloclub/transformer-explainer.git -
llama-gpt
AI repositoriesA self-hosted, offline, ChatGPT-like chatbot. Powered by Llama 2. 100% private, with no data leaving your device. New: Code Llama support!
git clone https://github.com/getumbrel/llama-gpt.git