mlc-llm
Universal LLM Deployment Engine with ML Compilation
Open the source (opens github.com) https://github.com/mlc-ai/mlc-llm
What it is
AI repositories from mlc-ai.
The problem it solves and who it suits haven't been reviewed by InnerVault. The description above is the source's own.
How to get it
Get the code
git clone https://github.com/mlc-ai/mlc-llm.git
Standard git access to a public repository
Setup steps: not provided by the source. Follow the instructions on the source.
Related
-
web-llm
AI repositoriesHigh-performance In-browser LLM Inference Engine
git clone https://github.com/mlc-ai/web-llm.git -
tpu-mlir
AI repositoriesMachine learning compiler based on MLIR for Sophgo TPU.
git clone https://github.com/sophgo/tpu-mlir.git -
llm-course
AI repositoriesCourse to get into Large Language Models (LLMs) with roadmaps and Colab notebooks.
git clone https://github.com/mlabonne/llm-course.git -
Hands-On-Large-Language-Models
AI repositoriesOfficial code repo for the O'Reilly Book - "Hands-On Large Language Models"
git clone https://github.com/HandsOnLLM/Hands-On-Large-Language-Models.git -
LLMs-from-scratch
AI repositoriesImplement a ChatGPT-like LLM in PyTorch from scratch, step by step
git clone https://github.com/rasbt/LLMs-from-scratch.git -
awesome-japanese-llm
AI repositories日本語LLMまとめ - Overview of Japanese LLMs
git clone https://github.com/llm-jp/awesome-japanese-llm.git