web-llm
High-performance In-browser LLM Inference Engine
Open the source (opens github.com) https://github.com/mlc-ai/web-llm
What it is
AI repositories from mlc-ai.
The problem it solves and who it suits haven't been reviewed by InnerVault. The description above is the source's own.
How to get it
Get the code
git clone https://github.com/mlc-ai/web-llm.git
Standard git access to a public repository
Setup steps: not provided by the source. Follow the instructions on the source.
Related
-
web-llm-chat
AI repositoriesChat with AI large language models running natively in your browser. Enjoy private, server-free, seamless AI conversations.
git clone https://github.com/mlc-ai/web-llm-chat.git -
LLMs-from-scratch
AI repositoriesImplement a ChatGPT-like LLM in PyTorch from scratch, step by step
git clone https://github.com/rasbt/LLMs-from-scratch.git -
litgpt
AI repositories20+ high-performance LLMs with recipes to pretrain, finetune and deploy at scale.
git clone https://github.com/Lightning-AI/litgpt.git -
Efficient-LLMs-Survey
AI repositories[TMLR 2024] Efficient Large Language Models: A Survey
git clone https://github.com/AIoT-MLSys-Lab/Efficient-LLMs-Survey.git -
ray
AI repositoriesRay is an AI compute engine. Ray consists of a core distributed runtime and a set of AI Libraries for accelerating ML workloads.
git clone https://github.com/ray-project/ray.git -
reasoning-from-scratch
AI repositoriesImplement a reasoning LLM in PyTorch from scratch, step by step
git clone https://github.com/rasbt/reasoning-from-scratch.git