llm
[Unmaintained, see README] An ecosystem of Rust libraries for working with large language models
Open the source (opens github.com) https://github.com/rustformers/llm
Before you use it
- Archived by its owner: read-only and no longer maintained.
What it is
AI repositories from rustformers.
The problem it solves and who it suits haven't been reviewed by InnerVault. The description above is the source's own.
How to get it
Get the code
git clone https://github.com/rustformers/llm.git
Standard git access to a public repository
Setup steps: not provided by the source. Follow the instructions on the source.
Related
-
llama.vscode
AI repositoriesVS Code extension for LLM-assisted code/text completion
git clone https://github.com/ggml-org/llama.vscode.git -
Llamatik
AI repositoriesTrue on-device AI SDK for Kotlin Multiplatform (Android, iOS, Desktop, JVM, WASM). LLM inference, Speech-to-Text, Image Generation, Agent Framework and RAG — powered by llama.cpp, whisper.cpp and stable-diffusion.cpp.
git clone https://github.com/llamatik/Llamatik.git -
paddler
AI repositoriesOpen-source LLM/VLM load balancer and serving platform for self-hosting LLMs (and VLMs) at scale 🏓🦙 Alternative to projects like llm-d, Docker Model Runner, etc but with less moving parts and simple deployments built around ggml ecosystem. Runs on CPU and GPU.
git clone https://github.com/intentee/paddler.git -
ml-engineering
AI repositoriesMachine Learning Engineering Open Book
git clone https://github.com/stas00/ml-engineering.git -
metaflow
AI repositoriesBuild, Manage and Deploy AI/ML Systems
git clone https://github.com/Netflix/metaflow.git -
giskard-oss
AI repositories🐢 Open-Source Evaluation & Testing library for LLM Agents
git clone https://github.com/Giskard-AI/giskard-oss.git