mistral.rs
Fast, flexible LLM inference
Open the source (opens github.com) https://github.com/ericlbuehler/mistral.rs
What it is
AI repositories from EricLBuehler.
The problem it solves and who it suits haven't been reviewed by InnerVault. The description above is the source's own.
How to get it
Get the code
git clone https://github.com/EricLBuehler/mistral.rs.git
Standard git access to a public repository
Setup steps: not provided by the source. Follow the instructions on the source.
Related
-
langchain-rust
AI repositories🦜️🔗LangChain for Rust, the easiest way to write LLM-based programs in Rust
git clone https://github.com/Abraxas-365/langchain-rust.git -
litellm
AI repositoriesThe fastest, litest AI Gateway. Rust core with Python SDK. Call 100+ LLM APIs in OpenAI (or native) format with cost tracking, guardrails, load balancing, and logging [Bedrock, Azure, OpenAI, Anthropic, OpenAI, VertexAI, vLLM, Nvidia NIM]
git clone https://github.com/BerriAI/litellm.git -
rig
AI repositories⚙️🦀 Build modular and scalable LLM Applications in Rust
git clone https://github.com/0xPlaygrounds/rig.git -
rtk
AI repositoriesCLI proxy that reduces LLM token consumption by 60-90% on common dev commands. Single Rust binary, zero dependencies
git clone https://github.com/rtk-ai/rtk.git -
TauriTavern
AI repositoriesThe classic Sillytavern, now has been rewritten in Tauri/Rust.
git clone https://github.com/Darkatse/TauriTavern.git -
jcode
AI repositoriesHigh performance coding agent harness written in Rust, built for heavy multi-agent dev workflows
git clone https://github.com/1jehuang/jcode.git