InnerVault

mistral.rs

Stale GitHub, EricLBuehler

Fast, flexible LLM inference

Open the source (opens github.com) https://github.com/ericlbuehler/mistral.rs

What it is

AI repositories from EricLBuehler.

The problem it solves and who it suits haven't been reviewed by InnerVault. The description above is the source's own.

How to get it

Get the code

git clone https://github.com/EricLBuehler/mistral.rs.git

Standard git access to a public repository

Setup steps: not provided by the source. Follow the instructions on the source.

Related

  1. langchain-rust

    AI repositories

    🦜️🔗LangChain for Rust, the easiest way to write LLM-based programs in Rust

    Stale GitHub, Abraxas-365 1,359 ★MITUpdated 13 days ago

    git clone https://github.com/Abraxas-365/langchain-rust.git
  2. litellm

    AI repositories

    The fastest, litest AI Gateway. Rust core with Python SDK. Call 100+ LLM APIs in OpenAI (or native) format with cost tracking, guardrails, load balancing, and logging [Bedrock, Azure, OpenAI, Anthropic, OpenAI, VertexAI, vLLM, Nvidia NIM]

    Indexed GitHub, BerriAI 63.3k ★Custom licence (see repository)Updated today

    git clone https://github.com/BerriAI/litellm.git
  3. rig

    AI repositories

    ⚙️🦀 Build modular and scalable LLM Applications in Rust

    Indexed GitHub, 0xPlaygrounds 9,156 ★MITUpdated today

    git clone https://github.com/0xPlaygrounds/rig.git
  4. rtk

    AI repositories

    CLI proxy that reduces LLM token consumption by 60-90% on common dev commands. Single Rust binary, zero dependencies

    Stale GitHub, rtk-ai 86.3k ★Apache-2.0Updated 4 days ago

    git clone https://github.com/rtk-ai/rtk.git
  5. TauriTavern

    AI repositories

    The classic Sillytavern, now has been rewritten in Tauri/Rust.

    Stale GitHub, Darkatse 2,272 ★AGPL-3.0Updated 4 days ago

    git clone https://github.com/Darkatse/TauriTavern.git
  6. jcode

    AI repositories

    High performance coding agent harness written in Rust, built for heavy multi-agent dev workflows

    Indexed GitHub, 1jehuang 21.8k ★MITUpdated today

    git clone https://github.com/1jehuang/jcode.git