InnerVault

mistral-inference

Stale ArchivedGitHub, mistralai

Official inference library for Mistral models

Open the source (opens github.com) https://github.com/mistralai/mistral-inference

Before you use it

  • Archived by its owner: read-only and no longer maintained.

What it is

AI repositories from mistralai.

The problem it solves and who it suits haven't been reviewed by InnerVault. The description above is the source's own.

How to get it

Get the code

git clone https://github.com/mistralai/mistral-inference.git

Standard git access to a public repository

Setup steps: not provided by the source. Follow the instructions on the source.

Related

  1. llm-action

    AI repositories

    本项目旨在分享大模型相关技术原理以及实战经验(大模型工程化、大模型应用落地)

    Stale GitHub, liguodongiot 25.2k ★Apache-2.0Updated 33 days ago

    git clone https://github.com/liguodongiot/llm-action.git
  2. TensorFold

    AI repositories

    LLM Inference Engine for Metal, CUDA and Vulkan.

    Indexed GitHub, ashhart 2,266 ★Apache-2.0Updated today

    git clone https://github.com/ashhart/TensorFold.git
  3. PowerInfer

    AI repositories

    High-speed Large Language Model Serving for Local Deployment

    Stale GitHub, Tiiny-AI 9,828 ★MITUpdated 6 months ago

    git clone https://github.com/Tiiny-AI/PowerInfer.git
  4. litgpt

    AI repositories

    20+ high-performance LLMs with recipes to pretrain, finetune and deploy at scale.

    Stale GitHub, Lightning-AI 13.7k ★Apache-2.0Updated 34 days ago

    git clone https://github.com/Lightning-AI/litgpt.git
  5. mistral.rs

    AI repositories

    Fast, flexible LLM inference

    Stale GitHub, EricLBuehler 7,821 ★MITUpdated 7 days ago

    git clone https://github.com/EricLBuehler/mistral.rs.git
  6. lmdeploy

    AI repositories

    LMDeploy is a toolkit for compressing, deploying, and serving LLMs.

    Stale GitHub, InternLM 8,136 ★Apache-2.0Updated 6 days ago

    git clone https://github.com/InternLM/lmdeploy.git