InnerVault

ipex-llm

Stale ArchivedGitHub, intel

Accelerate local LLM inference and finetuning (LLaMA, Mistral, ChatGLM, Qwen, DeepSeek, Mixtral, Gemma, Phi, MiniCPM, Qwen-VL, MiniCPM-V, etc.) on Intel XPU (e.g., local PC with iGPU and NPU, discrete GPU such as Arc, Flex and Max); seamlessly integrate with llama.cpp, Ollama, HuggingFace, LangChain, LlamaIndex, vLLM, DeepSpeed, Axolotl, etc.

Open the source (opens github.com) https://github.com/intel/ipex-llm

Before you use it

  • Archived by its owner: read-only and no longer maintained.

What it is

AI repositories from intel.

The problem it solves and who it suits haven't been reviewed by InnerVault. The description above is the source's own.

How to get it

Get the code

git clone https://github.com/intel/ipex-llm.git

Standard git access to a public repository

Setup steps: not provided by the source. Follow the instructions on the source.

Related

  1. ml-engineering

    AI repositories

    Machine Learning Engineering Open Book

    Stale GitHub, stas00 19.7k ★CC-BY-SA-4.0Updated 12 days ago

    git clone https://github.com/stas00/ml-engineering.git
  2. Soup

    AI repositories

    Fine-tune LLMs from one YAML. Layer streaming trains an 8B model on a 4 GB laptop GPU.

    Stale GitHub, MakazhanAlpamys 10.3k ★Apache-2.0Updated 9 days ago

    git clone https://github.com/MakazhanAlpamys/Soup.git
  3. chitu

    AI repositories

    High-performance inference framework for large language models, focusing on efficiency, flexibility, and availability.

    Stale GitHub, thu-pacman 2,998 ★Apache-2.0Updated 11 days ago

    git clone https://github.com/thu-pacman/chitu.git
  4. trainer

    AI repositories

    Distributed AI Model Training and LLM Fine-Tuning on Kubernetes

    Stale GitHub, kubeflow 2,273 ★Apache-2.0Updated 10 days ago

    git clone https://github.com/kubeflow/trainer.git
  5. nano-vllm

    AI repositories

    Nano vLLM

    Stale GitHub, GeeeekExplorer 15.8k ★MITUpdated 6 months ago

    git clone https://github.com/GeeeekExplorer/nano-vllm.git
  6. transformers

    AI repositories

    🤗 Transformers: the model-definition framework for state-of-the-art machine learning models in text, vision, audio, and multimodal models, for both inference and training.

    Indexed GitHub, huggingface 169.0k ★Apache-2.0Updated today

    git clone https://github.com/huggingface/transformers.git