InnerVault

TensorFold

IndexedGitHub, ashhart

LLM Inference Engine for Metal, CUDA and Vulkan.

Open the source (opens github.com) https://github.com/ashhart/tensorfold

What it is

AI repositories from ashhart.

The problem it solves and who it suits haven't been reviewed by InnerVault. The description above is the source's own.

How to get it

Get the code

git clone https://github.com/ashhart/TensorFold.git

Standard git access to a public repository

Setup steps: not provided by the source. Follow the instructions on the source.

Related

  1. Atomic-Chat

    AI repositories

    Local AI app and inference engine for agents. Run open-weight LLMs locally — private, 100% offline on your computer. Join our Discord: https://discord.com/invite/8wGSsvmg4V

    Stale GitHub, AtomicBot-ai 1,808 ★Custom licence (see repository)Updated 30 days ago

    git clone https://github.com/AtomicBot-ai/Atomic-Chat.git
  2. awesome-ai-web-search

    AI repositories

    List of software that allows searching the web with the assistance of AI: https://hf.co/spaces/felladrin/awesome-ai-web-search

    Stale GitHub, felladrin 1,506 ★CC0-1.0Updated 10 days ago

    git clone https://github.com/felladrin/awesome-ai-web-search.git
  3. llm-action

    AI repositories

    本项目旨在分享大模型相关技术原理以及实战经验(大模型工程化、大模型应用落地)

    Stale GitHub, liguodongiot 25.2k ★Apache-2.0Updated 33 days ago

    git clone https://github.com/liguodongiot/llm-action.git
  4. PowerInfer

    AI repositories

    High-speed Large Language Model Serving for Local Deployment

    Stale GitHub, Tiiny-AI 9,828 ★MITUpdated 6 months ago

    git clone https://github.com/Tiiny-AI/PowerInfer.git
  5. litgpt

    AI repositories

    20+ high-performance LLMs with recipes to pretrain, finetune and deploy at scale.

    Stale GitHub, Lightning-AI 13.7k ★Apache-2.0Updated 34 days ago

    git clone https://github.com/Lightning-AI/litgpt.git
  6. mistral.rs

    AI repositories

    Fast, flexible LLM inference

    Stale GitHub, EricLBuehler 7,821 ★MITUpdated 7 days ago

    git clone https://github.com/EricLBuehler/mistral.rs.git