TensorFold
LLM Inference Engine for Metal, CUDA and Vulkan.
Open the source (opens github.com) https://github.com/ashhart/tensorfold
What it is
AI repositories from ashhart.
The problem it solves and who it suits haven't been reviewed by InnerVault. The description above is the source's own.
How to get it
Get the code
git clone https://github.com/ashhart/TensorFold.git
Standard git access to a public repository
Setup steps: not provided by the source. Follow the instructions on the source.
Related
-
Atomic-Chat
AI repositoriesLocal AI app and inference engine for agents. Run open-weight LLMs locally — private, 100% offline on your computer. Join our Discord: https://discord.com/invite/8wGSsvmg4V
git clone https://github.com/AtomicBot-ai/Atomic-Chat.git -
awesome-ai-web-search
AI repositoriesList of software that allows searching the web with the assistance of AI: https://hf.co/spaces/felladrin/awesome-ai-web-search
git clone https://github.com/felladrin/awesome-ai-web-search.git -
llm-action
AI repositories本项目旨在分享大模型相关技术原理以及实战经验(大模型工程化、大模型应用落地)
git clone https://github.com/liguodongiot/llm-action.git -
PowerInfer
AI repositoriesHigh-speed Large Language Model Serving for Local Deployment
git clone https://github.com/Tiiny-AI/PowerInfer.git -
litgpt
AI repositories20+ high-performance LLMs with recipes to pretrain, finetune and deploy at scale.
git clone https://github.com/Lightning-AI/litgpt.git -
mistral.rs
AI repositoriesFast, flexible LLM inference
git clone https://github.com/EricLBuehler/mistral.rs.git