Library
85,340 resources from 11 public sources. 54 checked by hand; the rest are unreviewed.
Results
-
TuyaOpen
AI repositoriesNext-gen AI+IoT framework for T2/T3/T5AI/ESP32/and more – Fast IoT and AI Agent hardware integration
git clone https://github.com/tuya/TuyaOpen.git -
llmfit
AI repositoriesHundreds of models & providers. One command to find what runs on your hardware.
git clone https://github.com/AlexsJones/llmfit.git -
OmAgent
AI repositories[EMNLP-2024] Build multimodal language agents for fast prototype and production
git clone https://github.com/om-ai-lab/OmAgent.git -
vllm-metal
AI repositoriesCommunity maintained hardware plugin for vLLM on Apple Silicon
git clone https://github.com/vllm-project/vllm-metal.git -
ElatoAI
AI repositoriesRealtime Voice AI with 100+ Models on Arduino ESP32 with Secure Websockets and Edge Functions for AI Companions, and Devices
git clone https://github.com/akdeb/ElatoAI.git -
vllm-ascend
AI repositoriesCommunity maintained hardware plugin for vLLM on Huawei Ascend
git clone https://github.com/vllm-project/vllm-ascend.git -
LocalAI
AI repositoriesLocalAI is the open-source AI engine. Run any model - LLMs, vision, voice, image, video - on any hardware. No GPU required.
git clone https://github.com/mudler/LocalAI.git -
TinyLLM
AI repositoriesSetup and run a local LLM and Chatbot using consumer grade hardware.
git clone https://github.com/jasonacox/TinyLLM.git -
moltis
AI repositoriesA secure persistent personal agent server in Rust. One binary, sandboxed execution, multi-provider LLMs, voice, memory, Telegram, WhatsApp, Discord, Teams, and MCP tools. Secure by design, runs on your hardware.
git clone https://github.com/moltis-org/moltis.git -
inference
AI repositoriesOpen-source inference platform for language, vision, embedding, reranking, image, audio, and video models. Deploy with multiple engines across heterogeneous hardware, from a laptop to a distributed cluster. Serve models through OpenAI-compatible APIs.
git clone https://github.com/xorbitsai/inference.git -
yzma
AI repositoriesGo with your own intelligence - Write Go applications that directly integrate llama.cpp for local inference using hardware acceleration on Linux, macOS, Windows, & WebAssembly.
git clone https://github.com/hybridgroup/yzma.git -
openmed
AI repositoriesLocal-first healthcare AI: clinical NER and HIPAA PII de-identification on hardware you control. 2,200+ medical models, 35 model-backed PII languages, and Python, MLX, Android and browser runtimes. Apache-2.0 SDK.
git clone https://github.com/maziyarpanahi/openmed.git -
BigMoeOnEdge
AI repositoriesRun MoE models bigger than your RAM. Frontier-size MoE on a phone, laptop, edge. Lossless, on stock llama.cpp. An adaptive streaming optimizer. Any hardware, any OS, any model, any quantization, behind a local OpenAI-compatible server.
git clone https://github.com/Helldez/BigMoeOnEdge.git
Indexed entries aren't reviewed or tested by InnerVault. Details come straight from each source. Anything that can reach your accounts, files or browser can do damage, so read the source before you install it.