Library
85,762 resources from 11 public sources. 53 checked by hand; the rest are unreviewed.
Results
-
LodeDB
AI repositoriesWorld's fastest and most compact embedded vector database: exact by default, multimodal, local-first, and GPU-accelerated
git clone https://github.com/Egoist-Machines/LodeDB.git -
diy-llm
AI repositoriesCovers pre-training data, Tokenizer, Transformer, MoE,distributed training, Scaling Laws, inference & alignment .6 progressive code assignments for full-stack LLM learning | 涵盖预训练数据、分词器、Transformer、MoE、分布式训练、缩放定律、推理与对齐,6 项渐进代码作业,掌握 LLM 全栈知识
git clone https://github.com/datawhalechina/diy-llm.git -
SiliconScope
AI repositoriesSudoless Apple Silicon system monitor (native SwiftUI GUI) with ANE / Media Engine / memory-bandwidth tracking
git clone https://github.com/kennss/SiliconScope.git -
chatllm.cpp
AI repositoriesPure C++ implementation of several models for real-time chatting on your computer (CPU & GPU)
git clone https://github.com/foldl/chatllm.cpp.git -
postgresml
AI repositoriesPostgres with GPUs for ML/AI apps.
git clone https://github.com/postgresml/postgresml.git -
rapidfireai
AI repositoriesRapidFire AI: Rapid AI Customization from RAG to Fine-Tuning
git clone https://github.com/RapidFireAI/rapidfireai.git -
LocalAI
AI repositoriesLocalAI is the open-source AI engine. Run any model - LLMs, vision, voice, image, video - on any hardware. No GPU required.
git clone https://github.com/mudler/LocalAI.git -
pegainfer
AI repositoriesPure Rust + CUDA LLM inference engine — no PyTorch, OpenAI-compatible, serves Qwen3 to Kimi-K2
git clone https://github.com/pegainfer-project/pegainfer.git -
higgsfield
AI repositoriesFault-tolerant, highly scalable GPU orchestration, and a machine learning framework designed for training models with billions to trillions of parameters
git clone https://github.com/higgsfield-ai/higgsfield.git -
GenieX
AI repositoriesRun frontier LLMs and VLMs locally on Qualcomm devices across NPU, GPU, and CPU with a few lines of code
git clone https://github.com/qualcomm/GenieX.git -
MiniSearch
AI repositoriesMinimalist web-searching platform with an AI assistant that runs directly from your browser. Demo: https://felladrin-minisearch.hf.space
git clone https://github.com/felladrin/MiniSearch.git -
OmniChar
AI repositoriesThe open .char format for consistent characters. Face, body, wardrobe & voice in one file, consistent across every model.
git clone https://github.com/omnichar/OmniChar.git -
halogen-flash-server
AI repositoriesLocal inference that behaves like a frontier API: Qwen3.8-Flash-Next on AMD Strix Halo plus small NPU models, over the OpenAI and Anthropic APIs on one port.
git clone https://github.com/peonist-ai/halogen-flash-server.git -
raft
AI repositoriesRAFT contains fundamental widely-used algorithms and primitives for machine learning and information retrieval. The algorithms are CUDA-accelerated and form building blocks for more easily writing high performance applications.
git clone https://github.com/NVIDIA/raft.git -
ipex-llm
AI repositoriesAccelerate local LLM inference and finetuning (LLaMA, Mistral, ChatGLM, Qwen, DeepSeek, Mixtral, Gemma, Phi, MiniCPM, Qwen-VL, MiniCPM-V, etc.) on Intel XPU (e.g., local PC with iGPU and NPU, discrete GPU such as Arc, Flex and Max); seamlessly integrate with llama.cpp, Ollama, HuggingFace, LangChain, LlamaIndex, vLLM, DeepSpeed, Axolotl, etc.
git clone https://github.com/intel/ipex-llm.git -
ShannonBase
AI repositoriesThe Next-Gen Database for AI—an infrastructure designed for data and AI. As the MySQL of the AI era.
git clone https://github.com/Shannon-Data/ShannonBase.git -
kimi-k3-in-c
AI repositoriesA 2.78-trillion-parameter Kimi K3 running inference on a single CPU in 8.24 GB of RAM. Portable C99: no BLAS, no framework, no GPU.
git clone https://github.com/FareedKhan-dev/kimi-k3-in-c.git -
paddler
AI repositoriesOpen-source LLM/VLM load balancer and serving platform for self-hosting LLMs (and VLMs) at scale 🏓🦙 Alternative to projects like llm-d, Docker Model Runner, etc but with less moving parts and simple deployments built around ggml ecosystem. Runs on CPU and GPU.
git clone https://github.com/intentee/paddler.git -
ome
AI repositoriesOpen Model Engine (OME) — Kubernetes operator for LLM serving, GPU scheduling, and model lifecycle management. Works with SGLang, vLLM, TensorRT-LLM, and Triton
git clone https://github.com/ome-projects/ome.git -
project-maya
AI repositoriesProject Maya - run GLM-5.3-Flash (321B MoE), DeepSeek-V4.1-Flash-1017 (748B MoE) and MiniMax-M3.1-Flash (428B MoE) privately on your own GPU(s), from one card to 16, NVIDIA or AMD, Linux or Windows. Engine, server, dashboard, OpenAI- and Anthropic-compatible API, quant tools.
git clone https://github.com/mw00/project-maya.git -
TensorSharp
AI repositoriesA native .NET LLM inference engine and agent runtime for GGUF models. TensorSharp provides a console application, a web-based chatbot interface, iPhone App, and Ollama/OpenAI-compatible HTTP APIs for programmatic access. It supports Windows/MacOS/iOS/Linux with full GPU capability
git clone https://github.com/zhongkaifu/TensorSharp.git -
janas
AI repositories37 tok/s from Qwen3-Next-80B (48 GB) on a 32 GB laptop, 24 without drafts vs 2.8 for llama.cpp; reading 62 vs 16 tok/s. Faster than llama.cpp on all 13 models compared in Q4_K_M. LLMs bigger than your RAM, pure C, CPU or GPU.
git clone https://github.com/prabanta-dev/janas.git -
video-search-and-summarization
AI repositoriesNVIDIA AI Blueprint for video search and summarization (VSS) is a GPU-accelerated reference architecture for building video analytics agents with real-time verified alerts, visual Q&A, and automated reporting. The VSS Blueprint uses vision language models (VLMs) such as NVIDIA Cosmos, LLMs such as NVIDIA Nemotron, RAG, and NVIDIA NIMs.
git clone https://github.com/NVIDIA-AI-Blueprints/video-search-and-summarization.git -
self-hosted-ai-stack
AI repositoriesDeploy a self-hosted AI stack with Docker Compose: local LLMs, chat, document parsing, embeddings, transcription, text-to-speech and MCP tools. Powered by Ollama, LiteLLM, AnythingLLM and more. Local-first with auto-configured authentication, lightweight stacks, optional HTTPS and NVIDIA GPU support. MIT licensed. Multi-arch: amd64, arm64.
git clone https://github.com/hwdsl2/self-hosted-ai-stack.git
Indexed entries aren't reviewed or tested by InnerVault. Details come straight from each source. Anything that can reach your accounts, files or browser can do damage, so read the source before you install it.