InnerVault

Library

85,762 resources from 11 public sources. 53 checked by hand; the rest are unreviewed.

Results

  1. LodeDB

    AI repositories

    World's fastest and most compact embedded vector database: exact by default, multimodal, local-first, and GPU-accelerated

    Stale GitHub, Egoist-Machines 103 ★Apache-2.0Updated 29 days ago

    git clone https://github.com/Egoist-Machines/LodeDB.git
  2. diy-llm

    AI repositories

    Covers pre-training data, Tokenizer, Transformer, MoE,distributed training, Scaling Laws, inference & alignment .6 progressive code assignments for full-stack LLM learning | 涵盖预训练数据、分词器、Transformer、MoE、分布式训练、缩放定律、推理与对齐,6 项渐进代码作业,掌握 LLM 全栈知识

    Stale GitHub, datawhalechina 2,648 ★Updated 14 days ago

    git clone https://github.com/datawhalechina/diy-llm.git
  3. SiliconScope

    AI repositories

    Sudoless Apple Silicon system monitor (native SwiftUI GUI) with ANE / Media Engine / memory-bandwidth tracking

    Stale GitHub, kennss 1,013 ★MITUpdated 14 days ago

    git clone https://github.com/kennss/SiliconScope.git
  4. chatllm.cpp

    AI repositories

    Pure C++ implementation of several models for real-time chatting on your computer (CPU & GPU)

    Stale GitHub, foldl 932 ★MITUpdated 29 days ago

    git clone https://github.com/foldl/chatllm.cpp.git
  5. postgresml

    AI repositories

    Postgres with GPUs for ML/AI apps.

    Stale GitHub, postgresml 6,822 ★MITUpdated 16 months ago

    git clone https://github.com/postgresml/postgresml.git
  6. rapidfireai

    AI repositories

    RapidFire AI: Rapid AI Customization from RAG to Fine-Tuning

    Stale GitHub, RapidFireAI 174 ★Apache-2.0Updated 19 days ago

    git clone https://github.com/RapidFireAI/rapidfireai.git
  7. LocalAI

    AI repositories

    LocalAI is the open-source AI engine. Run any model - LLMs, vision, voice, image, video - on any hardware. No GPU required.

    Indexed GitHub, mudler 50.4k ★MITUpdated today

    git clone https://github.com/mudler/LocalAI.git
  8. pegainfer

    AI repositories

    Pure Rust + CUDA LLM inference engine — no PyTorch, OpenAI-compatible, serves Qwen3 to Kimi-K2

    Stale GitHub, pegainfer-project 729 ★Apache-2.0Updated 18 days ago

    git clone https://github.com/pegainfer-project/pegainfer.git
  9. higgsfield

    AI repositories

    Fault-tolerant, highly scalable GPU orchestration, and a machine learning framework designed for training models with billions to trillions of parameters

    Stale GitHub, higgsfield-ai 6,021 ★Apache-2.0Updated 40 days ago

    git clone https://github.com/higgsfield-ai/higgsfield.git
  10. GenieX

    AI repositories

    Run frontier LLMs and VLMs locally on Qualcomm devices across NPU, GPU, and CPU with a few lines of code

    Stale GitHub, qualcomm 8,494 ★BSD-3-ClauseUpdated 11 days ago

    git clone https://github.com/qualcomm/GenieX.git
  11. MiniSearch

    AI repositories

    Minimalist web-searching platform with an AI assistant that runs directly from your browser. Demo: https://felladrin-minisearch.hf.space

    Indexed GitHub, felladrin 609 ★Apache-2.0Updated today

    git clone https://github.com/felladrin/MiniSearch.git
  12. OmniChar

    AI repositories

    The open .char format for consistent characters. Face, body, wardrobe & voice in one file, consistent across every model.

    Stale GitHub, omnichar 572 ★GPL-3.0Updated 18 days ago

    git clone https://github.com/omnichar/OmniChar.git
  13. halogen-flash-server

    AI repositories

    Local inference that behaves like a frontier API: Qwen3.8-Flash-Next on AMD Strix Halo plus small NPU models, over the OpenAI and Anthropic APIs on one port.

    Stale GitHub, peonist-ai 1,258 ★Custom licence (see repository)Updated 8 days ago

    git clone https://github.com/peonist-ai/halogen-flash-server.git
  14. raft

    AI repositories

    RAFT contains fundamental widely-used algorithms and primitives for machine learning and information retrieval. The algorithms are CUDA-accelerated and form building blocks for more easily writing high performance applications.

    Stale GitHub, NVIDIA 1,051 ★Apache-2.0Updated 13 days ago

    git clone https://github.com/NVIDIA/raft.git
  15. ipex-llm

    AI repositories

    Accelerate local LLM inference and finetuning (LLaMA, Mistral, ChatGLM, Qwen, DeepSeek, Mixtral, Gemma, Phi, MiniCPM, Qwen-VL, MiniCPM-V, etc.) on Intel XPU (e.g., local PC with iGPU and NPU, discrete GPU such as Arc, Flex and Max); seamlessly integrate with llama.cpp, Ollama, HuggingFace, LangChain, LlamaIndex, vLLM, DeepSpeed, Axolotl, etc.

    Stale Archived GitHub, intel 8,846 ★Apache-2.0Updated 9 months ago 1 note

    git clone https://github.com/intel/ipex-llm.git
  16. ShannonBase

    AI repositories

    The Next-Gen Database for AI—an infrastructure designed for data and AI. As the MySQL of the AI era.

    Indexed GitHub, Shannon-Data 200 ★Custom licence (see repository)Updated today

    git clone https://github.com/Shannon-Data/ShannonBase.git
  17. kimi-k3-in-c

    AI repositories

    A 2.78-trillion-parameter Kimi K3 running inference on a single CPU in 8.24 GB of RAM. Portable C99: no BLAS, no framework, no GPU.

    Stale GitHub, FareedKhan-dev 9,049 ★Apache-2.0Updated 45 days ago

    git clone https://github.com/FareedKhan-dev/kimi-k3-in-c.git
  18. paddler

    AI repositories

    Open-source LLM/VLM load balancer and serving platform for self-hosting LLMs (and VLMs) at scale 🏓🦙 Alternative to projects like llm-d, Docker Model Runner, etc but with less moving parts and simple deployments built around ggml ecosystem. Runs on CPU and GPU.

    Stale GitHub, intentee 1,690 ★Apache-2.0Updated 9 days ago

    git clone https://github.com/intentee/paddler.git
  19. ome

    AI repositories

    Open Model Engine (OME) — Kubernetes operator for LLM serving, GPU scheduling, and model lifecycle management. Works with SGLang, vLLM, TensorRT-LLM, and Triton

    Stale GitHub, ome-projects 523 ★Apache-2.0Updated 13 days ago

    git clone https://github.com/ome-projects/ome.git
  20. project-maya

    AI repositories

    Project Maya - run GLM-5.3-Flash (321B MoE), DeepSeek-V4.1-Flash-1017 (748B MoE) and MiniMax-M3.1-Flash (428B MoE) privately on your own GPU(s), from one card to 16, NVIDIA or AMD, Linux or Windows. Engine, server, dashboard, OpenAI- and Anthropic-compatible API, quant tools.

    Stale GitHub, mw00 2,482 ★MITUpdated 12 days ago

    git clone https://github.com/mw00/project-maya.git
  21. TensorSharp

    AI repositories

    A native .NET LLM inference engine and agent runtime for GGUF models. TensorSharp provides a console application, a web-based chatbot interface, iPhone App, and Ollama/OpenAI-compatible HTTP APIs for programmatic access. It supports Windows/MacOS/iOS/Linux with full GPU capability

    Stale GitHub, zhongkaifu 675 ★BSD-3-ClauseUpdated 4 days ago

    git clone https://github.com/zhongkaifu/TensorSharp.git
  22. janas

    AI repositories

    37 tok/s from Qwen3-Next-80B (48 GB) on a 32 GB laptop, 24 without drafts vs 2.8 for llama.cpp; reading 62 vs 16 tok/s. Faster than llama.cpp on all 13 models compared in Q4_K_M. LLMs bigger than your RAM, pure C, CPU or GPU.

    Indexed GitHub, prabanta-dev 717 ★GPL-3.0Updated today

    git clone https://github.com/prabanta-dev/janas.git
  23. NVIDIA AI Blueprint for video search and summarization (VSS) is a GPU-accelerated reference architecture for building video analytics agents with real-time verified alerts, visual Q&A, and automated reporting. The VSS Blueprint uses vision language models (VLMs) such as NVIDIA Cosmos, LLMs such as NVIDIA Nemotron, RAG, and NVIDIA NIMs.

    Indexed GitHub, NVIDIA-AI-Blueprints 1,986 ★Apache-2.0Updated today

    git clone https://github.com/NVIDIA-AI-Blueprints/video-search-and-summarization.git
  24. self-hosted-ai-stack

    AI repositories

    Deploy a self-hosted AI stack with Docker Compose: local LLMs, chat, document parsing, embeddings, transcription, text-to-speech and MCP tools. Powered by Ollama, LiteLLM, AnythingLLM and more. Local-first with auto-configured authentication, lightweight stacks, optional HTTPS and NVIDIA GPU support. MIT licensed. Multi-arch: amd64, arm64.

    Indexed GitHub, hwdsl2 179 ★MITUpdated yesterday

    git clone https://github.com/hwdsl2/self-hosted-ai-stack.git

Indexed entries aren't reviewed or tested by InnerVault. Details come straight from each source. Anything that can reach your accounts, files or browser can do damage, so read the source before you install it.