Library
85,762 resources from 11 public sources. 54 checked by hand; the rest are unreviewed.
Results
-
surogate
AI repositoriesTrain and serve LLMs at extreme speed and massive throughput.
git clone https://github.com/invergent-ai/surogate.git -
pegainfer
AI repositoriesPure Rust + CUDA LLM inference engine — no PyTorch, OpenAI-compatible, serves Qwen3 to Kimi-K2
git clone https://github.com/pegainfer-project/pegainfer.git -
gpustack
AI repositoriesA GPU cluster manager for high-performance AI model serving (vLLM, SGLang) and on-demand SSH-accessible GPU instances.
git clone https://github.com/gpustack/gpustack.git -
tt-metal
AI repositories:metal: TT-NN operator library, and TT-Metalium low level kernel programming model.
git clone https://github.com/tenstorrent/tt-metal.git -
oumi
AI repositoriesEasily fine-tune (SFT/RL), evaluate, and deploy Qwen, Gemma, or any open agentic LLM/VLM!
git clone https://github.com/oumi-ai/oumi.git -
hax
AI repositoriesA minimalist, terminal-native coding agent written in C.
git clone https://github.com/OleksandrChekhovskyi/hax.git -
OmAgent
AI repositories[EMNLP-2024] Build multimodal language agents for fast prototype and production
git clone https://github.com/om-ai-lab/OmAgent.git -
LEANN
AI repositories[MLsys2026 Best Paper]: https://arxiv.org/abs/2506.08276. RAG on Everything with LEANN. Enjoy 97% storage savings while running a fast, accurate, and 100% private RAG application on your personal device.
git clone https://github.com/StarTrail-org/LEANN.git -
tools
AI repositoriesA set of tools that gives agents powerful capabilities.
git clone https://github.com/strands-agents/tools.git -
beelzebub
AI repositoriesA secure low code deception runtime framework, leveraging AI for System Virtualization.
git clone https://github.com/beelzebub-labs/beelzebub.git -
AITreasureBox
AI repositories🤖 Automatically collected AI repos, tools, websites, papers & tutorials. 实用AI百宝箱 💎
git clone https://github.com/superiorlu/AITreasureBox.git -
GenAI_LLM_timeline
AI repositoriesChatGPT, GenerativeAI and LLMs Timeline
git clone https://github.com/hollobit/GenAI_LLM_timeline.git -
biniou
AI repositoriesa self-hosted webui for 30+ generative ai
git clone https://github.com/Woolverine94/biniou.git -
TinyLLM
AI repositoriesSetup and run a local LLM and Chatbot using consumer grade hardware.
git clone https://github.com/jasonacox/TinyLLM.git -
SiliconScope
AI repositoriesSudoless Apple Silicon system monitor (native SwiftUI GUI) with ANE / Media Engine / memory-bandwidth tracking
git clone https://github.com/kennss/SiliconScope.git -
inference
AI repositoriesOpen-source inference platform for language, vision, embedding, reranking, image, audio, and video models. Deploy with multiple engines across heterogeneous hardware, from a laptop to a distributed cluster. Serve models through OpenAI-compatible APIs.
git clone https://github.com/xorbitsai/inference.git -
vectordb-recipes
AI repositoriesResource, examples & tutorials for multimodal AI, RAG and agents using vector search and LLMs
git clone https://github.com/lancedb/vectordb-recipes.git -
Automodel
AI repositories🚀 Pytorch Distributed native training library for LLMs/VLMs with OOTB Hugging Face support
git clone https://github.com/NVIDIA-NeMo/Automodel.git -
HilbertRaum
AI repositoriesAI, fully local on your computer.
git clone https://github.com/HilbertraumAI/HilbertRaum.git -
aikit
AI repositories🏗️ Fine-tune, build, and deploy open-source LLMs easily!
git clone https://github.com/kaito-project/aikit.git -
web-llm-chat
AI repositoriesChat with AI large language models running natively in your browser. Enjoy private, server-free, seamless AI conversations.
git clone https://github.com/mlc-ai/web-llm-chat.git -
ETOS-LLM-Studio
AI repositoriesA native LLM client for iOS & Apple Watch. Run local GGUF models offline via llama.cpp, or connect to OpenAI/Claude/Gemini. Features local RAG, Model Context Protocol (MCP) tools, Siri Shortcuts, and cross-device sync. Built with Swift.
git clone https://github.com/Eric-Terminal/ETOS-LLM-Studio.git -
xTuring
AI repositoriesBuild, personalize and control your own LLMs. From data pre-processing to fine-tuning, xTuring provides an easy way to personalize open-source LLMs. Join our discord community: https://discord.gg/TgHXuSJEk6
git clone https://github.com/stochasticai/xTuring.git -
slide-deck-ai
AI repositoriesCo-create PowerPoint slide decks with AI
git clone https://github.com/barun-saha/slide-deck-ai.git
Indexed entries aren't reviewed or tested by InnerVault. Details come straight from each source. Anything that can reach your accounts, files or browser can do damage, so read the source before you install it.