Library
85,340 resources from 11 public sources. 54 checked by hand; the rest are unreviewed.
Results
-
uzu
AI repositoriesA high-performance inference engine for AI models
git clone https://github.com/trymirai/uzu.git -
seatunnel
AI repositoriesSeaTunnel is a multimodal, high-performance, distributed, massive data integration tool.
git clone https://github.com/apache/seatunnel.git -
evalscope
AI repositoriesA streamlined and customizable framework for efficient large model (LLM, VLM, AIGC) evaluation and performance benchmarking.
git clone https://github.com/modelscope/evalscope.git -
openlake
AI repositoriesOpenLake is a high performance storage engine for efficient LLM inference and GPU Training
git clone https://github.com/openlake-project/openlake.git -
gpustack
AI repositoriesA GPU cluster manager for high-performance AI model serving (vLLM, SGLang) and on-demand SSH-accessible GPU instances.
git clone https://github.com/gpustack/gpustack.git -
ECC
AI repositoriesThe agent harness performance optimization system. Skills, instincts, memory, security, and research-first development for Claude Code, Codex, Opencode, Cursor and beyond.
git clone https://github.com/affaan-m/ECC.git -
web-llm
AI repositoriesHigh-performance In-browser LLM Inference Engine
git clone https://github.com/mlc-ai/web-llm.git -
metaflow
AI repositoriesBuild, Manage and Deploy AI/ML Systems
git clone https://github.com/Netflix/metaflow.git -
EmbedAnything
AI repositoriesHighly Performant, Modular, Memory Safe and Production-ready Inference, Ingestion and Indexing built in Rust 🦀
git clone https://github.com/StarlightSearch/EmbedAnything.git -
optimate
AI repositoriesA collection of libraries to optimise AI model performances
git clone https://github.com/nebuly-ai/optimate.git -
openvino
AI repositoriesOpenVINO™ is an open source toolkit for optimizing and deploying AI inference
git clone https://github.com/openvinotoolkit/openvino.git -
ai-infra-book
AI repositories《深入理解 AI Infra:量化分析与系统设计》(李博杰 著)开源书稿:从硬件约束和模型架构出发,量化推导 LLM 推理与训练系统设计。含全书正文、PDF、配套计算工具与实验
git clone https://github.com/bojieli/ai-infra-book.git -
hallucination-leaderboard
AI repositoriesLeaderboard Comparing LLM Performance at Producing Hallucinations when Summarizing Short Documents
git clone https://github.com/vectara/hallucination-leaderboard.git -
litgpt
AI repositories20+ high-performance LLMs with recipes to pretrain, finetune and deploy at scale.
git clone https://github.com/Lightning-AI/litgpt.git -
jcode
AI repositoriesHigh performance coding agent harness written in Rust, built for heavy multi-agent dev workflows
git clone https://github.com/1jehuang/jcode.git -
sglang
AI repositoriesSGLang is a high-performance serving framework for large language models and multimodal models.
git clone https://github.com/sgl-project/sglang.git -
llm-d
AI repositoriesState of the art inference performance with modern accelerators on Kubernetes
git clone https://github.com/llm-d/llm-d.git -
chitu
AI repositoriesHigh-performance inference framework for large language models, focusing on efficiency, flexibility, and availability.
git clone https://github.com/thu-pacman/chitu.git -
oneDNN
AI repositoriesOpen-source library of optimized deep learning operations (matmul, convolution, attention) for CPUs (x64, AArch64, RISC-V) and Intel GPUs. Used by PyTorch, TensorFlow, OpenVINO, and ONNX Runtime.
git clone https://github.com/uxlfoundation/oneDNN.git -
MNN
AI repositoriesMNN: A blazing-fast, lightweight inference engine battle-tested by Alibaba, powering high-performance on-device LLMs and Edge AI.
git clone https://github.com/alibaba/MNN.git -
SiliconScope
AI repositoriesSudoless Apple Silicon system monitor (native SwiftUI GUI) with ANE / Media Engine / memory-bandwidth tracking
git clone https://github.com/kennss/SiliconScope.git -
milvus
AI repositoriesMilvus is a high-performance, cloud-native vector database built for scalable vector ANN search
git clone https://github.com/milvus-io/milvus.git -
maxtext
AI repositoriesA simple, performant, and scalable Jax LLM!
git clone https://github.com/AI-Hypercomputer/maxtext.git -
rtp-llm
AI repositoriesRTP-LLM: Alibaba's high-performance LLM inference engine for diverse applications.
git clone https://github.com/alibaba/rtp-llm.git
Indexed entries aren't reviewed or tested by InnerVault. Details come straight from each source. Anything that can reach your accounts, files or browser can do damage, so read the source before you install it.