Library
85,762 resources from 11 public sources. 54 checked by hand; the rest are unreviewed.
Results
Looks like a goal we have a starting path for: I want to research potential clients
-
hallucination-leaderboard
AI repositoriesLeaderboard Comparing LLM Performance at Producing Hallucinations when Summarizing Short Documents
git clone https://github.com/vectara/hallucination-leaderboard.git -
evalscope
AI repositoriesA streamlined and customizable framework for efficient large model (LLM, VLM, AIGC) evaluation and performance benchmarking.
git clone https://github.com/modelscope/evalscope.git -
uzu
AI repositoriesA high-performance inference engine for AI models
git clone https://github.com/trymirai/uzu.git -
openlake
AI repositoriesOpenLake is a high performance storage engine for efficient LLM inference and GPU Training
git clone https://github.com/openlake-project/openlake.git -
gpustack
AI repositoriesA GPU cluster manager for high-performance AI model serving (vLLM, SGLang) and on-demand SSH-accessible GPU instances.
git clone https://github.com/gpustack/gpustack.git -
web-llm
AI repositoriesHigh-performance In-browser LLM Inference Engine
git clone https://github.com/mlc-ai/web-llm.git -
seatunnel
AI repositoriesSeaTunnel is a multimodal, high-performance, distributed, massive data integration tool.
git clone https://github.com/apache/seatunnel.git -
ai-infra-book
AI repositories《深入理解 AI Infra:量化分析与系统设计》(李博杰 著)开源书稿:从硬件约束和模型架构出发,量化推导 LLM 推理与训练系统设计。含全书正文、PDF、配套计算工具与实验
git clone https://github.com/bojieli/ai-infra-book.git -
litgpt
AI repositories20+ high-performance LLMs with recipes to pretrain, finetune and deploy at scale.
git clone https://github.com/Lightning-AI/litgpt.git -
llm-d
AI repositoriesState of the art inference performance with modern accelerators on Kubernetes
git clone https://github.com/llm-d/llm-d.git -
ECC
AI repositoriesThe agent harness performance optimization system. Skills, instincts, memory, security, and research-first development for Claude Code, Codex, Opencode, Cursor and beyond.
git clone https://github.com/affaan-m/ECC.git -
docext
AI repositoriesAn on-premises, OCR-free unstructured data extraction, markdown conversion and benchmarking toolkit. (https://idp-leaderboard.org/)
git clone https://github.com/NanoNets/docext.git -
optimate
AI repositoriesA collection of libraries to optimise AI model performances
git clone https://github.com/nebuly-ai/optimate.git -
rtp-llm
AI repositoriesRTP-LLM: Alibaba's high-performance LLM inference engine for diverse applications.
git clone https://github.com/alibaba/rtp-llm.git -
metaflow
AI repositoriesBuild, Manage and Deploy AI/ML Systems
git clone https://github.com/Netflix/metaflow.git -
chitu
AI repositoriesHigh-performance inference framework for large language models, focusing on efficiency, flexibility, and availability.
git clone https://github.com/thu-pacman/chitu.git -
SiliconScope
AI repositoriesSudoless Apple Silicon system monitor (native SwiftUI GUI) with ANE / Media Engine / memory-bandwidth tracking
git clone https://github.com/kennss/SiliconScope.git -
maxtext
AI repositoriesA simple, performant, and scalable Jax LLM!
git clone https://github.com/AI-Hypercomputer/maxtext.git -
MNN
AI repositoriesMNN: A blazing-fast, lightweight inference engine battle-tested by Alibaba, powering high-performance on-device LLMs and Edge AI.
git clone https://github.com/alibaba/MNN.git -
jcode
AI repositoriesHigh performance coding agent harness written in Rust, built for heavy multi-agent dev workflows
git clone https://github.com/1jehuang/jcode.git -
openvino
AI repositoriesOpenVINO™ is an open source toolkit for optimizing and deploying AI inference
git clone https://github.com/openvinotoolkit/openvino.git -
sglang
AI repositoriesSGLang is a high-performance serving framework for large language models and multimodal models.
git clone https://github.com/sgl-project/sglang.git -
deepreasoning
AI repositoriesA high-performance LLM inference API and Chat UI that integrates DeepSeek R1's CoT reasoning traces with Anthropic Claude models.
git clone https://github.com/winfunc/deepreasoning.git -
LightLLM
AI repositoriesLightLLM is a Python-based LLM (Large Language Model) inference and serving framework, notable for its lightweight design, easy scalability, and high-speed performance.
git clone https://github.com/ModelTC/LightLLM.git
Indexed entries aren't reviewed or tested by InnerVault. Details come straight from each source. Anything that can reach your accounts, files or browser can do damage, so read the source before you install it.