InnerVault

Library

85,340 resources from 11 public sources. 54 checked by hand; the rest are unreviewed.

Results

  1. uzu

    AI repositories

    A high-performance inference engine for AI models

    Indexed GitHub, trymirai 3,351 ★MITUpdated today

    git clone https://github.com/trymirai/uzu.git
  2. seatunnel

    AI repositories

    SeaTunnel is a multimodal, high-performance, distributed, massive data integration tool.

    Stale GitHub, apache 9,795 ★Apache-2.0Updated 6 days ago

    git clone https://github.com/apache/seatunnel.git
  3. evalscope

    AI repositories

    A streamlined and customizable framework for efficient large model (LLM, VLM, AIGC) evaluation and performance benchmarking.

    Indexed GitHub, modelscope 3,697 ★Apache-2.0Updated today

    git clone https://github.com/modelscope/evalscope.git
  4. openlake

    AI repositories

    OpenLake is a high performance storage engine for efficient LLM inference and GPU Training

    Stale GitHub, openlake-project 2,851 ★Apache-2.0Updated 7 days ago

    git clone https://github.com/openlake-project/openlake.git
  5. gpustack

    AI repositories

    A GPU cluster manager for high-performance AI model serving (vLLM, SGLang) and on-demand SSH-accessible GPU instances.

    Indexed GitHub, gpustack 6,039 ★Apache-2.0Updated 3 days ago

    git clone https://github.com/gpustack/gpustack.git
  6. ECC

    AI repositories

    The agent harness performance optimization system. Skills, instincts, memory, security, and research-first development for Claude Code, Codex, Opencode, Cursor and beyond.

    Indexed GitHub, affaan-m 304.0k ★MITUpdated today

    git clone https://github.com/affaan-m/ECC.git
  7. web-llm

    AI repositories

    High-performance In-browser LLM Inference Engine

    Stale GitHub, mlc-ai 19.3k ★Apache-2.0Updated 36 days ago

    git clone https://github.com/mlc-ai/web-llm.git
  8. metaflow

    AI repositories

    Build, Manage and Deploy AI/ML Systems

    Stale GitHub, Netflix 10.3k ★Apache-2.0Updated 7 days ago

    git clone https://github.com/Netflix/metaflow.git
  9. EmbedAnything

    AI repositories

    Highly Performant, Modular, Memory Safe and Production-ready Inference, Ingestion and Indexing built in Rust 🦀

    Indexed GitHub, StarlightSearch 1,324 ★Apache-2.0Updated yesterday

    git clone https://github.com/StarlightSearch/EmbedAnything.git
  10. optimate

    AI repositories

    A collection of libraries to optimise AI model performances

    Stale GitHub, nebuly-ai 8,328 ★Apache-2.0Updated 2 years ago

    git clone https://github.com/nebuly-ai/optimate.git
  11. openvino

    AI repositories

    OpenVINO™ is an open source toolkit for optimizing and deploying AI inference

    Indexed GitHub, openvinotoolkit 11.2k ★Apache-2.0Updated today

    git clone https://github.com/openvinotoolkit/openvino.git
  12. ai-infra-book

    AI repositories

    《深入理解 AI Infra:量化分析与系统设计》(李博杰 著)开源书稿:从硬件约束和模型架构出发,量化推导 LLM 推理与训练系统设计。含全书正文、PDF、配套计算工具与实验

    Stale GitHub, bojieli 6,489 ★Apache-2.0Updated 46 days ago

    git clone https://github.com/bojieli/ai-infra-book.git
  13. hallucination-leaderboard

    AI repositories

    Leaderboard Comparing LLM Performance at Producing Hallucinations when Summarizing Short Documents

    Stale GitHub, vectara 3,323 ★Apache-2.0Updated 24 days ago

    git clone https://github.com/vectara/hallucination-leaderboard.git
  14. litgpt

    AI repositories

    20+ high-performance LLMs with recipes to pretrain, finetune and deploy at scale.

    Stale GitHub, Lightning-AI 13.7k ★Apache-2.0Updated 34 days ago

    git clone https://github.com/Lightning-AI/litgpt.git
  15. jcode

    AI repositories

    High performance coding agent harness written in Rust, built for heavy multi-agent dev workflows

    Indexed GitHub, 1jehuang 21.8k ★MITUpdated today

    git clone https://github.com/1jehuang/jcode.git
  16. sglang

    AI repositories

    SGLang is a high-performance serving framework for large language models and multimodal models.

    Indexed GitHub, sgl-project 38.9k ★Apache-2.0Updated today

    git clone https://github.com/sgl-project/sglang.git
  17. llm-d

    AI repositories

    State of the art inference performance with modern accelerators on Kubernetes

    Indexed GitHub, llm-d 5,274 ★Apache-2.0Updated today

    git clone https://github.com/llm-d/llm-d.git
  18. chitu

    AI repositories

    High-performance inference framework for large language models, focusing on efficiency, flexibility, and availability.

    Stale GitHub, thu-pacman 2,998 ★Apache-2.0Updated 11 days ago

    git clone https://github.com/thu-pacman/chitu.git
  19. oneDNN

    AI repositories

    Open-source library of optimized deep learning operations (matmul, convolution, attention) for CPUs (x64, AArch64, RISC-V) and Intel GPUs. Used by PyTorch, TensorFlow, OpenVINO, and ONNX Runtime.

    Indexed GitHub, uxlfoundation 4,094 ★Apache-2.0Updated today

    git clone https://github.com/uxlfoundation/oneDNN.git
  20. MNN

    AI repositories

    MNN: A blazing-fast, lightweight inference engine battle-tested by Alibaba, powering high-performance on-device LLMs and Edge AI.

    Indexed GitHub, alibaba 16.5k ★Apache-2.0Updated today

    git clone https://github.com/alibaba/MNN.git
  21. SiliconScope

    AI repositories

    Sudoless Apple Silicon system monitor (native SwiftUI GUI) with ANE / Media Engine / memory-bandwidth tracking

    Stale GitHub, kennss 1,013 ★MITUpdated 14 days ago

    git clone https://github.com/kennss/SiliconScope.git
  22. milvus

    AI repositories

    Milvus is a high-performance, cloud-native vector database built for scalable vector ANN search

    Indexed GitHub, milvus-io 46.7k ★Apache-2.0Updated today

    git clone https://github.com/milvus-io/milvus.git
  23. maxtext

    AI repositories

    A simple, performant, and scalable Jax LLM!

    Indexed GitHub, AI-Hypercomputer 2,461 ★Apache-2.0Updated 2 days ago

    git clone https://github.com/AI-Hypercomputer/maxtext.git
  24. rtp-llm

    AI repositories

    RTP-LLM: Alibaba's high-performance LLM inference engine for diverse applications.

    Indexed GitHub, alibaba 1,400 ★Apache-2.0Updated 2 days ago

    git clone https://github.com/alibaba/rtp-llm.git

Indexed entries aren't reviewed or tested by InnerVault. Details come straight from each source. Anything that can reach your accounts, files or browser can do damage, so read the source before you install it.