InnerVault

Library

85,762 resources from 11 public sources. 54 checked by hand; the rest are unreviewed.

Results

1,102 results with any of your words Clear search and filters

Looks like a goal we have a starting path for: I want to research potential clients

  1. hallucination-leaderboard

    AI repositories

    Leaderboard Comparing LLM Performance at Producing Hallucinations when Summarizing Short Documents

    Stale GitHub, vectara 3,323 ★Apache-2.0Updated 25 days ago

    git clone https://github.com/vectara/hallucination-leaderboard.git
  2. evalscope

    AI repositories

    A streamlined and customizable framework for efficient large model (LLM, VLM, AIGC) evaluation and performance benchmarking.

    Indexed GitHub, modelscope 3,697 ★Apache-2.0Updated yesterday

    git clone https://github.com/modelscope/evalscope.git
  3. uzu

    AI repositories

    A high-performance inference engine for AI models

    Indexed GitHub, trymirai 3,351 ★MITUpdated yesterday

    git clone https://github.com/trymirai/uzu.git
  4. openlake

    AI repositories

    OpenLake is a high performance storage engine for efficient LLM inference and GPU Training

    Stale GitHub, openlake-project 2,851 ★Apache-2.0Updated 8 days ago

    git clone https://github.com/openlake-project/openlake.git
  5. gpustack

    AI repositories

    A GPU cluster manager for high-performance AI model serving (vLLM, SGLang) and on-demand SSH-accessible GPU instances.

    Indexed GitHub, gpustack 6,039 ★Apache-2.0Updated 4 days ago

    git clone https://github.com/gpustack/gpustack.git
  6. web-llm

    AI repositories

    High-performance In-browser LLM Inference Engine

    Stale GitHub, mlc-ai 19.3k ★Apache-2.0Updated 37 days ago

    git clone https://github.com/mlc-ai/web-llm.git
  7. seatunnel

    AI repositories

    SeaTunnel is a multimodal, high-performance, distributed, massive data integration tool.

    Stale GitHub, apache 9,795 ★Apache-2.0Updated 7 days ago

    git clone https://github.com/apache/seatunnel.git
  8. ai-infra-book

    AI repositories

    《深入理解 AI Infra:量化分析与系统设计》(李博杰 著)开源书稿:从硬件约束和模型架构出发,量化推导 LLM 推理与训练系统设计。含全书正文、PDF、配套计算工具与实验

    Stale GitHub, bojieli 6,489 ★Apache-2.0Updated 47 days ago

    git clone https://github.com/bojieli/ai-infra-book.git
  9. litgpt

    AI repositories

    20+ high-performance LLMs with recipes to pretrain, finetune and deploy at scale.

    Stale GitHub, Lightning-AI 13.7k ★Apache-2.0Updated 35 days ago

    git clone https://github.com/Lightning-AI/litgpt.git
  10. llm-d

    AI repositories

    State of the art inference performance with modern accelerators on Kubernetes

    Indexed GitHub, llm-d 5,274 ★Apache-2.0Updated yesterday

    git clone https://github.com/llm-d/llm-d.git
  11. ECC

    AI repositories

    The agent harness performance optimization system. Skills, instincts, memory, security, and research-first development for Claude Code, Codex, Opencode, Cursor and beyond.

    Indexed GitHub, affaan-m 304.0k ★MITUpdated yesterday

    git clone https://github.com/affaan-m/ECC.git
  12. docext

    AI repositories

    An on-premises, OCR-free unstructured data extraction, markdown conversion and benchmarking toolkit. (https://idp-leaderboard.org/)

    Stale GitHub, NanoNets 2,083 ★Apache-2.0Updated 8 months ago

    git clone https://github.com/NanoNets/docext.git
  13. optimate

    AI repositories

    A collection of libraries to optimise AI model performances

    Stale GitHub, nebuly-ai 8,328 ★Apache-2.0Updated 2 years ago

    git clone https://github.com/nebuly-ai/optimate.git
  14. rtp-llm

    AI repositories

    RTP-LLM: Alibaba's high-performance LLM inference engine for diverse applications.

    Indexed GitHub, alibaba 1,400 ★Apache-2.0Updated 3 days ago

    git clone https://github.com/alibaba/rtp-llm.git
  15. metaflow

    AI repositories

    Build, Manage and Deploy AI/ML Systems

    Stale GitHub, Netflix 10.3k ★Apache-2.0Updated 8 days ago

    git clone https://github.com/Netflix/metaflow.git
  16. chitu

    AI repositories

    High-performance inference framework for large language models, focusing on efficiency, flexibility, and availability.

    Stale GitHub, thu-pacman 2,998 ★Apache-2.0Updated 12 days ago

    git clone https://github.com/thu-pacman/chitu.git
  17. SiliconScope

    AI repositories

    Sudoless Apple Silicon system monitor (native SwiftUI GUI) with ANE / Media Engine / memory-bandwidth tracking

    Stale GitHub, kennss 1,013 ★MITUpdated 15 days ago

    git clone https://github.com/kennss/SiliconScope.git
  18. maxtext

    AI repositories

    A simple, performant, and scalable Jax LLM!

    Indexed GitHub, AI-Hypercomputer 2,461 ★Apache-2.0Updated 3 days ago

    git clone https://github.com/AI-Hypercomputer/maxtext.git
  19. MNN

    AI repositories

    MNN: A blazing-fast, lightweight inference engine battle-tested by Alibaba, powering high-performance on-device LLMs and Edge AI.

    Indexed GitHub, alibaba 16.5k ★Apache-2.0Updated yesterday

    git clone https://github.com/alibaba/MNN.git
  20. jcode

    AI repositories

    High performance coding agent harness written in Rust, built for heavy multi-agent dev workflows

    Indexed GitHub, 1jehuang 21.8k ★MITUpdated yesterday

    git clone https://github.com/1jehuang/jcode.git
  21. openvino

    AI repositories

    OpenVINO™ is an open source toolkit for optimizing and deploying AI inference

    Indexed GitHub, openvinotoolkit 11.2k ★Apache-2.0Updated yesterday

    git clone https://github.com/openvinotoolkit/openvino.git
  22. sglang

    AI repositories

    SGLang is a high-performance serving framework for large language models and multimodal models.

    Indexed GitHub, sgl-project 38.9k ★Apache-2.0Updated yesterday

    git clone https://github.com/sgl-project/sglang.git
  23. deepreasoning

    AI repositories

    A high-performance LLM inference API and Chat UI that integrates DeepSeek R1's CoT reasoning traces with Anthropic Claude models.

    Stale GitHub, winfunc 5,355 ★MITUpdated 13 months ago

    git clone https://github.com/winfunc/deepreasoning.git
  24. LightLLM

    AI repositories

    LightLLM is a Python-based LLM (Large Language Model) inference and serving framework, notable for its lightweight design, easy scalability, and high-speed performance.

    Indexed GitHub, ModelTC 4,362 ★Apache-2.0Updated yesterday

    git clone https://github.com/ModelTC/LightLLM.git

Indexed entries aren't reviewed or tested by InnerVault. Details come straight from each source. Anything that can reach your accounts, files or browser can do damage, so read the source before you install it.