InnerVault

Library

85,762 resources from 11 public sources. 54 checked by hand; the rest are unreviewed.

Results

  1. higgsfield

    AI repositories

    Fault-tolerant, highly scalable GPU orchestration, and a machine learning framework designed for training models with billions to trillions of parameters

    Stale GitHub, higgsfield-ai 6,021 ★Apache-2.0Updated 40 days ago

    git clone https://github.com/higgsfield-ai/higgsfield.git
  2. uzu

    AI repositories

    A high-performance inference engine for AI models

    Indexed GitHub, trymirai 3,351 ★MITUpdated today

    git clone https://github.com/trymirai/uzu.git
  3. seatunnel

    AI repositories

    SeaTunnel is a multimodal, high-performance, distributed, massive data integration tool.

    Stale GitHub, apache 9,795 ★Apache-2.0Updated 6 days ago

    git clone https://github.com/apache/seatunnel.git
  4. openlake

    AI repositories

    OpenLake is a high performance storage engine for efficient LLM inference and GPU Training

    Stale GitHub, openlake-project 2,851 ★Apache-2.0Updated 7 days ago

    git clone https://github.com/openlake-project/openlake.git
  5. gpustack

    AI repositories

    A GPU cluster manager for high-performance AI model serving (vLLM, SGLang) and on-demand SSH-accessible GPU instances.

    Indexed GitHub, gpustack 6,039 ★Apache-2.0Updated 3 days ago

    git clone https://github.com/gpustack/gpustack.git
  6. web-llm

    AI repositories

    High-performance In-browser LLM Inference Engine

    Stale GitHub, mlc-ai 19.3k ★Apache-2.0Updated 36 days ago

    git clone https://github.com/mlc-ai/web-llm.git
  7. metaflow

    AI repositories

    Build, Manage and Deploy AI/ML Systems

    Stale GitHub, Netflix 10.3k ★Apache-2.0Updated 7 days ago

    git clone https://github.com/Netflix/metaflow.git
  8. paper-qa

    AI repositories

    High accuracy RAG for answering questions from scientific documents with citations

    Stale GitHub, Future-House 9,573 ★Apache-2.0Updated 7 days ago

    git clone https://github.com/Future-House/paper-qa.git
  9. distrifuser

    AI repositories

    [CVPR 2024 Highlight] DistriFusion: Distributed Parallel Inference for High-Resolution Diffusion Models

    Stale GitHub, mit-han-lab 732 ★MITUpdated 23 months ago

    git clone https://github.com/mit-han-lab/distrifuser.git
  10. EmbedAnything

    AI repositories

    Highly Performant, Modular, Memory Safe and Production-ready Inference, Ingestion and Indexing built in Rust 🦀

    Indexed GitHub, StarlightSearch 1,324 ★Apache-2.0Updated yesterday

    git clone https://github.com/StarlightSearch/EmbedAnything.git
  11. PowerInfer

    AI repositories

    High-speed Large Language Model Serving for Local Deployment

    Stale GitHub, Tiiny-AI 9,828 ★MITUpdated 6 months ago

    git clone https://github.com/Tiiny-AI/PowerInfer.git
  12. vllm

    AI repositories

    A high-throughput and memory-efficient inference and serving engine for LLMs

    Indexed GitHub, vllm-project 97.0k ★Apache-2.0Updated today

    git clone https://github.com/vllm-project/vllm.git
  13. litgpt

    AI repositories

    20+ high-performance LLMs with recipes to pretrain, finetune and deploy at scale.

    Stale GitHub, Lightning-AI 13.7k ★Apache-2.0Updated 34 days ago

    git clone https://github.com/Lightning-AI/litgpt.git
  14. jcode

    AI repositories

    High performance coding agent harness written in Rust, built for heavy multi-agent dev workflows

    Indexed GitHub, 1jehuang 21.8k ★MITUpdated today

    git clone https://github.com/1jehuang/jcode.git
  15. AI-Youtube-Shorts-Generator

    AI repositories

    Open-source alternative to Opus Clip, Vidyo.ai, Klap & SubMagic. Turn long-form YouTube videos into viral 9:16 shorts using LLM highlight detection, Whisper transcription, and auto vertical cropping — free, no watermarks, no per-clip credits.

    Stale GitHub, Anil-matcha 5,348 ★MITUpdated 36 days ago

    git clone https://github.com/Anil-matcha/AI-Youtube-Shorts-Generator.git
  16. sglang

    AI repositories

    SGLang is a high-performance serving framework for large language models and multimodal models.

    Indexed GitHub, sgl-project 38.9k ★Apache-2.0Updated today

    git clone https://github.com/sgl-project/sglang.git
  17. chitu

    AI repositories

    High-performance inference framework for large language models, focusing on efficiency, flexibility, and availability.

    Stale GitHub, thu-pacman 2,998 ★Apache-2.0Updated 11 days ago

    git clone https://github.com/thu-pacman/chitu.git
  18. infinity

    AI repositories

    Infinity is a high-throughput, low-latency serving engine for text-embeddings, reranking models, clip, clap and colpali

    Stale GitHub, michaelfeil 2,984 ★MITUpdated 6 days ago

    git clone https://github.com/michaelfeil/infinity.git
  19. MNN

    AI repositories

    MNN: A blazing-fast, lightweight inference engine battle-tested by Alibaba, powering high-performance on-device LLMs and Edge AI.

    Indexed GitHub, alibaba 16.5k ★Apache-2.0Updated today

    git clone https://github.com/alibaba/MNN.git
  20. milvus

    AI repositories

    Milvus is a high-performance, cloud-native vector database built for scalable vector ANN search

    Indexed GitHub, milvus-io 46.7k ★Apache-2.0Updated today

    git clone https://github.com/milvus-io/milvus.git
  21. ruoyi-ai

    AI repositories

    Enterprise-grade AI agent framework with multi-provider LLM management, secure knowledge bases and high-precision RAG, visual workflow orchestration, and multi-agent coordination.

    Stale GitHub, ageerle 5,769 ★MITUpdated 26 days ago

    git clone https://github.com/ageerle/ruoyi-ai.git
  22. rtp-llm

    AI repositories

    RTP-LLM: Alibaba's high-performance LLM inference engine for diverse applications.

    Indexed GitHub, alibaba 1,400 ★Apache-2.0Updated 2 days ago

    git clone https://github.com/alibaba/rtp-llm.git
  23. edgequake

    AI repositories

    EdegQuake 🌋 High-performance GraphRAG inspired from LightRag written in Rust; Transform documents into intelligent knowledge graphs for superior retrieval and generation

    Indexed GitHub, raphaelmansuy 2,305 ★Apache-2.0Updated today

    git clone https://github.com/raphaelmansuy/edgequake.git
  24. figures4papers

    AI repositories

    My Python scripts to make high-quality figures for publications in top AI conferences and journals.

    Indexed GitHub, ChenLiu-1996 11.2k ★Custom licence (see repository)Updated 2 days ago

    git clone https://github.com/ChenLiu-1996/figures4papers.git

Indexed entries aren't reviewed or tested by InnerVault. Details come straight from each source. Anything that can reach your accounts, files or browser can do damage, so read the source before you install it.