InnerVault

Library

85,762 resources from 11 public sources. 53 checked by hand; the rest are unreviewed.

Results

  1. sglang

    AI repositories

    SGLang is a high-performance serving framework for large language models and multimodal models.

    Indexed GitHub, sgl-project 38.9k ★Apache-2.0Updated today

    git clone https://github.com/sgl-project/sglang.git
  2. zero-to-sglang

    Docs & tutorials

    Official SGLang x Datawhale course on LLM inference: understand inference, build a mini-sglang from scratch, then read the real SGLang source and land your first PR. Available in English and Chinese.

    Indexed GitHub, datawhalechina 2,148 ★Updated today

    git clone https://github.com/datawhalechina/zero-to-sglang.git
  3. Cosmos3-Nano

    Models

    model by nvidia · cosmos

    Stale Hugging Face Hub, nvidia 397 ♥otherUpdated 2 months ago

    nvidia/Cosmos3-Nano
  4. SpecForge

    AI repositories

    Train speculative decoding models effortlessly and port them smoothly to SGLang serving.

    Indexed GitHub, sgl-project 1,287 ★MITUpdated today

    git clone https://github.com/sgl-project/SpecForge.git
  5. gpustack

    AI repositories

    A GPU cluster manager for high-performance AI model serving (vLLM, SGLang) and on-demand SSH-accessible GPU instances.

    Indexed GitHub, gpustack 6,039 ★Apache-2.0Updated 3 days ago

    git clone https://github.com/gpustack/gpustack.git
  6. text to audio model by MiniMaxAI · diffusers

    Indexed Hugging Face Hub, MiniMaxAI 1,532 ♥Updated 21 days ago

    MiniMaxAI/MiniMax-Music3
  7. Mooncake

    AI repositories

    Mooncake is the serving platform for Kimi, a leading LLM service provided by Moonshot AI.

    Indexed GitHub, kvcache-ai 7,047 ★Apache-2.0Updated today

    git clone https://github.com/kvcache-ai/Mooncake.git
  8. Bittune

    Agents & frameworks

    Local-first engineering agent that deploys, benchmarks and tunes vLLM/SGLang inference services on your own GPUs, with auditable run evidence.

    Indexed GitHub, bitcloud-ai 304 ★MITUpdated 3 days ago

    git clone https://github.com/bitcloud-ai/Bittune.git
  9. text generation model by tencent

    Indexed Hugging Face Hub, tencent 286 ♥apache-2.0Updated 2 days ago

    tencent/Qwen3.8-27B-DSpine-b16
  10. ome

    AI repositories

    Open Model Engine (OME) — Kubernetes operator for LLM serving, GPU scheduling, and model lifecycle management. Works with SGLang, vLLM, TensorRT-LLM, and Triton

    Stale GitHub, ome-projects 523 ★Apache-2.0Updated 13 days ago

    git clone https://github.com/ome-projects/ome.git
  11. MemT-1.0

    Agents & frameworks

    Official repository for MemT-1.0

    Stale GitHub, MemTensor 527 ★Custom licence (see repository)Updated 8 days ago

    git clone https://github.com/MemTensor/MemT-1.0.git
  12. image text to text model by mistralai · transformers

    Indexed Hugging Face Hub, mistralai 1,663 ♥otherUpdated 14 days ago

    mistralai/Mistral-Large-4-1T-A52B
  13. text generation model by z-lab · transformers

    Stale Hugging Face Hub, z-lab 316 ♥apache-2.0Updated 2 months ago

    z-lab/Qwen3.8-27B-DFlash2
  14. kvcached

    AI repositories

    Virtualized Elastic KV Cache for Dynamic GPU Sharing and Beyond

    Stale GitHub, ovg-project 2,033 ★Apache-2.0Updated 8 days ago

    git clone https://github.com/ovg-project/kvcached.git
  15. One-Eval

    Datasets & benchmarks

    Automated system for LLM evaluation via agents. Doc as below:

    Stale GitHub, OpenDCAI 165 ★Apache-2.0Updated 2 months ago

    git clone https://github.com/OpenDCAI/One-Eval.git
  16. smg

    AI repositories

    Engine-agnostic LLM gateway in Rust. Full OpenAI & Anthropic API compatibility across vLLM, TRT-LLM, TokenSpeed, SGLang, OpenAI, Gemini & more. Industry-first gRPC pipeline, KV cache-aware routing, chat history, tokenization caching, Responses API, embeddings, WASM plugins, MCP, and multi-tenant auth.

    Indexed GitHub, smg-project 723 ★Apache-2.0Updated today

    git clone https://github.com/smg-project/smg.git
  17. text generation model by incoai · transformers

    Stale Hugging Face Hub, incoai 70 ♥apache-2.0Updated 28 days ago

    incoai/Qwen3.8-Flash-Next-DFlash2
  18. model by mistralai

    Stale Hugging Face Hub, mistralai 70 ♥otherUpdated 18 days ago

    mistralai/Mistral-Large-4-1T-A52B-NVFP4
  19. model by unsloth · transformers

    Stale Hugging Face Hub, unsloth 46 ♥otherUpdated 18 days ago

    unsloth/Mistral-Large-4-1T-A52B-GGUF
  20. text generation model by MiniMaxAI · transformers

    Indexed Hugging Face Hub, MiniMaxAI 77 ♥otherUpdated 6 days ago

    MiniMaxAI/MiniMax-H3-Image-PE
  21. inference

    AI repositories

    Open-source inference platform for language, vision, embedding, reranking, image, audio, and video models. Deploy with multiple engines across heterogeneous hardware, from a laptop to a distributed cluster. Serve models through OpenAI-compatible APIs.

    Indexed GitHub, xorbitsai 9,660 ★Apache-2.0Updated today

    git clone https://github.com/xorbitsai/inference.git
  22. Hyperloom

    Agents & frameworks

    An agentic system that auto-optimizes LLM workloads on AMD GPUs.

    Stale GitHub, AMD-AGI 269 ★Custom licence (see repository)Updated 4 days ago

    git clone https://github.com/AMD-AGI/Hyperloom.git
  23. image text to text model by drowzeys · transformers

    Stale Hugging Face Hub, drowzeys 129 ♥mitUpdated 27 days ago 1 note

    drowzeys/keys-DeepSeek-V4.1-Flash-1017-Abliterated
  24. skills

    Skills

    Claude Code plugin marketplace — 77 installable reference skills across vLLM/SGLang inference, Kubernetes & Harvester, GPU host bring-up, observability, security, and agent workflows.

    Stale GitHub, air-gapped 6 ★MITUpdated 6 days ago

    git clone https://github.com/air-gapped/skills.git

Indexed entries aren't reviewed or tested by InnerVault. Details come straight from each source. Anything that can reach your accounts, files or browser can do damage, so read the source before you install it.