InnerVault

Library

85,340 resources from 11 public sources. 54 checked by hand; the rest are unreviewed.

Results

  1. ml-engineering

    AI repositories

    Machine Learning Engineering Open Book

    Stale GitHub, stas00 19.7k ★CC-BY-SA-4.0Updated 12 days ago

    git clone https://github.com/stas00/ml-engineering.git
  2. llm-d

    AI repositories

    State of the art inference performance with modern accelerators on Kubernetes

    Indexed GitHub, llm-d 5,274 ★Apache-2.0Updated today

    git clone https://github.com/llm-d/llm-d.git
  3. dstack

    Skills

    A unified orchestration layer for heterogeneous AI compute. It standardizes how to manage compute and run training and inference on GPU clouds, Kubernetes, VMs, or bare-metal clusters.

    Stale GitHub, dstackai 2,293 ★MPL-2.0Updated 18 days ago

    git clone https://github.com/dstackai/dstack.git
  4. pegainfer

    AI repositories

    Pure Rust + CUDA LLM inference engine — no PyTorch, OpenAI-compatible, serves Qwen3 to Kimi-K2

    Stale GitHub, pegainfer-project 729 ★Apache-2.0Updated 18 days ago

    git clone https://github.com/pegainfer-project/pegainfer.git
  5. halogen-flash-server

    AI repositories

    Local inference that behaves like a frontier API: Qwen3.8-Flash-Next on AMD Strix Halo plus small NPU models, over the OpenAI and Anthropic APIs on one port.

    Stale GitHub, peonist-ai 1,258 ★Custom licence (see repository)Updated 8 days ago

    git clone https://github.com/peonist-ai/halogen-flash-server.git
  6. beta9

    AI repositories

    Ultrafast serverless GPU inference, sandboxes, and background jobs

    Indexed GitHub, beam-cloud 1,852 ★AGPL-3.0Updated today

    git clone https://github.com/beam-cloud/beta9.git
  7. Inference AIops

    MCP servers

    Governed GPU inference ops (vLLM + Ray Serve): latency RCA, scaling, drain, 39 tools.

    Stale Official MCP Registry, io.github.AIops-tools Updated 17 days ago 1 note

    inference-aiops@0.13.0
  8. Corey James portfolio

    MCP servers

    Fit reports and search over Corey James's work: GPU inference, agent governance, enterprise AI.

    Stale Official MCP Registry, ai.coreyjames Updated 20 days ago 1 note

Indexed entries aren't reviewed or tested by InnerVault. Details come straight from each source. Anything that can reach your accounts, files or browser can do damage, so read the source before you install it.