Library
85,340 resources from 11 public sources. 54 checked by hand; the rest are unreviewed.
Results
-
ml-engineering
AI repositoriesMachine Learning Engineering Open Book
git clone https://github.com/stas00/ml-engineering.git -
llm-d
AI repositoriesState of the art inference performance with modern accelerators on Kubernetes
git clone https://github.com/llm-d/llm-d.git -
dstack
SkillsA unified orchestration layer for heterogeneous AI compute. It standardizes how to manage compute and run training and inference on GPU clouds, Kubernetes, VMs, or bare-metal clusters.
git clone https://github.com/dstackai/dstack.git -
pegainfer
AI repositoriesPure Rust + CUDA LLM inference engine — no PyTorch, OpenAI-compatible, serves Qwen3 to Kimi-K2
git clone https://github.com/pegainfer-project/pegainfer.git -
halogen-flash-server
AI repositoriesLocal inference that behaves like a frontier API: Qwen3.8-Flash-Next on AMD Strix Halo plus small NPU models, over the OpenAI and Anthropic APIs on one port.
git clone https://github.com/peonist-ai/halogen-flash-server.git -
beta9
AI repositoriesUltrafast serverless GPU inference, sandboxes, and background jobs
git clone https://github.com/beam-cloud/beta9.git -
Inference AIops
MCP serversGoverned GPU inference ops (vLLM + Ray Serve): latency RCA, scaling, drain, 39 tools.
inference-aiops@0.13.0 -
Corey James portfolio
MCP serversFit reports and search over Corey James's work: GPU inference, agent governance, enterprise AI.
Indexed entries aren't reviewed or tested by InnerVault. Details come straight from each source. Anything that can reach your accounts, files or browser can do damage, so read the source before you install it.