Library
85,340 resources from 11 public sources. 54 checked by hand; the rest are unreviewed.
Results
-
text generation model by prism-ml · mlx
prism-ml/Ternary-Bonsai-2-27B-mlx-2bit -
Edge0-145B-q3k
Modelstext generation model by Edge0 · edge0
Edge0/Edge0-145B-q3k -
cuda4cpu
MCP serversCompile, run and check CUDA and HIP kernels without a GPU: wrong results, races, memory errors
ghcr.io/javier-cabezas/cuda4cpu:0.6.0 -
NVIDIA CUDA Docs
MCP serversSearch NVIDIA CUDA documentation and code samples from AI coding agents.
-
CUDA-Q Docs
MCP serversCUDA-Q docs, API reference, and runnable examples for AI agents, pinned to your installed version.
cudaq-docs-mcp@0.1.1 -
cuvs
AI repositoriescuVS - a library for vector search and clustering on the GPU
git clone https://github.com/NVIDIA/cuvs.git -
beta9
AI repositoriesUltrafast serverless GPU inference, sandboxes, and background jobs
git clone https://github.com/beam-cloud/beta9.git -
ramalama
AI repositoriesRamaLama is an open-source developer tool that simplifies the local serving of AI models from any source and facilitates their use for inference in production, all through the familiar language of containers.
git clone https://github.com/containers/ramalama.git -
uccl
AI repositoriesUCCL is an efficient communication library for GPUs, covering collectives, P2P (e.g., KV cache transfer, RL weight transfer), and EP (e.g., GPU-driven)
git clone https://github.com/uccl-project/uccl.git -
Edge0-120B-NVFP4
Modelstext generation model by Edge0 · edge0
Edge0/Edge0-120B-NVFP4 -
zero-to-sglang
Docs & tutorialsOfficial SGLang x Datawhale course on LLM inference: understand inference, build a mini-sglang from scratch, then read the real SGLang source and land your first PR. Available in English and Chinese.
git clone https://github.com/datawhalechina/zero-to-sglang.git -
Edge0-120B-q3k
Modelstext generation model by Edge0 · edge0
Edge0/Edge0-120B-q3k -
Ternary-Bonsai-2-9B-gguf
Modelsimage text to text model by prism-ml · llama.cpp
prism-ml/Ternary-Bonsai-2-9B-gguf -
starling
AI repositoriesLocal AI in .NET, with no Python sidecar and no API key: embeddings, entity extraction, image and video search and chat on ONNX Runtime (CPU/CUDA), through Microsoft.Extensions.AI.
git clone https://github.com/starlinghq/starling.git -
Glyd
Datasets & benchmarksLossless AI compression: 33% less GPU memory, bit for bit.
git clone https://github.com/surya-koritala/Glyd.git -
yzma
AI repositoriesGo with your own intelligence - Write Go applications that directly integrate llama.cpp for local inference using hardware acceleration on Linux, macOS, Windows, & WebAssembly.
git clone https://github.com/hybridgroup/yzma.git -
Flide
Agents & frameworks🔥🔥 The extremely fast inference engine for decision model
git clone https://github.com/OmniJev/Flide.git -
Audio Studio
MCP serversLocal AI BGM and sound effects with Stable Audio 3 (Apple Silicon MLX, NVIDIA CUDA)
audio-studio-mcp@1.1.1 -
Ternary-Bonsai-2-2B-gguf
Modelsimage text to text model by prism-ml · llama.cpp
prism-ml/Ternary-Bonsai-2-2B-gguf -
doomsday
SkillsDoomsday Network (DOOM) — Sovereign Layer-1 Proof-of-Work GPU Blockchain (SHA-256d CUDA), Zero-Fee PPLNS Pool, Remote MCP Server & 1:1 Base Mainnet DeFi Bridge (wDOOM)
git clone https://github.com/doomsday-network/doomsday.git -
Ternary-Bonsai-2-4B-gguf
Modelsimage text to text model by prism-ml · llama.cpp
prism-ml/Ternary-Bonsai-2-4B-gguf -
project-maya
AI repositoriesProject Maya - run GLM-5.3-Flash (321B MoE), DeepSeek-V4.1-Flash-1017 (748B MoE) and MiniMax-M3.1-Flash (428B MoE) privately on your own GPU(s), from one card to 16, NVIDIA or AMD, Linux or Windows. Engine, server, dashboard, OpenAI- and Anthropic-compatible API, quant tools.
git clone https://github.com/mw00/project-maya.git -
z-image-studio
MCP serversA Cli, a webUI, and a MCP server for the Z-Image-Turbo text-to-image generation model (Tongyi-MAI/Z-Image-Turbo base model as well as quantized models)
git clone https://github.com/iconben/z-image-studio.git -
ai-hardware-engineer-roadmap
Agents & frameworksMaster AI inference, AI agent harness systems, and hardware engineering — then design a physical AI chip. That is the goal.
git clone https://github.com/ai-hpc/ai-hardware-engineer-roadmap.git
Indexed entries aren't reviewed or tested by InnerVault. Details come straight from each source. Anything that can reach your accounts, files or browser can do damage, so read the source before you install it.