InnerVault

Library

85,340 resources from 11 public sources. 54 checked by hand; the rest are unreviewed.

Results

  1. text generation model by prism-ml · mlx

    Stale Hugging Face Hub, prism-ml 452 ♥apache-2.0Updated 55 days ago

    prism-ml/Ternary-Bonsai-2-27B-mlx-2bit
  2. text generation model by Edge0 · edge0

    Indexed Hugging Face Hub, Edge0 98 ♥otherUpdated yesterday

    Edge0/Edge0-145B-q3k
  3. cuda4cpu

    MCP servers

    Compile, run and check CUDA and HIP kernels without a GPU: wrong results, races, memory errors

    Stale Official MCP Registry, io.github.javier-cabezas Updated 6 days ago 1 note

    ghcr.io/javier-cabezas/cuda4cpu:0.6.0
  4. NVIDIA CUDA Docs

    MCP servers

    Search NVIDIA CUDA documentation and code samples from AI coding agents.

    Stale Official MCP Registry, com.nvidia.ngc.nsight.copilot.api Updated 3 months ago 1 note

  5. CUDA-Q Docs

    MCP servers

    CUDA-Q docs, API reference, and runnable examples for AI agents, pinned to your installed version.

    Stale Official MCP Registry, io.github.rogerawong Updated 3 months ago 1 note

    cudaq-docs-mcp@0.1.1
  6. cuvs

    AI repositories

    cuVS - a library for vector search and clustering on the GPU

    Indexed GitHub, NVIDIA 895 ★Apache-2.0Updated 2 days ago

    git clone https://github.com/NVIDIA/cuvs.git
  7. beta9

    AI repositories

    Ultrafast serverless GPU inference, sandboxes, and background jobs

    Indexed GitHub, beam-cloud 1,852 ★AGPL-3.0Updated today

    git clone https://github.com/beam-cloud/beta9.git
  8. ramalama

    AI repositories

    RamaLama is an open-source developer tool that simplifies the local serving of AI models from any source and facilitates their use for inference in production, all through the familiar language of containers.

    Stale GitHub, containers 3,097 ★MITUpdated 16 days ago

    git clone https://github.com/containers/ramalama.git
  9. uccl

    AI repositories

    UCCL is an efficient communication library for GPUs, covering collectives, P2P (e.g., KV cache transfer, RL weight transfer), and EP (e.g., GPU-driven)

    Indexed GitHub, uccl-project 1,585 ★Apache-2.0Updated yesterday

    git clone https://github.com/uccl-project/uccl.git
  10. text generation model by Edge0 · edge0

    Indexed Hugging Face Hub, Edge0 36 ♥otherUpdated yesterday

    Edge0/Edge0-120B-NVFP4
  11. zero-to-sglang

    Docs & tutorials

    Official SGLang x Datawhale course on LLM inference: understand inference, build a mini-sglang from scratch, then read the real SGLang source and land your first PR. Available in English and Chinese.

    Indexed GitHub, datawhalechina 2,148 ★Updated today

    git clone https://github.com/datawhalechina/zero-to-sglang.git
  12. text generation model by Edge0 · edge0

    Indexed Hugging Face Hub, Edge0 20 ♥otherUpdated yesterday

    Edge0/Edge0-120B-q3k
  13. image text to text model by prism-ml · llama.cpp

    Indexed Hugging Face Hub, prism-ml 183 ♥apache-2.0Updated 12 days ago

    prism-ml/Ternary-Bonsai-2-9B-gguf
  14. starling

    AI repositories

    Local AI in .NET, with no Python sidecar and no API key: embeddings, entity extraction, image and video search and chat on ONNX Runtime (CPU/CUDA), through Microsoft.Extensions.AI.

    Indexed GitHub, starlinghq 102 ★Apache-2.0Updated today

    git clone https://github.com/starlinghq/starling.git
  15. Glyd

    Datasets & benchmarks

    Lossless AI compression: 33% less GPU memory, bit for bit.

    Stale GitHub, surya-koritala 321 ★Custom licence (see repository)Updated 14 days ago

    git clone https://github.com/surya-koritala/Glyd.git
  16. yzma

    AI repositories

    Go with your own intelligence - Write Go applications that directly integrate llama.cpp for local inference using hardware acceleration on Linux, macOS, Windows, & WebAssembly.

    Stale GitHub, hybridgroup 652 ★Custom licence (see repository)Updated 32 days ago

    git clone https://github.com/hybridgroup/yzma.git
  17. Flide

    Agents & frameworks

    🔥🔥 The extremely fast inference engine for decision model

    Stale GitHub, OmniJev 396 ★Apache-2.0Updated 5 days ago

    git clone https://github.com/OmniJev/Flide.git
  18. Audio Studio

    MCP servers

    Local AI BGM and sound effects with Stable Audio 3 (Apple Silicon MLX, NVIDIA CUDA)

    Indexed Official MCP Registry, io.github.kanaworksai-hue 673 ★Updated today 1 note

    audio-studio-mcp@1.1.1
  19. image text to text model by prism-ml · llama.cpp

    Stale Hugging Face Hub, prism-ml 34 ♥apache-2.0Updated 33 days ago

    prism-ml/Ternary-Bonsai-2-2B-gguf
  20. doomsday

    Skills

    Doomsday Network (DOOM) — Sovereign Layer-1 Proof-of-Work GPU Blockchain (SHA-256d CUDA), Zero-Fee PPLNS Pool, Remote MCP Server & 1:1 Base Mainnet DeFi Bridge (wDOOM)

    Stale GitHub, doomsday-network 16 ★MITUpdated 22 days ago

    git clone https://github.com/doomsday-network/doomsday.git
  21. image text to text model by prism-ml · llama.cpp

    Stale Hugging Face Hub, prism-ml 30 ♥apache-2.0Updated 32 days ago

    prism-ml/Ternary-Bonsai-2-4B-gguf
  22. project-maya

    AI repositories

    Project Maya - run GLM-5.3-Flash (321B MoE), DeepSeek-V4.1-Flash-1017 (748B MoE) and MiniMax-M3.1-Flash (428B MoE) privately on your own GPU(s), from one card to 16, NVIDIA or AMD, Linux or Windows. Engine, server, dashboard, OpenAI- and Anthropic-compatible API, quant tools.

    Stale GitHub, mw00 2,482 ★MITUpdated 12 days ago

    git clone https://github.com/mw00/project-maya.git
  23. z-image-studio

    MCP servers

    A Cli, a webUI, and a MCP server for the Z-Image-Turbo text-to-image generation model (Tongyi-MAI/Z-Image-Turbo base model as well as quantized models)

    Stale GitHub, iconben 128 ★Apache-2.0Updated 25 days ago

    git clone https://github.com/iconben/z-image-studio.git
  24. ai-hardware-engineer-roadmap

    Agents & frameworks

    Master AI inference, AI agent harness systems, and hardware engineering — then design a physical AI chip. That is the goal.

    Stale GitHub, ai-hpc 291 ★MITUpdated 28 days ago

    git clone https://github.com/ai-hpc/ai-hardware-engineer-roadmap.git

Indexed entries aren't reviewed or tested by InnerVault. Details come straight from each source. Anything that can reach your accounts, files or browser can do damage, so read the source before you install it.