InnerVault

Library

85,762 resources from 11 public sources. 53 checked by hand; the rest are unreviewed.

Results

  1. imp

    Agents & frameworks

    Run large AI chat models privately on your own NVIDIA RTX 50 or RTX PRO graphics card. On one RTX 5090, Qwen3.8-27B writes about 70 words per second, 1.4x faster than vLLM. Even a model almost four times larger than the card's memory runs. Works with apps made for ChatGPT or Claude. Starts with one docker command.

    Stale GitHub, kekzl 124 ★MITUpdated 12 days ago

    git clone https://github.com/kekzl/imp.git
  2. ascend-sleuth

    Skills

    昇腾 NPU 训练与推理故障诊断知识库:按症状命中 case、用先验知识与源码分析定位根因,定位后进待审队列、每周升格回库。

    Indexed GitHub, pillumina 6 ★MITUpdated today

    git clone https://github.com/pillumina/ascend-sleuth.git
  3. AI/ML and HPC at planetary scale. One API. Every Accelerator. Any Region. MIT-0 licensed.

    Stale GitHub, aws-solutions-library-samples 54 ★MIT-0Updated 5 days ago

    git clone https://github.com/aws-solutions-library-samples/global-capacity-orchestrator-on-aws.git
  4. LMeterX

    Datasets & benchmarks

    A general-purpose API load testing platform that supports LLM services、A2A/MCP services and business HTTP interfaces, enabling one-click performance testing, result comparison, and AI-powered intelligent analysis and summarization. 一站式通用 API 压测平台,支持大模型推理业/务 HTTP 接口、A2A/MCP服务,一键完成性能测试、结果对比与 AI 智能分析总结

    Stale GitHub, MigoXLab 212 ★Apache-2.0Updated 55 days ago

    git clone https://github.com/MigoXLab/LMeterX.git
  5. Evidence-driven CUDA, CUTLASS, Triton and GPU workload optimization for ChatGPT · 使用 ChatGPT 驱动 GPU workload 性能优化

    Stale GitHub, troycheng 7 ★MITUpdated 12 days ago

    git clone https://github.com/troycheng/cuda-kernel-optimizer.git
  6. ai-hardware-fit

    Datasets & benchmarks

    Can my GPU run this? Pick a GPU to get 3 fitting AI models, quantization, VRAM, speed ranges, and run commands. 한국어·English.

    Indexed GitHub, jaeseok614 44 ★MITUpdated today

    git clone https://github.com/jaeseok614/ai-hardware-fit.git
  7. ContextPilot

    Prompts

    Accelerating Long Context LLM Inference with Accuracy-Preserving Context Optimization in SGLang, vLLM, llama.cpp, OpenClaw, RAG, and Agentic AI.

    Stale GitHub, EfficientContext 145 ★Apache-2.0Updated 25 days ago

    git clone https://github.com/EfficientContext/ContextPilot.git
  8. This repository contains hands-on projects, code examples, and deployment workflows. Explore multi-agent systems, LangChain, LangGraph, AutoGen, CrewAI, RAG, MCP, automation with n8n, and scalable agent deployment using Docker, AWS, and BentoML.

    Stale GitHub, MDalamin5 104 ★MITUpdated 13 days ago

    git clone https://github.com/MDalamin5/End-to-End-Agentic-Ai-Automation-Lab.git
  9. An 18 notebook course that isolates and measures each component of agentic loop engineering on real, industry standard software datasets.

    Stale GitHub, FareedKhan-dev 59 ★MITUpdated 4 months ago

    git clone https://github.com/FareedKhan-dev/agentic-loop-engineering-course.git
  10. alzeo

    Agents & frameworks

    Alzeo is an open-source installer that turns an NVIDIA DGX Spark, or any GB10 machine (ASUS, Dell, HP, Lenovo, MSI, GIGABYTE, Acer), into a private AI server in one command: measured model lanes, OpenAI and Anthropic APIs, and a local cockpit.

    Stale GitHub, hasso5703 258 ★MITUpdated 5 days ago

    git clone https://github.com/hasso5703/alzeo.git
  11. model-compose

    AI repositories

    Declarative AI pipelines in one YAML file. Tokens, audio chunks, and video frames flow between isolated components. Compose 100+ components for models, agents, speech, vision, and live broadcast. Run local models, cloud APIs, or both. Inspired by docker-compose.

    Indexed GitHub, hanyeol 119 ★MITUpdated today

    git clone https://github.com/hanyeol/model-compose.git
  12. taOS

    Agents & frameworks

    Self-hosted AI agent OS. Your memory, chat, agents, and files stay on hardware you own, offline by default, cloud by choice. Offline AI memory (taOSmd), self-hosted multi-framework group chat, a full web desktop + app store, and auto-clustering across the consumer hardware you already have (Orange/Raspberry Pi, Mac mini, gaming PC).

    Indexed GitHub, jaylfc 608 ★AGPL-3.0Updated yesterday

    git clone https://github.com/jaylfc/taOS.git
  13. askimo

    AI repositories

    AI desktop app for chat, RAG, Skills, MCP tools, and agents. Support multiple LLMs (Anthropic, OpenAI, VertexAI, vLLM, Nvidia NIM, Gemini, OpenRouter)

    Indexed GitHub, askimo-ai 550 ★AGPL-3.0Updated yesterday

    git clone https://github.com/askimo-ai/askimo.git
  14. qwen38-strix-halo-harness

    Datasets & benchmarks

    AI coding agent harness for any hardware, local or cloud (OpenAI-compatible engines). Tuned for AMD Strix Halo: Qwen3.8 125B on the iGPU, NPU side-jobs, crash recovery, logged benchmarks.

    Stale GitHub, aic0d3r 38 ★MITUpdated 8 days ago

    git clone https://github.com/aic0d3r/qwen38-strix-halo-harness.git
  15. Inference AIops

    MCP servers

    Governed GPU inference ops (vLLM + Ray Serve): latency RCA, scaling, drain, 39 tools.

    Stale Official MCP Registry, io.github.AIops-tools Updated 17 days ago 1 note

    inference-aiops@0.13.0
  16. qsp-client

    MCP servers

    QSP — relay MCP tools to any OpenAI-compatible local LLM (llama.cpp, Ollama, vLLM)

    Stale Official MCP Registry, io.github.qso-graph Updated 8 days ago 1 note

    qsp-client@0.5.2
  17. qsp-mcp

    MCP servers

    QSP — relay MCP tools to any OpenAI-compatible local LLM (llama.cpp, Ollama, vLLM)

    Stale Official MCP Registry, io.github.qso-graph Updated 49 days ago 2 notes

    qsp-mcp@0.1.1
  18. localharness

    Agents & frameworks

    An open-source, coding agent harness designed specifically for local LLMs. Designed as everything a user needs to jumpstart their own harness (detailed event steams, logs, and performance data) or quickly replace closed source one (featuring out of the box plugins for web search, image gen, memory, auto research and more in dev).

    Stale GitHub, ahwurm 59 ★MITUpdated 12 days ago

    git clone https://github.com/ahwurm/localharness.git
  19. Local AI MCP

    MCP servers

    Run, fit, and route work to local LLMs (Ollama, LM Studio, llama.cpp, MLX, vLLM, and more).

    Stale Official MCP Registry, io.github.TMHSDigital Updated 13 days ago 2 notes

    @tmhs/local-ai-mcp@0.6.1
  20. restai

    AI repositories

    RESTai is an AIaaS (AI as a Service) open-source platform. Supports many public and local LLM suported by Ollama/vLLM/etc. Precise embeddings usage, tuning, analytics etc. Built-in image/audio generation with dynamic loading generators. Live chat deployment. Built-in block based graphical language. Prompt versioning and much more...

    Indexed GitHub, apocas 520 ★Apache-2.0Updated 3 days ago

    git clone https://github.com/apocas/restai.git
  21. ipex-llm

    AI repositories

    Accelerate local LLM inference and finetuning (LLaMA, Mistral, ChatGLM, Qwen, DeepSeek, Mixtral, Gemma, Phi, MiniCPM, Qwen-VL, MiniCPM-V, etc.) on Intel XPU (e.g., local PC with iGPU and NPU, discrete GPU such as Arc, Flex and Max); seamlessly integrate with llama.cpp, Ollama, HuggingFace, LangChain, LlamaIndex, vLLM, DeepSpeed, Axolotl, etc.

    Stale Archived GitHub, intel 8,846 ★Apache-2.0Updated 9 months ago 1 note

    git clone https://github.com/intel/ipex-llm.git
  22. Scramble statistical AI text watermarks by rewriting with a local model (vLLM, Ollama), and strip C2PA, EXIF, XMP and invisible Unicode. Agent skill plus Python CLI.

    Stale GitHub, novatechflow 7 ★Apache-2.0Updated 12 days ago

    git clone https://github.com/novatechflow/ai-watermark-scrambler.git
  23. The math arm for LLMs: compute and check numbers from CSV and Excel data with pandas, SciPy and statsmodels, each with its calculation. Tool calling for Claude, Codex and local models (Ollama, vLLM, llama.cpp, LM Studio), Kaggle-style AutoML with --explain, and paper tables and figures.

    Stale GitHub, saineshnakra 35 ★MITUpdated 10 days ago

    git clone https://github.com/saineshnakra/automated-data-analyst.git
  24. tne-sdk

    Skills

    TNE-SDK - The Official Python SDK for The Null Epoch - an AI-only MMO where LLMs play autonomously. Connect any model (OpenAI, Anthropic, Ollama, vLLM, etc.) via MCP, TUI launcher, or raw HTTP. Includes memory, reflection, and agent orchestration for persistent AI gameplay/benchmarking.

    Stale GitHub, Firespawn-Studios 14 ★MITUpdated 17 days ago

    git clone https://github.com/Firespawn-Studios/tne-sdk.git

Indexed entries aren't reviewed or tested by InnerVault. Details come straight from each source. Anything that can reach your accounts, files or browser can do damage, so read the source before you install it.