Library
85,762 resources from 11 public sources. 53 checked by hand; the rest are unreviewed.
Results
-
imp
Agents & frameworksRun large AI chat models privately on your own NVIDIA RTX 50 or RTX PRO graphics card. On one RTX 5090, Qwen3.8-27B writes about 70 words per second, 1.4x faster than vLLM. Even a model almost four times larger than the card's memory runs. Works with apps made for ChatGPT or Claude. Starts with one docker command.
git clone https://github.com/kekzl/imp.git -
ascend-sleuth
Skills昇腾 NPU 训练与推理故障诊断知识库:按症状命中 case、用先验知识与源码分析定位根因,定位后进待审队列、每周升格回库。
git clone https://github.com/pillumina/ascend-sleuth.git -
global-capacity-orchestrator-on-aws
MCP serversAI/ML and HPC at planetary scale. One API. Every Accelerator. Any Region. MIT-0 licensed.
git clone https://github.com/aws-solutions-library-samples/global-capacity-orchestrator-on-aws.git -
LMeterX
Datasets & benchmarksA general-purpose API load testing platform that supports LLM services、A2A/MCP services and business HTTP interfaces, enabling one-click performance testing, result comparison, and AI-powered intelligent analysis and summarization. 一站式通用 API 压测平台,支持大模型推理业/务 HTTP 接口、A2A/MCP服务,一键完成性能测试、结果对比与 AI 智能分析总结
git clone https://github.com/MigoXLab/LMeterX.git -
cuda-kernel-optimizer
SkillsEvidence-driven CUDA, CUTLASS, Triton and GPU workload optimization for ChatGPT · 使用 ChatGPT 驱动 GPU workload 性能优化
git clone https://github.com/troycheng/cuda-kernel-optimizer.git -
ai-hardware-fit
Datasets & benchmarksCan my GPU run this? Pick a GPU to get 3 fitting AI models, quantization, VRAM, speed ranges, and run commands. 한국어·English.
git clone https://github.com/jaeseok614/ai-hardware-fit.git -
ContextPilot
PromptsAccelerating Long Context LLM Inference with Accuracy-Preserving Context Optimization in SGLang, vLLM, llama.cpp, OpenClaw, RAG, and Agentic AI.
git clone https://github.com/EfficientContext/ContextPilot.git -
End-to-End-Agentic-Ai-Automation-Lab
MCP serversThis repository contains hands-on projects, code examples, and deployment workflows. Explore multi-agent systems, LangChain, LangGraph, AutoGen, CrewAI, RAG, MCP, automation with n8n, and scalable agent deployment using Docker, AWS, and BentoML.
git clone https://github.com/MDalamin5/End-to-End-Agentic-Ai-Automation-Lab.git -
agentic-loop-engineering-course
Docs & tutorialsAn 18 notebook course that isolates and measures each component of agentic loop engineering on real, industry standard software datasets.
git clone https://github.com/FareedKhan-dev/agentic-loop-engineering-course.git -
alzeo
Agents & frameworksAlzeo is an open-source installer that turns an NVIDIA DGX Spark, or any GB10 machine (ASUS, Dell, HP, Lenovo, MSI, GIGABYTE, Acer), into a private AI server in one command: measured model lanes, OpenAI and Anthropic APIs, and a local cockpit.
git clone https://github.com/hasso5703/alzeo.git -
model-compose
AI repositoriesDeclarative AI pipelines in one YAML file. Tokens, audio chunks, and video frames flow between isolated components. Compose 100+ components for models, agents, speech, vision, and live broadcast. Run local models, cloud APIs, or both. Inspired by docker-compose.
git clone https://github.com/hanyeol/model-compose.git -
taOS
Agents & frameworksSelf-hosted AI agent OS. Your memory, chat, agents, and files stay on hardware you own, offline by default, cloud by choice. Offline AI memory (taOSmd), self-hosted multi-framework group chat, a full web desktop + app store, and auto-clustering across the consumer hardware you already have (Orange/Raspberry Pi, Mac mini, gaming PC).
git clone https://github.com/jaylfc/taOS.git -
askimo
AI repositoriesAI desktop app for chat, RAG, Skills, MCP tools, and agents. Support multiple LLMs (Anthropic, OpenAI, VertexAI, vLLM, Nvidia NIM, Gemini, OpenRouter)
git clone https://github.com/askimo-ai/askimo.git -
qwen38-strix-halo-harness
Datasets & benchmarksAI coding agent harness for any hardware, local or cloud (OpenAI-compatible engines). Tuned for AMD Strix Halo: Qwen3.8 125B on the iGPU, NPU side-jobs, crash recovery, logged benchmarks.
git clone https://github.com/aic0d3r/qwen38-strix-halo-harness.git -
Inference AIops
MCP serversGoverned GPU inference ops (vLLM + Ray Serve): latency RCA, scaling, drain, 39 tools.
inference-aiops@0.13.0 -
qsp-client
MCP serversQSP — relay MCP tools to any OpenAI-compatible local LLM (llama.cpp, Ollama, vLLM)
qsp-client@0.5.2 -
qsp-mcp
MCP serversQSP — relay MCP tools to any OpenAI-compatible local LLM (llama.cpp, Ollama, vLLM)
qsp-mcp@0.1.1 -
localharness
Agents & frameworksAn open-source, coding agent harness designed specifically for local LLMs. Designed as everything a user needs to jumpstart their own harness (detailed event steams, logs, and performance data) or quickly replace closed source one (featuring out of the box plugins for web search, image gen, memory, auto research and more in dev).
git clone https://github.com/ahwurm/localharness.git -
Local AI MCP
MCP serversRun, fit, and route work to local LLMs (Ollama, LM Studio, llama.cpp, MLX, vLLM, and more).
@tmhs/local-ai-mcp@0.6.1 -
restai
AI repositoriesRESTai is an AIaaS (AI as a Service) open-source platform. Supports many public and local LLM suported by Ollama/vLLM/etc. Precise embeddings usage, tuning, analytics etc. Built-in image/audio generation with dynamic loading generators. Live chat deployment. Built-in block based graphical language. Prompt versioning and much more...
git clone https://github.com/apocas/restai.git -
ipex-llm
AI repositoriesAccelerate local LLM inference and finetuning (LLaMA, Mistral, ChatGLM, Qwen, DeepSeek, Mixtral, Gemma, Phi, MiniCPM, Qwen-VL, MiniCPM-V, etc.) on Intel XPU (e.g., local PC with iGPU and NPU, discrete GPU such as Arc, Flex and Max); seamlessly integrate with llama.cpp, Ollama, HuggingFace, LangChain, LlamaIndex, vLLM, DeepSpeed, Axolotl, etc.
git clone https://github.com/intel/ipex-llm.git -
ai-watermark-scrambler
SkillsScramble statistical AI text watermarks by rewriting with a local model (vLLM, Ollama), and strip C2PA, EXIF, XMP and invisible Unicode. Agent skill plus Python CLI.
git clone https://github.com/novatechflow/ai-watermark-scrambler.git -
automated-data-analyst
SkillsThe math arm for LLMs: compute and check numbers from CSV and Excel data with pandas, SciPy and statsmodels, each with its calculation. Tool calling for Claude, Codex and local models (Ollama, vLLM, llama.cpp, LM Studio), Kaggle-style AutoML with --explain, and paper tables and figures.
git clone https://github.com/saineshnakra/automated-data-analyst.git -
tne-sdk
SkillsTNE-SDK - The Official Python SDK for The Null Epoch - an AI-only MMO where LLMs play autonomously. Connect any model (OpenAI, Anthropic, Ollama, vLLM, etc.) via MCP, TUI launcher, or raw HTTP. Includes memory, reflection, and agent orchestration for persistent AI gameplay/benchmarking.
git clone https://github.com/Firespawn-Studios/tne-sdk.git
Indexed entries aren't reviewed or tested by InnerVault. Details come straight from each source. Anything that can reach your accounts, files or browser can do damage, so read the source before you install it.