Library
85,762 resources from 11 public sources. 53 checked by hand; the rest are unreviewed.
Results
-
fde-gym
Datasets & benchmarksThe online judge for the LLM era. Every case is a real customer delivery: you work it with a coding agent, and your system is judged once it is live.
git clone https://github.com/deeplethe/fde-gym.git -
primitive-bench
Datasets & benchmarksThe marketplace for verifiable AI outcomes: state a task, get a fixed price upfront, and Primitive Bench routes across tools to complete it, refunded if the outcome isn't delivered. This repo is the open verification layer.
git clone https://github.com/primitive-bench/primitive-bench.git -
copilot-cache-scout
Agents & frameworksMulti-Agent Code Review Cost Benchmark 2026: Librarian vs Prompt Cache
git clone https://github.com/PROrunner926/copilot-cache-scout.git -
awesome-decision-models
AI repositoriesA curated list of decision models (System One / typed decision models): hosted APIs, open-weight models, runtimes, SDKs, applications, benchmarks, and papers.
git clone https://github.com/AnotiaWang/awesome-decision-models.git -
multi-agents
Datasets & benchmarksMulti-agent teams for real work: run teams of coding agents (Claude Code, Codex, any model) in isolated git worktrees, and measure whether the team beats a solo agent on cost and results.
git clone https://github.com/BichengWang/multi-agents.git -
fastRAG
AI repositoriesEfficient Retrieval Augmentation and Generation Framework
git clone https://github.com/IntelLabs/fastRAG.git -
llm-srbench
Agents & frameworks[ICML2025 Oral] LLM-SRBench: A New Benchmark for Scientific Equation Discovery with Large Language Models
git clone https://github.com/deep-symbolic-mathematics/llm-srbench.git -
agent-skill-implementation
SkillsEmpirical research into how agent platforms implement Agent Skill loading, management, and presentation. Benchmark skills and per-platform findings.
git clone https://github.com/agent-ecosystem/agent-skill-implementation.git -
apple-silicon-llm-bench
Datasets & benchmarksReproducible on-device LLM benchmarks for Apple Silicon (iPhone 17 Pro, M4 Max): Apple Core AI, MLX, llama.cpp, LiteRT-LM and Core ML on the same model and harness, every number with its quantization and capture session; hybrid Mamba-2 models (Nemotron-3 Nano, Granite-4.0-H, Falcon-H1) included.
git clone https://github.com/john-rocky/apple-silicon-llm-bench.git -
many-ppt-skills
SkillsEvery AI slide-deck skill worth knowing, on one page — both the HTML and native-PPTX routes, compared on what actually decides the choice rather than on star count. Bilingual, auto-refreshed.
git clone https://github.com/brycewang-stanford/many-ppt-skills.git -
DeepResearch-Bench-II
Datasets & benchmarksDeepResearch Bench II (DRB2) is the follow-up to DeepResearch Bench, with a stronger focus on measuring the gap between deep research systems and human experts. It does so by decomposing expert-written reports into hierarchical rubrics covering presentation, analysis, and evidence, and using them to evaluate model-generated.
git clone https://github.com/imlrz/DeepResearch-Bench-II.git -
ouba-classmate
Skills一行安装的中文求职 Agent Skills 套件,覆盖跳槽涨薪全流程(岗位搜索/简历匹配/面试陪练/查公司)+《中文 AI 求职 Skill 公开横评》数据。Claude Code·Codex·MCP
git clone https://github.com/ouxxyy/ouba-classmate.git -
avaloka
Agents & frameworksOpen source release of Data Science Agents that can analyze and transform datasets as well as train and infer models to augment your data scientists.
git clone https://github.com/guruvaidev/avaloka.git -
backendskills
SkillsSkills that stop AI agents from writing backend code that passes the demo and breaks in production. Critical mistakes: 25/150 runs without, 2/150 with. Claude Code, Codex, Cursor.
git clone https://github.com/globalmpc/backendskills.git -
LMeterX
Datasets & benchmarksA general-purpose API load testing platform that supports LLM services、A2A/MCP services and business HTTP interfaces, enabling one-click performance testing, result comparison, and AI-powered intelligent analysis and summarization. 一站式通用 API 压测平台,支持大模型推理业/务 HTTP 接口、A2A/MCP服务,一键完成性能测试、结果对比与 AI 智能分析总结
git clone https://github.com/MigoXLab/LMeterX.git -
opentai.github.io
SkillsThe official website of the Open Trustworthy AI Community (OpenTAI).
git clone https://github.com/OpenTAI/opentai.github.io.git -
Awesome-LLMs-for-Vulnerability-Detection
AI repositoriesThe community's most comprehensive, continuously-updated index of research on Large Language Models for software vulnerability detection — papers across function-level, repository-level, agentic, and smart-contract detection, plus datasets, benchmarks, and surveys.
git clone https://github.com/huhusmang/Awesome-LLMs-for-Vulnerability-Detection.git -
skills
SkillsEdge finds task-fit agent skills, shows available evidence, and loads pinned versions into AI agents.
git clone https://github.com/getedgehq/skills.git -
Awesome-Self-Evolving-Agents
SkillsA Survey of Self-Evolving Agents | A curated list of resources (surveys, papers, benchmarks, and opensource projects) on Self-Evolving Agents.
git clone https://github.com/XMUDeepLIT/Awesome-Self-Evolving-Agents.git -
ai-hardware-fit
Datasets & benchmarksCan my GPU run this? Pick a GPU to get 3 fitting AI models, quantization, VRAM, speed ranges, and run commands. 한국어·English.
git clone https://github.com/jaeseok614/ai-hardware-fit.git -
skillcheck
PromptsBlind A/B testing for AI agent skills, .cursorrules, CLAUDE.md, and system prompts. Detects placebo and harmful instructions.
git clone https://github.com/sx4im/skillcheck.git -
Awesome-Agent-Memory
AI repositoriesCurated systems, benchmarks, and papers etc. on memory for LLMs/MLLMs --- long-term context, retrieval, and reasoning.
git clone https://github.com/TeleAI-UAGI/Awesome-Agent-Memory.git -
CaPtain
Agents & frameworksCaPtain: A Pipeline for Post-Training Code-as-Policy Robot Agents — CaPtain-Harness, SFT and RL training code, benchmark adapters
git clone https://github.com/waltstephen/CaPtain.git -
dokimi
SkillsDokimi (Greek δοκιμή, "test, proof") measures whether a skill, MCP doc source, agent profile or repository guidance actually helps a coding agent: paired on/off arm comparisons, novel-vs-known content analysis, and repository scans with graded agent runs.
git clone https://github.com/intel/dokimi.git
Indexed entries aren't reviewed or tested by InnerVault. Details come straight from each source. Anything that can reach your accounts, files or browser can do damage, so read the source before you install it.