InnerVault

Library

85,762 resources from 11 public sources. 53 checked by hand; the rest are unreviewed.

Results

  1. fde-gym

    Datasets & benchmarks

    The online judge for the LLM era. Every case is a real customer delivery: you work it with a coding agent, and your system is judged once it is live.

    Stale GitHub, deeplethe 111 ★Apache-2.0Updated 18 days ago

    git clone https://github.com/deeplethe/fde-gym.git
  2. primitive-bench

    Datasets & benchmarks

    The marketplace for verifiable AI outcomes: state a task, get a fixed price upfront, and Primitive Bench routes across tools to complete it, refunded if the outcome isn't delivered. This repo is the open verification layer.

    Stale GitHub, primitive-bench 122 ★Apache-2.0Updated 2 months ago

    git clone https://github.com/primitive-bench/primitive-bench.git
  3. copilot-cache-scout

    Agents & frameworks

    Multi-Agent Code Review Cost Benchmark 2026: Librarian vs Prompt Cache

    Indexed GitHub, PROrunner926 114 ★Updated today

    git clone https://github.com/PROrunner926/copilot-cache-scout.git
  4. awesome-decision-models

    AI repositories

    A curated list of decision models (System One / typed decision models): hosted APIs, open-weight models, runtimes, SDKs, applications, benchmarks, and papers.

    Stale GitHub, AnotiaWang 699 ★CC0-1.0Updated 7 days ago

    git clone https://github.com/AnotiaWang/awesome-decision-models.git
  5. multi-agents

    Datasets & benchmarks

    Multi-agent teams for real work: run teams of coding agents (Claude Code, Codex, any model) in isolated git worktrees, and measure whether the team beats a solo agent on cost and results.

    Stale GitHub, BichengWang 158 ★MITUpdated 8 days ago

    git clone https://github.com/BichengWang/multi-agents.git
  6. fastRAG

    AI repositories

    Efficient Retrieval Augmentation and Generation Framework

    Stale Archived GitHub, IntelLabs 1,786 ★Apache-2.0Updated 10 months ago 1 note

    git clone https://github.com/IntelLabs/fastRAG.git
  7. llm-srbench

    Agents & frameworks

    [ICML2025 Oral] LLM-SRBench: A New Benchmark for Scientific Equation Discovery with Large Language Models

    Stale GitHub, deep-symbolic-mathematics 131 ★Updated 15 months ago

    git clone https://github.com/deep-symbolic-mathematics/llm-srbench.git
  8. Empirical research into how agent platforms implement Agent Skill loading, management, and presentation. Benchmark skills and per-platform findings.

    Stale GitHub, agent-ecosystem 6 ★CC-BY-4.0Updated 15 days ago

    git clone https://github.com/agent-ecosystem/agent-skill-implementation.git
  9. apple-silicon-llm-bench

    Datasets & benchmarks

    Reproducible on-device LLM benchmarks for Apple Silicon (iPhone 17 Pro, M4 Max): Apple Core AI, MLX, llama.cpp, LiteRT-LM and Core ML on the same model and harness, every number with its quantization and capture session; hybrid Mamba-2 models (Nemotron-3 Nano, Granite-4.0-H, Falcon-H1) included.

    Indexed GitHub, john-rocky 73 ★MITUpdated today

    git clone https://github.com/john-rocky/apple-silicon-llm-bench.git
  10. Every AI slide-deck skill worth knowing, on one page — both the HTML and native-PPTX routes, compared on what actually decides the choice rather than on star count. Bilingual, auto-refreshed.

    Stale GitHub, brycewang-stanford 73 ★Custom licence (see repository)Updated 8 days ago

    git clone https://github.com/brycewang-stanford/many-ppt-skills.git
  11. DeepResearch-Bench-II

    Datasets & benchmarks

    DeepResearch Bench II (DRB2) is the follow-up to DeepResearch Bench, with a stronger focus on measuring the gap between deep research systems and human experts. It does so by decomposing expert-written reports into hierarchical rubrics covering presentation, analysis, and evidence, and using them to evaluate model-generated.

    Stale GitHub, imlrz 96 ★Apache-2.0Updated 28 days ago

    git clone https://github.com/imlrz/DeepResearch-Bench-II.git
  12. 一行安装的中文求职 Agent Skills 套件,覆盖跳槽涨薪全流程(岗位搜索/简历匹配/面试陪练/查公司)+《中文 AI 求职 Skill 公开横评》数据。Claude Code·Codex·MCP

    Indexed GitHub, ouxxyy 71 ★MITUpdated today

    git clone https://github.com/ouxxyy/ouba-classmate.git
  13. avaloka

    Agents & frameworks

    Open source release of Data Science Agents that can analyze and transform datasets as well as train and infer models to augment your data scientists.

    Stale GitHub, guruvaidev 94 ★Apache-2.0Updated 5 days ago

    git clone https://github.com/guruvaidev/avaloka.git
  14. backendskills

    Skills

    Skills that stop AI agents from writing backend code that passes the demo and breaks in production. Critical mistakes: 25/150 runs without, 2/150 with. Claude Code, Codex, Cursor.

    Stale GitHub, globalmpc 49 ★MITUpdated 7 days ago

    git clone https://github.com/globalmpc/backendskills.git
  15. LMeterX

    Datasets & benchmarks

    A general-purpose API load testing platform that supports LLM services、A2A/MCP services and business HTTP interfaces, enabling one-click performance testing, result comparison, and AI-powered intelligent analysis and summarization. 一站式通用 API 压测平台,支持大模型推理业/务 HTTP 接口、A2A/MCP服务,一键完成性能测试、结果对比与 AI 智能分析总结

    Stale GitHub, MigoXLab 212 ★Apache-2.0Updated 55 days ago

    git clone https://github.com/MigoXLab/LMeterX.git
  16. The official website of the Open Trustworthy AI Community (OpenTAI).

    Indexed GitHub, OpenTAI 12 ★Updated today

    git clone https://github.com/OpenTAI/opentai.github.io.git
  17. The community's most comprehensive, continuously-updated index of research on Large Language Models for software vulnerability detection — papers across function-level, repository-level, agentic, and smart-contract detection, plus datasets, benchmarks, and surveys.

    Indexed GitHub, huhusmang 1,597 ★MITUpdated yesterday

    git clone https://github.com/huhusmang/Awesome-LLMs-for-Vulnerability-Detection.git
  18. skills

    Skills

    Edge finds task-fit agent skills, shows available evidence, and loads pinned versions into AI agents.

    Stale GitHub, getedgehq 5 ★Apache-2.0Updated 4 days ago

    git clone https://github.com/getedgehq/skills.git
  19. A Survey of Self-Evolving Agents | A curated list of resources (surveys, papers, benchmarks, and opensource projects) on Self-Evolving Agents.

    Indexed GitHub, XMUDeepLIT 485 ★Updated 3 days ago

    git clone https://github.com/XMUDeepLIT/Awesome-Self-Evolving-Agents.git
  20. ai-hardware-fit

    Datasets & benchmarks

    Can my GPU run this? Pick a GPU to get 3 fitting AI models, quantization, VRAM, speed ranges, and run commands. 한국어·English.

    Indexed GitHub, jaeseok614 44 ★MITUpdated today

    git clone https://github.com/jaeseok614/ai-hardware-fit.git
  21. skillcheck

    Prompts

    Blind A/B testing for AI agent skills, .cursorrules, CLAUDE.md, and system prompts. Detects placebo and harmful instructions.

    Stale GitHub, sx4im 30 ★MITUpdated 13 days ago

    git clone https://github.com/sx4im/skillcheck.git
  22. Awesome-Agent-Memory

    AI repositories

    Curated systems, benchmarks, and papers etc. on memory for LLMs/MLLMs --- long-term context, retrieval, and reasoning.

    Indexed GitHub, TeleAI-UAGI 713 ★Apache-2.0Updated yesterday

    git clone https://github.com/TeleAI-UAGI/Awesome-Agent-Memory.git
  23. CaPtain

    Agents & frameworks

    CaPtain: A Pipeline for Post-Training Code-as-Policy Robot Agents — CaPtain-Harness, SFT and RL training code, benchmark adapters

    Indexed GitHub, waltstephen 96 ★MITUpdated 6 days ago

    git clone https://github.com/waltstephen/CaPtain.git
  24. dokimi

    Skills

    Dokimi (Greek δοκιμή, "test, proof") measures whether a skill, MCP doc source, agent profile or repository guidance actually helps a coding agent: paired on/off arm comparisons, novel-vs-known content analysis, and repository scans with graded agent runs.

    Indexed GitHub, intel 37 ★Apache-2.0Updated today

    git clone https://github.com/intel/dokimi.git

Indexed entries aren't reviewed or tested by InnerVault. Details come straight from each source. Anything that can reach your accounts, files or browser can do damage, so read the source before you install it.