InnerVault

Library

85,762 resources from 11 public sources. 53 checked by hand; the rest are unreviewed.

Results

  1. humanities_data_benchmark

    Datasets & benchmarks

    LLM Benchmark Suite for Humanities Data

    Stale GitHub, RISE-UNIBAS 32 ★GPL-3.0Updated 12 days ago

    git clone https://github.com/RISE-UNIBAS/humanities_data_benchmark.git
  2. Catch fabricated RAG citations before they reach the user: a zero-token verbatim gate + a burden-of-proof judge, framework-agnostic.

    Indexed GitHub, tonydzi 6 ★MITUpdated 2 days ago

    git clone https://github.com/tonydzi/verbatim-citation-gate.git
  3. embodied-first-exam

    Agents & frameworks

    The first exam for code agents in the physical world: frozen robot tasks from many benchmark suites, each answered with a program and verified in a separate sandbox. Runs on Harbor.

    Stale GitHub, mll-lab-nu 236 ★MITUpdated 10 days ago

    git clone https://github.com/mll-lab-nu/embodied-first-exam.git
  4. caliper

    Agents & frameworks

    Run your real agent with and without your skills, MCPs, and rules. See which ones actually help, and what they cost in tokens. Supports Claude Code, Codex, Pi, Hermes, Antigravity, and OpenCode.

    Indexed GitHub, edonadei 235 ★MITUpdated yesterday

    git clone https://github.com/edonadei/caliper.git
  5. PhysGym

    Datasets & benchmarks

    A benchmark suite for evaluating LLM-based interactive scientific reasoning.

    Indexed GitHub, principia-ai 103 ★MITUpdated 3 days ago

    git clone https://github.com/principia-ai/PhysGym.git
  6. labelhub-platform

    MCP servers

    面向 LLM 训练数据生产的可信工作台:AI 提供证据、人类裁决,append-only 账本、可复现导出、评测关卡与 MCP Server。

    Stale GitHub, Iceberg86-gb 48 ★Apache-2.0Updated 9 days ago

    git clone https://github.com/Iceberg86-gb/labelhub-platform.git
  7. haiku.rag

    AI repositories

    Agentic RAG for local and self-hosted document search: hybrid retrieval, reranking and multimodal RAG on embedded LanceDB, with Docling parsing and an MCP server

    Indexed GitHub, ggozad 660 ★MITUpdated yesterday

    git clone https://github.com/ggozad/haiku.rag.git
  8. dxl-commerce-agent

    Tools & apps

    OpenClaw + 大模型驱动的完整电商客服自动化系统:覆盖淘宝、拼多多、抖音、快手、小红书、视频号,包含浏览器/手机 Worker、订单物流与售后工具、记忆、回执、恢复和 Eval。--------------技术交流或者定制开发加微信:whichmen。

    Indexed GitHub, whichmen 145 ★MITUpdated 2 days ago

    git clone https://github.com/whichmen/dxl-commerce-agent.git
  9. GDPevo

    Datasets & benchmarks

    A Benchmark for Evaluating Agent Self-Evolution on Real Business Tasks

    Stale GitHub, Prism-Shadow 119 ★Apache-2.0Updated 18 days ago

    git clone https://github.com/Prism-Shadow/GDPevo.git
  10. agentic-ai

    AI repositories

    Agentic AI research papers, benchmarks, frameworks, and tools curated across 24 domains.

    Indexed GitHub, mahmoudrabie 193 ★MITUpdated 2 days ago

    git clone https://github.com/mahmoudrabie/agentic-ai.git
  11. cap-evolve

    MCP servers

    Optimize any AI agent’s skills, tools/MCP, and prompts against your own evals.

    Indexed GitHub, skillberry-ai 70 ★Apache-2.0Updated today

    git clone https://github.com/skillberry-ai/cap-evolve.git
  12. DM-Code-Agent

    Agents & frameworks

    An inspectable coding agent. Trace changes, diagnose failed runs, and share test evidence. Local-first Python, no-key demo, standalone HTML reports.

    Indexed GitHub, hwfengcs 152 ★MITUpdated yesterday

    git clone https://github.com/hwfengcs/DM-Code-Agent.git
  13. Awesome-Jailbreak-on-LLMs

    AI repositories

    Awesome-Jailbreak-on-LLMs is a collection of state-of-the-art, novel, exciting jailbreak methods on LLMs. It contains papers, codes, datasets, evaluations, and analyses.

    Stale GitHub, yueliu1999 1,730 ★MITUpdated 8 days ago

    git clone https://github.com/yueliu1999/Awesome-Jailbreak-on-LLMs.git
  14. Act as an AI Security and Compliance Expert. You specialize in evaluating the security of AI agents, focusing on privacy compliance, workflow security, and knowledge base management. Your task is to create a…

    Indexed prompts.chat (CC0 prompt collection), bluedog110776@gmail.com CC0-1.0

  15. # Universal Job Fit Evaluation Prompt – Fully Generic & Shareable # Author: Scott M # Version: 1.6 # Last Modified: 2026-03-06 ## Changelog - **v1.6 (2026-03-06):** Integrated "Read Between the Lines" (Vibe Check), ATS…

    Indexed prompts.chat (CC0 prompt collection), thanos0000@gmail.com CC0-1.0

  16. Research-Assistant-Agent

    Agents & frameworks

    Multi-agent research execution system: paper reproduction, benchmark evaluation, AutoResearch and claim-evidence graphs

    Indexed GitHub, zzp1221 207 ★MITUpdated 3 days ago

    git clone https://github.com/zzp1221/Research-Assistant-Agent.git
  17. 🚀 A curated collection of AI engineering resources, roadmaps, tools, and projects covering LLMs, RAG, AI Agents, MCP, fine-tuning, evaluations, and production AI systems.

    Stale GitHub, dipakkr 22.5k ★MITUpdated 26 days ago

    git clone https://github.com/dipakkr/awesome-ai-engineering.git
  18. GateMem

    Agents & frameworks

    GateMem: a benchmark and evaluation toolkit for memory governance in multi-principal shared-memory LLM agents.

    Stale GitHub, rzhub 139 ★MITUpdated 35 days ago

    git clone https://github.com/rzhub/GateMem.git
  19. DishwasherBench

    Datasets & benchmarks

    A dishwasher-loading game on a physical simulation of one real machine, built to benchmark language models and playable in a browser. The game inside is called Spotless.

    Stale GitHub, composo-ai 71 ★MITUpdated 30 days ago

    git clone https://github.com/composo-ai/DishwasherBench.git
  20. sec-code-bench

    Datasets & benchmarks

    SecCodeBench is a benchmark suite focusing on evaluating the security of code generated by large language models (LLMs).

    Stale GitHub, alibaba 135 ★Apache-2.0Updated 35 days ago

    git clone https://github.com/alibaba/sec-code-bench.git
  21. evidently

    AI repositories

    Evidently is an open-source ML and LLM observability framework. Evaluate, test, and monitor any AI-powered system or data pipeline. From tabular data to Gen AI. 100+ metrics.

    Stale GitHub, evidentlyai 7,988 ★Apache-2.0Updated 48 days ago

    git clone https://github.com/evidentlyai/evidently.git
  22. Self-improvement feedback loop for AI agent skills — analyzes past sessions, drafts structured improvement proposals, and gates auto-apply behind an evaluation framework. Host-agnostic (Hermes, Claude Code, and any HostAdapter).

    Stale GitHub, Carlo1911 6 ★MITUpdated 29 days ago

    git clone https://github.com/Carlo1911/skill-evolution.git
  23. Awesome-Agent-Harness

    Agents & frameworks

    The first survey dedicated to LLM agent harnesses — 168 references, 34 evidence-coded systems, and 30 evaluation entries.

    Stale GitHub, Gloriaameng 381 ★CC-BY-4.0Updated 7 days ago

    git clone https://github.com/Gloriaameng/Awesome-Agent-Harness.git
  24. Repo2RLEnv

    AI repositories

    Turn any repository into verifiable RL environments for coding agents - Harbor tasks you can train on, evaluate and share on the Hugging Face Hub

    Stale GitHub, huggingface 779 ★Apache-2.0Updated 7 days ago

    git clone https://github.com/huggingface/Repo2RLEnv.git

Indexed entries aren't reviewed or tested by InnerVault. Details come straight from each source. Anything that can reach your accounts, files or browser can do damage, so read the source before you install it.