Library
85,762 resources from 11 public sources. 54 checked by hand; the rest are unreviewed.
Results
-
coder_eval
SkillsPlaywright for coding agents. Test that your skills, MCP servers, and CLIs actually work when an agent uses them — sandboxed YAML suites, A/B experiments, CI gates.
git clone https://github.com/UiPath/coder_eval.git -
gamebot
Datasets & benchmarks[ACL 2025] GAMEBoT: Transparent Assessment of LLM Reasoning in Games
git clone https://github.com/Visual-AI/gamebot.git -
ai-village
Datasets & benchmarksHugging Face dataset by aidigestorg
aidigestorg/ai-village -
AutoHarness
Agents & frameworksAutoHarness: Automated Harness Engineering for AI Agents
git clone https://github.com/aiming-lab/AutoHarness.git -
gpqa
Datasets & benchmarksHugging Face dataset by Idavidrein
Idavidrein/gpqa -
Awesome-Jailbreak-on-LLMs
AI repositoriesAwesome-Jailbreak-on-LLMs is a collection of state-of-the-art, novel, exciting jailbreak methods on LLMs. It contains papers, codes, datasets, evaluations, and analyses.
git clone https://github.com/yueliu1999/Awesome-Jailbreak-on-LLMs.git -
Xiaomi-OCR-0
Modelsimage text to text model by xiaomi-research · transformers
xiaomi-research/Xiaomi-OCR-0 -
Omni-SafetyBench
Datasets & benchmarks[ACM MM 2026 Oral] Code for paper "Omni-SafetyBench: A Benchmark for Safety Evaluation of Audio-Visual Large Language Models".
git clone https://github.com/THU-BPM/Omni-SafetyBench.git -
chembench
Datasets & benchmarksHow good are LLMs at chemistry?
git clone https://github.com/lamalab-org/chembench.git -
Gemma-4-12B-OBLITERATED
Modelstext generation model by OBLITERATUS · transformers
OBLITERATUS/Gemma-4-12B-OBLITERATED -
Boucle-framework
Agents & frameworksAutonomous agent framework with structured memory, safety hooks, and loop management. Built by the agent that runs on it.
git clone https://github.com/Bande-a-Bonnot/Boucle-framework.git -
self-bench
Datasets & benchmarksBenchmark coding agents and models on your own repository with private Harbor-formatted evals built from its merged pull requests.
git clone https://github.com/mupt-ai/self-bench.git -
d3-turbo
Modelszero shot classification model by vllm-sr · transformers
vllm-sr/d3-turbo -
LightOnOCR-3-4B
Modelsimage text to text model by lightonai · transformers
lightonai/LightOnOCR-3-4B -
awesome-rsi
Docs & tutorialsA curated research map of Recursive Self-Improvement (RSI): models, agents, harnesses, embodied systems, automated AI R&D, benchmarks, and safety.
git clone https://github.com/lobehub/awesome-rsi.git -
ritmo
Agents & frameworksThe agent-first type safe ECS runtime
git clone https://github.com/typeonce-dev/ritmo.git -
TrustLLM
Datasets & benchmarks[ICML 2024] TrustLLM: LLM trustworthiness evaluation across truthfulness, safety, fairness, robustness, privacy and ethics. Python/CLI toolkit for local models, compatible APIs and AI agent orchestration.
git clone https://github.com/HowieHwong/TrustLLM.git -
d3-flash
Modelszero shot classification model by vllm-sr · transformers
vllm-sr/d3-flash -
web-eval-agent
MCP serversAn MCP server that autonomously evaluates web applications.
git clone https://github.com/refreshdotdev/web-eval-agent.git -
vega-08b-public-intents
Modelstext classification model by nandakishorm · vega
nandakishorm/vega-08b-public-intents -
agents-last-exam
Datasets & benchmarksHugging Face dataset by agents-last-exam
agents-last-exam/agents-last-exam -
skillcheck
PromptsBlind A/B testing for AI agent skills, .cursorrules, CLAUDE.md, and system prompts. Detects placebo and harmful instructions.
git clone https://github.com/sx4im/skillcheck.git -
ai-eval
MCP serversCloudflare Workers MCP server: ai-eval
-
OvisOCR3
Modelsimage text to text model by ATH-MaaS · transformers
ATH-MaaS/OvisOCR3
Indexed entries aren't reviewed or tested by InnerVault. Details come straight from each source. Anything that can reach your accounts, files or browser can do damage, so read the source before you install it.