InnerVault

Library

85,762 resources from 11 public sources. 54 checked by hand; the rest are unreviewed.

Results

522 results with any of your words Clear search and filters
  1. GRIT

    Datasets & benchmarks

    Hugging Face dataset by zzliang

    Stale Hugging Face Hub, zzliang 164 ♥ms-plUpdated 3 years ago

    zzliang/GRIT
  2. xVerify

    Datasets & benchmarks

    xVerify: Efficient Answer Verifier for Reasoning Model Evaluations

    Stale GitHub, IAAR-Shanghai 150 ★Custom licence (see repository)Updated 20 days ago

    git clone https://github.com/IAAR-Shanghai/xVerify.git
  3. AI_Diplomacy

    Datasets & benchmarks

    Frontier Models playing the board game Diplomacy.

    Stale GitHub, GoodStartLabs 708 ★Custom licence (see repository)Updated 5 months ago

    git clone https://github.com/GoodStartLabs/AI_Diplomacy.git
  4. openbench

    Datasets & benchmarks

    Same model, different wrapper: a from-scratch benchmark comparing coding-agent harnesses (codex, pi, opencode, cursor, devin) and open models on correctness, speed, and token cost

    Stale GitHub, minghinmatthewlam 137 ★MITUpdated 2 months ago

    git clone https://github.com/minghinmatthewlam/openbench.git
  5. polymarket-paper-trader

    Datasets & benchmarks

    Paper trading simulator for Polymarket

    Stale GitHub, agent-next 495 ★MITUpdated 16 days ago

    git clone https://github.com/agent-next/polymarket-paper-trader.git
  6. minebench

    Datasets & benchmarks

    Minecraft-style voxel benchmark for comparing AI models (Arena + Sandbox)

    Indexed GitHub, Ammaar-Alam 343 ★MITUpdated 5 days ago

    git clone https://github.com/Ammaar-Alam/minebench.git
  7. active_genie

    Datasets & benchmarks

    The Lodash for GenAI: Real Value + Consistent + Model-Agnostic

    Stale GitHub, Roriz 168 ★Apache-2.0Updated 3 months ago

    git clone https://github.com/Roriz/active_genie.git
  8. LoopArena

    Datasets & benchmarks

    Benchmarking models as runtime Controllers for Loop Engineering

    Stale GitHub, AMAP-ML 151 ★Apache-2.0Updated 33 days ago

    git clone https://github.com/AMAP-ML/LoopArena.git
  9. PyHealth

    Datasets & benchmarks

    A deep learning toolkit for healthcare AI: EHR (MIMIC, eICU, OMOP), clinical text, signals and imaging. 30+ models, reproducible pipelines.

    Indexed GitHub, sunlabuiuc 1,699 ★MITUpdated yesterday

    git clone https://github.com/sunlabuiuc/PyHealth.git
  10. debate

    Datasets & benchmarks

    Adversarial multi-turn benchmark for LLM debate quality, using side-swapped matchups and multi-model judging to rank models by judged debate performance.

    Stale GitHub, lechmazur 38 ★Updated 22 days ago

    git clone https://github.com/lechmazur/debate.git
  11. DecisionPivot

    Datasets & benchmarks

    DecisionPivot: a diagnostic benchmark for decision models in LLM systems. Contrast pairs that differ in one decisive detail, generators with independent solvers, scorer and runners.

    Stale GitHub, StartLuxLabs 144 ★Apache-2.0Updated 27 days ago

    git clone https://github.com/StartLuxLabs/DecisionPivot.git
  12. nagi-bench

    Datasets & benchmarks

    One-shot LLM eval cases by NAGI STUDIO - same prompt, different agents (model + harness), runnable artifacts side by side.

    Indexed GitHub, nagi-studio 78 ★MITUpdated 5 days ago

    git clone https://github.com/nagi-studio/nagi-bench.git
  13. NIMStats

    Datasets & benchmarks

    📊 Automated hourly benchmarks for 20+ NVIDIA NIM models — interactive dashboard, zero infra, self-hostable. Open-source & community-driven.

    Indexed GitHub, MauroDruwel 57 ★Updated yesterday

    git clone https://github.com/MauroDruwel/NIMStats.git
  14. llm-price-compass

    Datasets & benchmarks

    This project collects GPU benchmarks from various cloud providers and compares them to fixed per token costs. Use our tool for efficient LLM GPU selections and cost-effective AI models. LLM provider price comparison, gpu benchmarks to price per token calculation, gpu benchmark table

    Stale GitHub, arc53 221 ★MITUpdated 23 months ago

    git clone https://github.com/arc53/llm-price-compass.git
  15. multi-agents

    Datasets & benchmarks

    Multi-agent teams for real work: run teams of coding agents (Claude Code, Codex, any model) in isolated git worktrees, and measure whether the team beats a solo agent on cost and results.

    Stale GitHub, BichengWang 158 ★MITUpdated 9 days ago

    git clone https://github.com/BichengWang/multi-agents.git
  16. self-bench

    Datasets & benchmarks

    Benchmark coding agents and models on your own repository with private Harbor-formatted evals built from its merged pull requests.

    Indexed GitHub, mupt-ai 34 ★MITUpdated yesterday

    git clone https://github.com/mupt-ai/self-bench.git
  17. DeepResearch-Bench-II

    Datasets & benchmarks

    DeepResearch Bench II (DRB2) is the follow-up to DeepResearch Bench, with a stronger focus on measuring the gap between deep research systems and human experts. It does so by decomposing expert-written reports into hierarchical rubrics covering presentation, analysis, and evidence, and using them to evaluate model-generated.

    Stale GitHub, imlrz 96 ★Apache-2.0Updated 29 days ago

    git clone https://github.com/imlrz/DeepResearch-Bench-II.git
  18. Awesome-AI4AI

    Datasets & benchmarks

    Updated weekly — until humanity achieves AI4AI. 1148 curated papers across Benchmarks, Harness Design, and Model Design — from long-horizon agents to recursive self-improvement. Citation rankings, GitHub stars, and source-verified weekly news.

    Stale GitHub, KaiWU5 218 ★MITUpdated 9 days ago

    git clone https://github.com/KaiWU5/Awesome-AI4AI.git

Indexed entries aren't reviewed or tested by InnerVault. Details come straight from each source. Anything that can reach your accounts, files or browser can do damage, so read the source before you install it.