InnerVault

Library

85,762 resources from 11 public sources. 53 checked by hand; the rest are unreviewed.

Results

  1. Awesome-AI-Scientist

    Datasets & benchmarks

    🧪 Awesome list of AI Scientist papers, systems, benchmarks, datasets and open-source platforms.

    Indexed GitHub, Omni-Scientist 105 ★Custom licence (see repository)Updated 3 days ago

    git clone https://github.com/Omni-Scientist/Awesome-AI-Scientist.git
  2. llm-value-rankings

    Datasets & benchmarks

    Daily LLM value rankings - compare 300+ models by intelligence, speed and price. OpenRouter + Artificial Analysis. 大模型性价比排行榜

    Indexed GitHub, yyh-001 30 ★MITUpdated yesterday

    git clone https://github.com/yyh-001/llm-value-rankings.git
  3. fleurs

    Datasets & benchmarks

    Hugging Face dataset by google

    Indexed Hugging Face Hub, google 513 ♥cc-by-4.0Updated 6 months ago

    google/fleurs
  4. ResearchClawBench

    Datasets & benchmarks

    🦞 ResearchClawBench: Evaluating AI Agents for Automated Research from Re-Discovery to New-Discovery

    Stale GitHub, InternScience 275 ★MITUpdated 19 days ago

    git clone https://github.com/InternScience/ResearchClawBench.git
  5. mobilegym

    Datasets & benchmarks

    [EMNLP 2026] MobileGym: A Verifiable and Highly Parallel Simulation Platform for Mobile GUI Agent Research · 浏览器里运行的安卓模拟器 · Browser-hosted Android Simulator · Verifiable Evaluation · Scalable Online RL Training

    Indexed GitHub, Purewhiter 866 ★Apache-2.0Updated 3 days ago

    git clone https://github.com/Purewhiter/mobilegym.git
  6. Multi-User-LLM-Agent

    Datasets & benchmarks

    Official code for the paper: "Multi-User Large Language Model Agents"

    Stale GitHub, Kordi-AI 39 ★Apache-2.0Updated 7 days ago

    git clone https://github.com/Kordi-AI/Multi-User-LLM-Agent.git
  7. aya_dataset

    Datasets & benchmarks

    Hugging Face dataset by CohereLabs

    Indexed Hugging Face Hub, CohereLabs 382 ♥apache-2.0Updated 19 months ago

    CohereLabs/aya_dataset
  8. aya_collection

    Datasets & benchmarks

    Hugging Face dataset by CohereLabs

    Indexed Hugging Face Hub, CohereLabs 252 ♥apache-2.0Updated 19 months ago

    CohereLabs/aya_collection
  9. alem-env

    Datasets & benchmarks

    Can LLM/MARL agents coordinate in long-horizon, open-ended tasks? NeurIPS 2026 (Evaluations and Datasets).

    Stale GitHub, alem-world 57 ★MITUpdated 11 days ago

    git clone https://github.com/alem-world/alem-env.git
  10. xVerify

    Datasets & benchmarks

    xVerify: Efficient Answer Verifier for Reasoning Model Evaluations

    Stale GitHub, IAAR-Shanghai 150 ★Custom licence (see repository)Updated 19 days ago

    git clone https://github.com/IAAR-Shanghai/xVerify.git
  11. mac-ml-speed-test

    Datasets & benchmarks

    A few quick scripts focused on testing TensorFlow/PyTorch/Llama 2 on macOS.

    Stale GitHub, mrdbourke 203 ★Updated 2 years ago

    git clone https://github.com/mrdbourke/mac-ml-speed-test.git
  12. sloptotal

    Datasets & benchmarks

    Open-source AI text detector and ChatGPT detector: 23 engines, one calibrated score, every number measured on a public benchmark. Self-hosted, runs on CPU.

    Stale GitHub, pablocaeg 98 ★MITUpdated 13 days ago

    git clone https://github.com/pablocaeg/sloptotal.git
  13. TwinFix

    Datasets & benchmarks

    TwinFix — AI agent that diagnoses, reproduces and fixes bugs in a disposable twin environment. 在一次性孪生环境中自动诊断、复现并修复故障的 AI Agent。

    Indexed GitHub, spacesky-cell 117 ★Apache-2.0Updated 3 days ago

    git clone https://github.com/spacesky-cell/TwinFix.git
  14. autoguardrails

    Datasets & benchmarks

    Alignment-research scaffold (autoresearch-style) for LLM guardrails: search over a single policy.md surface

    Stale GitHub, SantanderAI 129 ★Apache-2.0Updated 46 days ago

    git clone https://github.com/SantanderAI/autoguardrails.git
  15. agent-duel

    Datasets & benchmarks

    Blinded battles between coding agents: two agents, one prompt, you pick the winner. Desktop app, runs locally.

    Stale GitHub, bottomless 35 ★Custom licence (see repository)Updated 5 days ago

    git clone https://github.com/bottomless/agent-duel.git
  16. awesome-ai-gateway

    Datasets & benchmarks

    ⚡ Awesome AI Gateway — pick an AI gateway from 240+ (LiteLLM, OpenRouter, Portkey, Kong, Higress, new-api, Bifrost) by cost, security & compliance, see what consolidated in 2026, learn how they actually work from an 8-chapter handbook, and verify every number yourself. Reproducible benchmarks, bilingual; stars & releases refreshed daily.

    Indexed GitHub, cuihuan 158 ★CC0-1.0Updated yesterday

    git clone https://github.com/cuihuan/awesome-ai-gateway.git
  17. xFinder

    Datasets & benchmarks

    [ICLR 2025] xFinder: Large Language Models as Automated Evaluators for Reliable Evaluation

    Stale GitHub, IAAR-Shanghai 178 ★Custom licence (see repository)Updated 12 months ago

    git clone https://github.com/IAAR-Shanghai/xFinder.git
  18. agent-orchestra

    Datasets & benchmarks

    Agents can work. They cannot declare success. A governed coordination protocol for multi-agent AI work: eight contracts (task, resource, ownership, handoff, verification, evidence, approval, recovery) enforced in code, plus a reproducible conformance benchmark. Apache-2.0 code, CC BY 4.0 specification, zero dependencies, Node 18+.

    Stale GitHub, 3338902669-ops 93 ★Apache-2.0Updated 24 days ago

    git clone https://github.com/3338902669-ops/agent-orchestra.git
  19. lasagna

    Datasets & benchmarks

    Swap one RAG pipeline stage, hold the rest fixed, and measure whether the gain survives composition. The framework behind "Retrieval Augmented Generation Compositionality": 450 configurations, eight benchmarks, corpora from 5K to 200K documents.

    Indexed GitHub, dolev31 35 ★Apache-2.0Updated yesterday

    git clone https://github.com/dolev31/lasagna.git
  20. qwen38-strix-halo-harness

    Datasets & benchmarks

    AI coding agent harness for any hardware, local or cloud (OpenAI-compatible engines). Tuned for AMD Strix Halo: Qwen3.8 125B on the iGPU, NPU side-jobs, crash recovery, logged benchmarks.

    Stale GitHub, aic0d3r 38 ★MITUpdated 8 days ago

    git clone https://github.com/aic0d3r/qwen38-strix-halo-harness.git
  21. xorcise

    Datasets & benchmarks

    Run cyber-AI agents against real missions in isolated environments. Record everything as OpenTelemetry evidence. Grade the evidence, not the claim.

    Stale GitHub, xorcise-ai 33 ★Custom licence (see repository)Updated 17 days ago

    git clone https://github.com/xorcise-ai/xorcise.git
  22. fde-gym

    Datasets & benchmarks

    The online judge for the LLM era. Every case is a real customer delivery: you work it with a coding agent, and your system is judged once it is live.

    Stale GitHub, deeplethe 111 ★Apache-2.0Updated 18 days ago

    git clone https://github.com/deeplethe/fde-gym.git
  23. bigcodebench

    Datasets & benchmarks

    [ICLR'25] BigCodeBench: Benchmarking Code Generation Towards AGI

    Stale Archived GitHub, bigcode-project 516 ★Apache-2.0Updated 10 months ago 1 note

    git clone https://github.com/bigcode-project/bigcodebench.git
  24. llm100kbench

    Datasets & benchmarks

    LLM 100k portfolio management benchmark

    Stale Archived GitHub, gqgs 44 ★Updated 21 days ago 1 note

    git clone https://github.com/gqgs/llm100kbench.git

Indexed entries aren't reviewed or tested by InnerVault. Details come straight from each source. Anything that can reach your accounts, files or browser can do damage, so read the source before you install it.