InnerVault

Library

85,762 resources from 11 public sources. 53 checked by hand; the rest are unreviewed.

Results

108 results with any of your words Clear search and filters
  1. xFinder

    Datasets & benchmarks

    [ICLR 2025] xFinder: Large Language Models as Automated Evaluators for Reliable Evaluation

    Stale GitHub, IAAR-Shanghai 178 ★Custom licence (see repository)Updated 12 months ago

    git clone https://github.com/IAAR-Shanghai/xFinder.git
  2. qwen38-strix-halo-harness

    Datasets & benchmarks

    AI coding agent harness for any hardware, local or cloud (OpenAI-compatible engines). Tuned for AMD Strix Halo: Qwen3.8 125B on the iGPU, NPU side-jobs, crash recovery, logged benchmarks.

    Stale GitHub, aic0d3r 38 ★MITUpdated 8 days ago

    git clone https://github.com/aic0d3r/qwen38-strix-halo-harness.git
  3. DyCodeEval

    Datasets & benchmarks

    Official repository of the ICML2025 paper “Dynamic Benchmarking of Reasoning Capabilities in Code Large Language Models Under Data Contamination”

    Stale GitHub, SeekingDream 222 ★Updated 10 months ago

    git clone https://github.com/SeekingDream/DyCodeEval.git
  4. ReForm-Eval

    Datasets & benchmarks

    An benchmark for evaluating the capabilities of large vision-language models (LVLMs)

    Stale GitHub, FudanDISC 145 ★Apache-2.0Updated 3 years ago

    git clone https://github.com/FudanDISC/ReForm-Eval.git
  5. openbench

    Datasets & benchmarks

    Same model, different wrapper: a from-scratch benchmark comparing coding-agent harnesses (codex, pi, opencode, cursor, devin) and open models on correctness, speed, and token cost

    Stale GitHub, minghinmatthewlam 137 ★MITUpdated 2 months ago

    git clone https://github.com/minghinmatthewlam/openbench.git
  6. mc4

    Datasets & benchmarks

    Hugging Face dataset by legacy-datasets

    Stale Hugging Face Hub, legacy-datasets 160 ♥odc-byUpdated 2 years ago

    legacy-datasets/mc4
  7. ChemLLMBench

    Datasets & benchmarks

    Official Code for What can Large Language Models do in chemistry? A comprehensive benchmark on eight tasks (In NeurIPS 2023)

    Stale GitHub, ChemFoundationModels 176 ★Updated 2 years ago

    git clone https://github.com/ChemFoundationModels/ChemLLMBench.git
  8. pile-of-law

    Datasets & benchmarks

    Hugging Face dataset by pile-of-law

    Indexed Hugging Face Hub, pile-of-law 295 ♥cc-by-nc-sa-4.0Updated 4 months ago

    pile-of-law/pile-of-law
  9. LawBench

    Datasets & benchmarks

    Benchmarking Legal Knowledge of Large Language Models

    Stale GitHub, open-compass 455 ★Apache-2.0Updated 3 years ago

    git clone https://github.com/open-compass/LawBench.git
  10. OSCAR-2301

    Datasets & benchmarks

    Hugging Face dataset by oscar-corpus

    Stale Hugging Face Hub, oscar-corpus 187 ♥cc0-1.0Updated 15 months ago 1 note

    oscar-corpus/OSCAR-2301
  11. SHP

    Datasets & benchmarks

    Hugging Face dataset by stanfordnlp

    Indexed Hugging Face Hub, stanfordnlp 333 ♥Updated 3 years ago

    stanfordnlp/SHP
  12. polymarket-paper-trader

    Datasets & benchmarks

    Paper trading simulator for Polymarket

    Stale GitHub, agent-next 495 ★MITUpdated 15 days ago

    git clone https://github.com/agent-next/polymarket-paper-trader.git
  13. WebInstructSub

    Datasets & benchmarks

    Hugging Face dataset by TIGER-Lab

    Stale Hugging Face Hub, TIGER-Lab 170 ♥apache-2.0Updated 2 years ago

    TIGER-Lab/WebInstructSub
  14. Matrix

    Datasets & benchmarks

    Hugging Face dataset by m-a-p

    Stale Hugging Face Hub, m-a-p 180 ♥apache-2.0Updated 20 months ago

    m-a-p/Matrix
  15. TACO

    Datasets & benchmarks

    Hugging Face dataset by BAAI

    Stale Hugging Face Hub, BAAI 144 ♥apache-2.0Updated 2 years ago

    BAAI/TACO
  16. Omni-SafetyBench

    Datasets & benchmarks

    [ACM MM 2026 Oral] Code for paper "Omni-SafetyBench: A Benchmark for Safety Evaluation of Audio-Visual Large Language Models".

    Stale GitHub, THU-BPM 115 ★Apache-2.0Updated 2 months ago

    git clone https://github.com/THU-BPM/Omni-SafetyBench.git
  17. JBB-Behaviors

    Datasets & benchmarks

    Hugging Face dataset by JailbreakBench

    Stale Hugging Face Hub, JailbreakBench 139 ♥mitUpdated 2 years ago

    JailbreakBench/JBB-Behaviors
  18. claude_mythos_distilled_25k

    Datasets & benchmarks

    Hugging Face dataset by WithinUsAI

    Stale Hugging Face Hub, WithinUsAI 191 ♥apache-2.0Updated 54 days ago

    WithinUsAI/claude_mythos_distilled_25k
  19. aurora

    Datasets & benchmarks

    [ICLR 2025] AuroraCap: Efficient, Performant Video Detailed Captioning and a New Benchmark

    Stale GitHub, wenhaochai 149 ★Apache-2.0Updated 17 months ago

    git clone https://github.com/wenhaochai/aurora.git
  20. NextTransformer

    Datasets & benchmarks

    :sunrise: A comprehensive, cutting-edge open-source framework for next-generation Transformers/LLM, with compute-matched benchmarking and a platform for autonomous architecture research.

    Indexed GitHub, Interactive-Active-AI 435 ★MITUpdated today

    git clone https://github.com/Interactive-Active-AI/NextTransformer.git
  21. confabulations

    Datasets & benchmarks

    Hallucinations (Confabulations) Document-Based Benchmark for RAG. Includes human-verified questions and answers.

    Stale GitHub, lechmazur 249 ★Updated 15 months ago

    git clone https://github.com/lechmazur/confabulations.git
  22. FastEval

    Datasets & benchmarks

    Fast & more realistic evaluation of chat language models. Includes leaderboard.

    Stale GitHub, FastEval 187 ★Apache-2.0Updated 2 years ago

    git clone https://github.com/FastEval/FastEval.git
  23. AmericanStories

    Datasets & benchmarks

    Hugging Face dataset by dell-research-harvard

    Stale Hugging Face Hub, dell-research-harvard 181 ♥cc-by-4.0Updated 20 months ago

    dell-research-harvard/AmericanStories
  24. minebench

    Datasets & benchmarks

    Minecraft-style voxel benchmark for comparing AI models (Arena + Sandbox)

    Indexed GitHub, Ammaar-Alam 343 ★MITUpdated 4 days ago

    git clone https://github.com/Ammaar-Alam/minebench.git

Indexed entries aren't reviewed or tested by InnerVault. Details come straight from each source. Anything that can reach your accounts, files or browser can do damage, so read the source before you install it.