Library
85,762 resources from 11 public sources. 54 checked by hand; the rest are unreviewed.
Results
-
TurtleBench
Datasets & benchmarksTurtleBench: Evaluating Top Language Models via Real-World Yes/No Puzzles.
git clone https://github.com/mazzzystar/TurtleBench.git -
SWE-ZERO-12M-trajectories
Datasets & benchmarksHugging Face dataset by AlienKevin
AlienKevin/SWE-ZERO-12M-trajectories -
NextTransformer
Datasets & benchmarks:sunrise: A comprehensive, cutting-edge open-source framework for next-generation Transformers/LLM, with compute-matched benchmarking and a platform for autonomous architecture research.
git clone https://github.com/Interactive-Active-AI/NextTransformer.git -
deepsearchqa
Datasets & benchmarksHugging Face dataset by google
google/deepsearchqa -
PKU-SafeRLHF
Datasets & benchmarksHugging Face dataset by PKU-Alignment
PKU-Alignment/PKU-SafeRLHF -
Big-Math-RL-Verified
Datasets & benchmarksHugging Face dataset by SynthLabsAI
SynthLabsAI/Big-Math-RL-Verified -
gigaspeech
Datasets & benchmarksHugging Face dataset by speechcolab
speechcolab/gigaspeech -
japanese-anime-speech-v2
Datasets & benchmarksHugging Face dataset by joujiboi
joujiboi/japanese-anime-speech-v2 -
Nemotron-Math-Proofs-v1
Datasets & benchmarksHugging Face dataset by nvidia
nvidia/Nemotron-Math-Proofs-v1 -
SciCode
Datasets & benchmarksA benchmark that challenges language models to code solutions for scientific problems
git clone https://github.com/scicode-bench/SciCode.git -
xperience-10m
Datasets & benchmarksHugging Face dataset by ropedia-ai
ropedia-ai/xperience-10m -
Nemotron-Personas-Japan
Datasets & benchmarksHugging Face dataset by nvidia
nvidia/Nemotron-Personas-Japan -
RLAIF-V-Dataset
Datasets & benchmarksHugging Face dataset by openbmb
openbmb/RLAIF-V-Dataset -
spotify-tracks-dataset
Datasets & benchmarksHugging Face dataset by maharshipandya
maharshipandya/spotify-tracks-dataset -
frames-benchmark
Datasets & benchmarksHugging Face dataset by google
google/frames-benchmark -
japanese-anime-speech
Datasets & benchmarksHugging Face dataset by joujiboi
joujiboi/japanese-anime-speech -
ParseBench
Datasets & benchmarksHugging Face dataset by llamaindex
llamaindex/ParseBench -
jupyter-agent-dataset
Datasets & benchmarksHugging Face dataset by jupyter-agent
jupyter-agent/jupyter-agent-dataset -
Awesome-LLM-Eval
Datasets & benchmarksAwesome-LLM-Eval: a curated list of tools, datasets/benchmark, demos, leaderboard, papers, docs and models, mainly for Evaluation on LLMs. 一个由工具、基准/数据、演示、排行榜和大模型等组成的精选列表,主要面向基础大模型评测,旨在探求生成式AI的技术边界.
git clone https://github.com/onejune2018/Awesome-LLM-Eval.git -
distilabel-capybara-dpo-7k-binarized
Datasets & benchmarksHugging Face dataset by argilla
argilla/distilabel-capybara-dpo-7k-binarized -
pixelprose
Datasets & benchmarksHugging Face dataset by tomg-group-umd
tomg-group-umd/pixelprose -
Chinese-H-Novels
Datasets & benchmarksHugging Face dataset by b3x0m
b3x0m/Chinese-H-Novels -
UHGEval
Datasets & benchmarks[ACL 2024] User-friendly evaluation framework: Eval Suite & Benchmarks: UHGEval, HaluEval, HalluQA, etc.
git clone https://github.com/IAAR-Shanghai/UHGEval.git -
dataclaw-peteromallet
Datasets & benchmarksHugging Face dataset by peteromallet
peteromallet/dataclaw-peteromallet
Indexed entries aren't reviewed or tested by InnerVault. Details come straight from each source. Anything that can reach your accounts, files or browser can do damage, so read the source before you install it.