Library
85,340 resources from 11 public sources. 54 checked by hand; the rest are unreviewed.
Results
-
prompts.chat
Datasets & benchmarksHugging Face dataset by fka
fka/prompts.chat -
ChatGPT-Jailbreak-Prompts
Datasets & benchmarksHugging Face dataset by rubend18
rubend18/ChatGPT-Jailbreak-Prompts -
LawBench
Datasets & benchmarksBenchmarking Legal Knowledge of Large Language Models
git clone https://github.com/open-compass/LawBench.git -
ShareGPT52K
Datasets & benchmarksHugging Face dataset by RyokoAI
RyokoAI/ShareGPT52K -
geobench
Datasets & benchmarksGeoGuessr benchmark for language models
git clone https://github.com/ccmdi/geobench.git -
sloptotal
Datasets & benchmarksOpen-source AI text detector and ChatGPT detector: 23 engines, one calibrated score, every number measured on a public benchmark. Self-hosted, runs on CPU.
git clone https://github.com/pablocaeg/sloptotal.git -
llm-bulls-and-cows-benchmark
Datasets & benchmarksA mini-framework for evaluating LLM performance on the Bulls and Cows number guessing game, supporting multiple LLM providers.
git clone https://github.com/stalkermustang/llm-bulls-and-cows-benchmark.git -
HC3
Datasets & benchmarksHugging Face dataset by Hello-SimpleAI
Hello-SimpleAI/HC3 -
HC3-Chinese
Datasets & benchmarksHugging Face dataset by Hello-SimpleAI
Hello-SimpleAI/HC3-Chinese -
UHGEval
Datasets & benchmarks[ACL 2024] User-friendly evaluation framework: Eval Suite & Benchmarks: UHGEval, HaluEval, HalluQA, etc.
git clone https://github.com/IAAR-Shanghai/UHGEval.git -
Awesome-LLM-Eval
Datasets & benchmarksAwesome-LLM-Eval: a curated list of tools, datasets/benchmark, demos, leaderboard, papers, docs and models, mainly for Evaluation on LLMs. 一个由工具、基准/数据、演示、排行榜和大模型等组成的精选列表,主要面向基础大模型评测,旨在探求生成式AI的技术边界.
git clone https://github.com/onejune2018/Awesome-LLM-Eval.git -
xVerify
Datasets & benchmarksxVerify: Efficient Answer Verifier for Reasoning Model Evaluations
git clone https://github.com/IAAR-Shanghai/xVerify.git -
bigcodebench
Datasets & benchmarks[ICLR'25] BigCodeBench: Benchmarking Code Generation Towards AGI
git clone https://github.com/bigcode-project/bigcodebench.git
Indexed entries aren't reviewed or tested by InnerVault. Details come straight from each source. Anything that can reach your accounts, files or browser can do damage, so read the source before you install it.