Library
85,762 resources from 11 public sources. 54 checked by hand; the rest are unreviewed.
Results
-
fable-5-premium
Datasets & benchmarksHugging Face dataset by saidutta69
saidutta69/fable-5-premium -
TurtleBench
Datasets & benchmarksTurtleBench: Evaluating Top Language Models via Real-World Yes/No Puzzles.
git clone https://github.com/mazzzystar/TurtleBench.git -
Trendyol-Cybersecurity-Instruction-Tuning-Dataset
Datasets & benchmarksHugging Face dataset by Trendyol
Trendyol/Trendyol-Cybersecurity-Instruction-Tuning-Dataset -
active_genie
Datasets & benchmarksThe Lodash for GenAI: Real Value + Consistent + Model-Agnostic
git clone https://github.com/Roriz/active_genie.git -
UHGEval
Datasets & benchmarks[ACL 2024] User-friendly evaluation framework: Eval Suite & Benchmarks: UHGEval, HaluEval, HalluQA, etc.
git clone https://github.com/IAAR-Shanghai/UHGEval.git -
MathVista
Datasets & benchmarksHugging Face dataset by AI4Math
AI4Math/MathVista -
LoopArena
Datasets & benchmarksBenchmarking models as runtime Controllers for Loop Engineering
git clone https://github.com/AMAP-ML/LoopArena.git -
OSCAR-2201
Datasets & benchmarksHugging Face dataset by oscar-corpus
oscar-corpus/OSCAR-2201 -
SGI-Bench
Datasets & benchmarksProbing Scientific General Intelligence of LLMs with Scientist-Aligned Workflows
git clone https://github.com/InternScience/SGI-Bench.git -
arxiv_dataset
Datasets & benchmarksHugging Face dataset by arxiv-community
arxiv-community/arxiv_dataset -
llm-value-rankings
Datasets & benchmarksDaily LLM value rankings - compare 300+ models by intelligence, speed and price. OpenRouter + Artificial Analysis. 大模型性价比排行榜
git clone https://github.com/yyh-001/llm-value-rankings.git -
autoguardrails
Datasets & benchmarksAlignment-research scaffold (autoresearch-style) for LLM guardrails: search over a single policy.md surface
git clone https://github.com/SantanderAI/autoguardrails.git -
tulu-3-sft-mixture
Datasets & benchmarksHugging Face dataset by allenai
allenai/tulu-3-sft-mixture -
Ditto
Datasets & benchmarksA self-ailgnment method for role-play. Benchmark for role-play. Resources for "Large Language Models are Superpositions of All Characters: Attaining Arbitrary Role-play via Self-Alignment".
git clone https://github.com/OFA-Sys/Ditto.git -
geobench
Datasets & benchmarksGeoGuessr benchmark for language models
git clone https://github.com/ccmdi/geobench.git -
sec-code-bench
Datasets & benchmarksSecCodeBench is a benchmark suite focusing on evaluating the security of code generated by large language models (LLMs).
git clone https://github.com/alibaba/sec-code-bench.git -
lora-speedrun
Datasets & benchmarksSpeedrunning LoRA fine-tuning: frozen task, frozen hardware, public wall-clock leaderboard. modded-nanogpt for fine-tuning.
git clone https://github.com/Saivineeth147/lora-speedrun.git -
debate
Datasets & benchmarksAdversarial multi-turn benchmark for LLM debate quality, using side-swapped matchups and multi-model judging to rank models by judged debate performance.
git clone https://github.com/lechmazur/debate.git -
ai-hardware-fit
Datasets & benchmarksCan my GPU run this? Pick a GPU to get 3 fitting AI models, quantization, VRAM, speed ranges, and run commands. 한국어·English.
git clone https://github.com/jaeseok614/ai-hardware-fit.git -
Awesome-AI-Scientist
Datasets & benchmarks🧪 Awesome list of AI Scientist papers, systems, benchmarks, datasets and open-source platforms.
git clone https://github.com/Omni-Scientist/Awesome-AI-Scientist.git -
DecisionPivot
Datasets & benchmarksDecisionPivot: a diagnostic benchmark for decision models in LLM systems. Contrast pairs that differ in one decisive detail, generators with independent solvers, scorer and runners.
git clone https://github.com/StartLuxLabs/DecisionPivot.git -
nagi-bench
Datasets & benchmarksOne-shot LLM eval cases by NAGI STUDIO - same prompt, different agents (model + harness), runnable artifacts side by side.
git clone https://github.com/nagi-studio/nagi-bench.git -
AIRTBench-Code
Datasets & benchmarksCode Repository for: AIRTBench: Measuring Autonomous AI Red Teaming Capabilities in Language Models
git clone https://github.com/dreadnode/AIRTBench-Code.git -
humanities_data_benchmark
Datasets & benchmarksLLM Benchmark Suite for Humanities Data
git clone https://github.com/RISE-UNIBAS/humanities_data_benchmark.git
Indexed entries aren't reviewed or tested by InnerVault. Details come straight from each source. Anything that can reach your accounts, files or browser can do damage, so read the source before you install it.