InnerVault

Library

85,340 resources from 11 public sources. 54 checked by hand; the rest are unreviewed.

Results

  1. opencompass

    Datasets & benchmarks

    OpenCompass is an LLM evaluation platform, supporting a wide range of models from OpenAI, Anthropic, Gemini, Qwen, GLM, DeepSeek, etc, across 100+ datasets covering knowledge, reasoning, coding, science, language, long-context, and safety.

    Indexed GitHub, open-compass 7,596 ★Apache-2.0Updated 5 days ago

    git clone https://github.com/open-compass/opencompass.git
  2. LLM-eval-survey

    Datasets & benchmarks

    The official GitHub page for the survey paper "A Survey on Evaluation of Large Language Models".

    Stale GitHub, MLGroupJLU 1,615 ★Updated 7 days ago

    git clone https://github.com/MLGroupJLU/LLM-eval-survey.git
  3. ClawBench

    Datasets & benchmarks

    Open-source benchmark for browser AI agents on daily tasks.

    Stale GitHub, TIGER-AI-Lab 1,229 ★Apache-2.0Updated 11 days ago

    git clone https://github.com/TIGER-AI-Lab/ClawBench.git
  4. Awesome-LLM-Eval

    Datasets & benchmarks

    Awesome-LLM-Eval: a curated list of tools, datasets/benchmark, demos, leaderboard, papers, docs and models, mainly for Evaluation on LLMs. 一个由工具、基准/数据、演示、排行榜和大模型等组成的精选列表,主要面向基础大模型评测,旨在探求生成式AI的技术边界.

    Stale GitHub, onejune2018 659 ★MITUpdated 11 months ago

    git clone https://github.com/onejune2018/Awesome-LLM-Eval.git
  5. MMLU-Pro

    Datasets & benchmarks

    Hugging Face dataset by TIGER-Lab

    Indexed Hugging Face Hub, TIGER-Lab 602 ♥mitUpdated 6 months ago

    TIGER-Lab/MMLU-Pro
  6. WizardLM_evol_instruct_V2_196k

    Datasets & benchmarks

    Hugging Face dataset by WizardLMTeam

    Indexed Hugging Face Hub, WizardLMTeam 261 ♥mitUpdated 2 years ago

    WizardLMTeam/WizardLM_evol_instruct_V2_196k
  7. Evol-Instruct-Code-80k-v1

    Datasets & benchmarks

    Hugging Face dataset by nickrosh

    Indexed Hugging Face Hub, nickrosh 260 ♥cc-by-nc-sa-4.0Updated 3 years ago

    nickrosh/Evol-Instruct-Code-80k-v1
  8. Static-to-Dynamic-LLMEval

    Datasets & benchmarks

    The official GitHub repository of the paper "Recent advances in large language model benchmarks against data contamination: From static to dynamic evaluation"

    Stale GitHub, SeekingDream 493 ★Updated 49 days ago

    git clone https://github.com/SeekingDream/Static-to-Dynamic-LLMEval.git
  9. ClawProBench

    Datasets & benchmarks

    ClawProBench is a live-first benchmark harness for evaluating LLM agents in the OpenClaw runtime with deterministic grading and repeated-trial reliability.

    Stale GitHub, suyoumo 825 ★Apache-2.0Updated 2 months ago

    git clone https://github.com/suyoumo/ClawProBench.git
  10. WizardLM_evol_instruct_70k

    Datasets & benchmarks

    Hugging Face dataset by WizardLMTeam

    Stale Hugging Face Hub, WizardLMTeam 205 ♥mitUpdated 2 years ago

    WizardLMTeam/WizardLM_evol_instruct_70k
  11. gsm8k

    Datasets & benchmarks

    Hugging Face dataset by openai

    Indexed Hugging Face Hub, openai 2,046 ♥mitUpdated 7 months ago

    openai/gsm8k
  12. One-Eval

    Datasets & benchmarks

    Automated system for LLM evaluation via agents. Doc as below:

    Stale GitHub, OpenDCAI 165 ★Apache-2.0Updated 2 months ago

    git clone https://github.com/OpenDCAI/One-Eval.git
  13. Magicoder-Evol-Instruct-110K

    Datasets & benchmarks

    Hugging Face dataset by ise-uiuc

    Stale Hugging Face Hub, ise-uiuc 193 ♥apache-2.0Updated 2 years ago

    ise-uiuc/Magicoder-Evol-Instruct-110K
  14. TrustLLM

    Datasets & benchmarks

    [ICML 2024] TrustLLM: LLM trustworthiness evaluation across truthfulness, safety, fairness, robustness, privacy and ethics. Python/CLI toolkit for local models, compatible APIs and AI agent orchestration.

    Stale GitHub, HowieHwong 632 ★MITUpdated 43 days ago

    git clone https://github.com/HowieHwong/TrustLLM.git
  15. evol-codealpaca-v1

    Datasets & benchmarks

    Hugging Face dataset by theblackcat102

    Stale Hugging Face Hub, theblackcat102 187 ♥apache-2.0Updated 2 years ago

    theblackcat102/evol-codealpaca-v1
  16. xFinder

    Datasets & benchmarks

    [ICLR 2025] xFinder: Large Language Models as Automated Evaluators for Reliable Evaluation

    Stale GitHub, IAAR-Shanghai 178 ★Custom licence (see repository)Updated 12 months ago

    git clone https://github.com/IAAR-Shanghai/xFinder.git
  17. typed-decisions

    Datasets & benchmarks

    Hugging Face dataset by LocalLLaMA

    Indexed Hugging Face Hub, LocalLLaMA 277 ♥apache-2.0Updated today

    LocalLLaMA/typed-decisions
  18. Hugging Face dataset by QuixiAI

    Stale Hugging Face Hub, QuixiAI 147 ♥Updated 3 years ago

    QuixiAI/WizardLM_alpaca_evol_instruct_70k_unfiltered
  19. agents-last-exam

    Datasets & benchmarks

    Hugging Face dataset by agents-last-exam

    Stale Hugging Face Hub, agents-last-exam 225 ♥cc-by-4.0Updated 33 days ago

    agents-last-exam/agents-last-exam
  20. everyday-conversations-llama3.1-2k

    Datasets & benchmarks

    Hugging Face dataset by HuggingFaceTB

    Stale Hugging Face Hub, HuggingFaceTB 140 ♥apache-2.0Updated 21 months ago

    HuggingFaceTB/everyday-conversations-llama3.1-2k
  21. FastEval

    Datasets & benchmarks

    Fast & more realistic evaluation of chat language models. Includes leaderboard.

    Stale GitHub, FastEval 187 ★Apache-2.0Updated 2 years ago

    git clone https://github.com/FastEval/FastEval.git
  22. UHGEval

    Datasets & benchmarks

    [ACL 2024] User-friendly evaluation framework: Eval Suite & Benchmarks: UHGEval, HaluEval, HalluQA, etc.

    Stale GitHub, IAAR-Shanghai 183 ★Apache-2.0Updated 17 months ago

    git clone https://github.com/IAAR-Shanghai/UHGEval.git
  23. olmOCR-bench

    Datasets & benchmarks

    Hugging Face dataset by allenai

    Indexed Hugging Face Hub, allenai 326 ♥odc-byUpdated 9 months ago

    allenai/olmOCR-bench
  24. Awesome-LLM-Long-Context-Modeling

    Datasets & benchmarks

    📰 Must-read papers and blogs on LLM based Long Context Modeling 🔥

    Indexed GitHub, Xnhyacinth 2,192 ★MITUpdated 3 days ago

    git clone https://github.com/Xnhyacinth/Awesome-LLM-Long-Context-Modeling.git

Indexed entries aren't reviewed or tested by InnerVault. Details come straight from each source. Anything that can reach your accounts, files or browser can do damage, so read the source before you install it.