InnerVault

MMLU-CF

Stale GitHub, microsoft

A Contamination-free Multi-task Language Understanding Benchmark [Official, ACL 2025]

Open the source (opens github.com) https://github.com/microsoft/mmlu-cf

What it is

Datasets & benchmarks from microsoft.

The problem it solves and who it suits haven't been reviewed by InnerVault. The description above is the source's own.

How to get it

Get the code

git clone https://github.com/microsoft/MMLU-CF.git

Standard git access to a public repository

Setup steps: not provided by the source. Follow the instructions on the source.

Related

  1. DyCodeEval

    Datasets & benchmarks

    Official repository of the ICML2025 paper “Dynamic Benchmarking of Reasoning Capabilities in Code Large Language Models Under Data Contamination”

    Stale GitHub, SeekingDream 222 ★Updated 10 months ago

    git clone https://github.com/SeekingDream/DyCodeEval.git
  2. MMLU-Pro

    Datasets & benchmarks

    Hugging Face dataset by TIGER-Lab

    Indexed Hugging Face Hub, TIGER-Lab 602 ♥mitUpdated 6 months ago

    TIGER-Lab/MMLU-Pro
  3. Static-to-Dynamic-LLMEval

    Datasets & benchmarks

    The official GitHub repository of the paper "Recent advances in large language model benchmarks against data contamination: From static to dynamic evaluation"

    Stale GitHub, SeekingDream 493 ★Updated 49 days ago

    git clone https://github.com/SeekingDream/Static-to-Dynamic-LLMEval.git
  4. mmlu

    Datasets & benchmarks

    Hugging Face dataset by cais

    Indexed Hugging Face Hub, cais 888 ♥mitUpdated 2 years ago

    cais/mmlu
  5. Global-MMLU

    Datasets & benchmarks

    Hugging Face dataset by CohereLabs

    Stale Hugging Face Hub, CohereLabs 165 ♥apache-2.0Updated 15 months ago

    CohereLabs/Global-MMLU
  6. ollama-benchmark

    Datasets & benchmarks

    LLM Benchmark for Throughput via Ollama (Local LLMs)

    Stale GitHub, aidatatools 397 ★MITUpdated 20 days ago

    git clone https://github.com/aidatatools/ollama-benchmark.git