InnerVault

SWE-bench_Pro

Stale Hugging Face Hub, ScaleAI

Hugging Face dataset by ScaleAI

Open the source (opens huggingface.co) https://huggingface.co/datasets/scaleai/swe-bench_pro

What it is

Datasets & benchmarks from ScaleAI.

The problem it solves and who it suits haven't been reviewed by InnerVault. The description above is the source's own.

How to get it

Load from the Hugging Face Hub

ScaleAI/SWE-bench_Pro

The repository id on the Hugging Face Hub

Setup steps: not provided by the source. Follow the instructions on the source.

Related

  1. olmOCR-bench

    Datasets & benchmarks

    Hugging Face dataset by allenai

    Indexed Hugging Face Hub, allenai 326 ♥odc-byUpdated 9 months ago

    allenai/olmOCR-bench
  2. SWE-bench_Verified

    Datasets & benchmarks

    Hugging Face dataset by SWE-bench

    Stale Hugging Face Hub, SWE-bench 188 ♥Updated 3 months ago

    SWE-bench/SWE-bench_Verified
  3. MMLU-Pro

    Datasets & benchmarks

    Hugging Face dataset by TIGER-Lab

    Indexed Hugging Face Hub, TIGER-Lab 602 ♥mitUpdated 6 months ago

    TIGER-Lab/MMLU-Pro
  4. gsm8k

    Datasets & benchmarks

    Hugging Face dataset by openai

    Indexed Hugging Face Hub, openai 2,046 ♥mitUpdated 7 months ago

    openai/gsm8k
  5. gpqa

    Datasets & benchmarks

    Hugging Face dataset by Idavidrein

    Indexed Hugging Face Hub, Idavidrein 642 ♥cc-by-4.0Updated 56 days ago 1 note

    Idavidrein/gpqa
  6. agents-last-exam

    Datasets & benchmarks

    Hugging Face dataset by agents-last-exam

    Stale Hugging Face Hub, agents-last-exam 225 ♥cc-by-4.0Updated 33 days ago

    agents-last-exam/agents-last-exam