SWE-bench_Pro
Hugging Face dataset by ScaleAI
Open the source (opens huggingface.co) https://huggingface.co/datasets/scaleai/swe-bench_pro
What it is
Datasets & benchmarks from ScaleAI.
The problem it solves and who it suits haven't been reviewed by InnerVault. The description above is the source's own.
How to get it
Load from the Hugging Face Hub
ScaleAI/SWE-bench_Pro
The repository id on the Hugging Face Hub
Setup steps: not provided by the source. Follow the instructions on the source.
Related
-
olmOCR-bench
Datasets & benchmarksHugging Face dataset by allenai
allenai/olmOCR-bench -
SWE-bench_Verified
Datasets & benchmarksHugging Face dataset by SWE-bench
SWE-bench/SWE-bench_Verified -
MMLU-Pro
Datasets & benchmarksHugging Face dataset by TIGER-Lab
TIGER-Lab/MMLU-Pro -
gsm8k
Datasets & benchmarksHugging Face dataset by openai
openai/gsm8k -
gpqa
Datasets & benchmarksHugging Face dataset by Idavidrein
Idavidrein/gpqa -
agents-last-exam
Datasets & benchmarksHugging Face dataset by agents-last-exam
agents-last-exam/agents-last-exam