SWE-bench_Verified
Hugging Face dataset by SWE-bench
Open the source (opens huggingface.co) https://huggingface.co/datasets/swe-bench/swe-bench_verified
What it is
Datasets & benchmarks from SWE-bench.
The problem it solves and who it suits haven't been reviewed by InnerVault. The description above is the source's own.
How to get it
Load from the Hugging Face Hub
SWE-bench/SWE-bench_Verified
The repository id on the Hugging Face Hub
Setup steps: not provided by the source. Follow the instructions on the source.
Related
-
olmOCR-bench
Datasets & benchmarksHugging Face dataset by allenai
allenai/olmOCR-bench -
SWE-bench_Pro
Datasets & benchmarksHugging Face dataset by ScaleAI
ScaleAI/SWE-bench_Pro -
MMLU-Pro
Datasets & benchmarksHugging Face dataset by TIGER-Lab
TIGER-Lab/MMLU-Pro -
gsm8k
Datasets & benchmarksHugging Face dataset by openai
openai/gsm8k -
gpqa
Datasets & benchmarksHugging Face dataset by Idavidrein
Idavidrein/gpqa -
agents-last-exam
Datasets & benchmarksHugging Face dataset by agents-last-exam
agents-last-exam/agents-last-exam