Library
85,762 resources from 11 public sources. 53 checked by hand; the rest are unreviewed.
Results
-
starcoderdata
Datasets & benchmarksHugging Face dataset by bigcode
bigcode/starcoderdata -
Granary
Datasets & benchmarksHugging Face dataset by nvidia
nvidia/Granary -
the-stack
Datasets & benchmarksHugging Face dataset by bigcode
bigcode/the-stack -
omnilingual-asr-corpus
Datasets & benchmarksHugging Face dataset by facebook
facebook/omnilingual-asr-corpus -
DishwasherBench
Datasets & benchmarksA dishwasher-loading game on a physical simulation of one real machine, built to benchmark language models and playable in a browser. The game inside is called Spotless.
git clone https://github.com/composo-ai/DishwasherBench.git -
SYNTH
Datasets & benchmarksHugging Face dataset by PleIAs
PleIAs/SYNTH -
fineweb
Datasets & benchmarksHugging Face dataset by HuggingFaceFW
HuggingFaceFW/fineweb -
Global-MMLU
Datasets & benchmarksHugging Face dataset by CohereLabs
CohereLabs/Global-MMLU -
GuanacoDataset
Datasets & benchmarksHugging Face dataset by JosephusCheung
JosephusCheung/GuanacoDataset -
ShareGPT52K
Datasets & benchmarksHugging Face dataset by RyokoAI
RyokoAI/ShareGPT52K -
product-database
Datasets & benchmarksHugging Face dataset by openfoodfacts
openfoodfacts/product-database -
Awesome-Datasets-Hub
Datasets & benchmarksA curated collection of datasets for Large Language Models (LLMs), covering medical AI, NLP, multimodal learning, instruction tuning, reasoning, code generation, and evaluation benchmarks.
git clone https://github.com/ahammadmejbah/Awesome-Datasets-Hub.git -
voxpopuli
Datasets & benchmarksHugging Face dataset by facebook
facebook/voxpopuli -
flores_plus
Datasets & benchmarksHugging Face dataset by openlanguagedata
openlanguagedata/flores_plus -
xlsum
Datasets & benchmarksHugging Face dataset by csebuetnlp
csebuetnlp/xlsum -
squad
Datasets & benchmarksHugging Face dataset by rajpurkar
rajpurkar/squad -
smol
Datasets & benchmarksHugging Face dataset by google
google/smol -
common_voice
Datasets & benchmarksHugging Face dataset by legacy-datasets
legacy-datasets/common_voice -
gsm8k
Datasets & benchmarksHugging Face dataset by openai
openai/gsm8k -
belebele
Datasets & benchmarksHugging Face dataset by facebook
facebook/belebele -
deepmark
Datasets & benchmarksDeepmark AI enables a unique testing environment for language models (LLM) assessment on task-specific metrics and on your own data so your GenAI-powered solution has predictable and reliable performance.
git clone https://github.com/IngestAI/deepmark.git -
ShareGPT_Vicuna_unfiltered
Datasets & benchmarksHugging Face dataset by anon8231489123
anon8231489123/ShareGPT_Vicuna_unfiltered -
multilingual_librispeech
Datasets & benchmarksHugging Face dataset by facebook
facebook/multilingual_librispeech -
Vaani
Datasets & benchmarksHugging Face dataset by ARTPARK-IISc
ARTPARK-IISc/Vaani
Indexed entries aren't reviewed or tested by InnerVault. Details come straight from each source. Anything that can reach your accounts, files or browser can do damage, so read the source before you install it.