Library
85,762 resources from 11 public sources. 53 checked by hand; the rest are unreviewed.
Results
-
belebele
Datasets & benchmarksHugging Face dataset by facebook
facebook/belebele -
fleurs
Datasets & benchmarksHugging Face dataset by google
google/fleurs -
aya_collection
Datasets & benchmarksHugging Face dataset by CohereLabs
CohereLabs/aya_collection -
train_1M_CN
Datasets & benchmarksHugging Face dataset by BelleGroup
BelleGroup/train_1M_CN -
train_3.5M_CN
Datasets & benchmarksHugging Face dataset by BelleGroup
BelleGroup/train_3.5M_CN -
multiturn_chat_0.8M
Datasets & benchmarksHugging Face dataset by BelleGroup
BelleGroup/multiturn_chat_0.8M -
One-Eval
Datasets & benchmarksAutomated system for LLM evaluation via agents. Doc as below:
git clone https://github.com/OpenDCAI/One-Eval.git -
oasst1
Datasets & benchmarksHugging Face dataset by OpenAssistant
OpenAssistant/oasst1 -
wikipedia
Datasets & benchmarksHugging Face dataset by wikimedia
wikimedia/wikipedia -
finepdfs
Datasets & benchmarksHugging Face dataset by HuggingFaceFW
HuggingFaceFW/finepdfs -
fineweb-2
Datasets & benchmarksHugging Face dataset by HuggingFaceFW
HuggingFaceFW/fineweb-2 -
CulturaX
Datasets & benchmarksHugging Face dataset by uonlp
uonlp/CulturaX -
c4
Datasets & benchmarksHugging Face dataset by allenai
allenai/c4 -
wikipedia
Datasets & benchmarksHugging Face dataset by legacy-datasets
legacy-datasets/wikipedia -
MMMLU
Datasets & benchmarksHugging Face dataset by openai
openai/MMMLU -
Alpaca-CoT
Datasets & benchmarksHugging Face dataset by QingyiSi
QingyiSi/Alpaca-CoT -
common_corpus
Datasets & benchmarksHugging Face dataset by PleIAs
PleIAs/common_corpus -
aya_dataset
Datasets & benchmarksHugging Face dataset by CohereLabs
CohereLabs/aya_dataset -
oasst2
Datasets & benchmarksHugging Face dataset by OpenAssistant
OpenAssistant/oasst2 -
finetranslations
Datasets & benchmarksHugging Face dataset by HuggingFaceFW
HuggingFaceFW/finetranslations -
YouTube-Commons
Datasets & benchmarksHugging Face dataset by PleIAs
PleIAs/YouTube-Commons -
RedPajama-Data-V2
Datasets & benchmarksHugging Face dataset by togethercomputer
togethercomputer/RedPajama-Data-V2 -
the-stack-v2
Datasets & benchmarksHugging Face dataset by bigcode
bigcode/the-stack-v2 -
WaxalNLP
Datasets & benchmarksHugging Face dataset by google
google/WaxalNLP
Indexed entries aren't reviewed or tested by InnerVault. Details come straight from each source. Anything that can reach your accounts, files or browser can do damage, so read the source before you install it.