llm-datasets
Curated list of datasets and tools for post-training.
Open the source (opens github.com) https://github.com/mlabonne/llm-datasets
What it is
AI repositories from mlabonne.
The problem it solves and who it suits haven't been reviewed by InnerVault. The description above is the source's own.
How to get it
Get the code
git clone https://github.com/mlabonne/llm-datasets.git
Standard git access to a public repository
Setup steps: not provided by the source. Follow the instructions on the source.
Related
-
csghub
AI repositoriesCSGHub is a brand-new open-source platform for managing LLMs, developed by the OpenCSG team. It offers both open-source and on-premise/SaaS solutions, with features comparable to Hugging Face. Gain full control over the lifecycle of LLMs, datasets, and agents, with Python SDK compatibility with Hugging Face. Join us! ⭐️
git clone https://github.com/OpenCSGs/csghub.git -
datasets
AI repositories🤗 The largest hub of ready-to-use datasets for AI models with fast, easy-to-use and efficient data manipulation tools
git clone https://github.com/huggingface/datasets.git -
curator
AI repositoriesSynthetic data curation for post-training and structured data extraction
git clone https://github.com/bespokelabsai/curator.git -
EnterpriseRAG-Bench
AI repositoriesDataset and benchmark for RAG on company internal documents.
git clone https://github.com/onyx-dot-app/EnterpriseRAG-Bench.git -
easy-dataset
AI repositoriesA powerful tool for creating datasets for LLM fine-tuning 、RAG and Eval
git clone https://github.com/ConardLi/easy-dataset.git -
Jackrong-llm-finetuning-guide
AI repositoriesgit clone https://github.com/R6410418/Jackrong-llm-finetuning-guide.git