data-juicer
Data processing for and with foundation models! ๐ ๐ ๐ฝ โก๏ธ โก๏ธ๐ธ ๐น ๐ท
Open the source (opens github.com) https://github.com/datajuicer/data-juicer
What it is
AI repositories from datajuicer.
The problem it solves and who it suits haven't been reviewed by InnerVault. The description above is the source's own.
How to get it
Get the code
git clone https://github.com/datajuicer/data-juicer.git
Standard git access to a public repository
Setup steps: not provided by the source. Follow the instructions on the source.
Related
-
docetl
AI repositoriesA system for agentic LLM-powered data processing and ETL
git clone https://github.com/ucbepic/docetl.git -
DataMate
AI repositoriesDataMate is an enterprise-level data processing platform designed for model fine-tuning and RAG retrieval.
git clone https://github.com/ModelEngine-Group/DataMate.git -
Curator
AI repositoriesScalable data pre processing and curation toolkit for LLMs
git clone https://github.com/NVIDIA-NeMo/Curator.git -
pandas-ai
AI repositoriesChat with your database or your datalake (SQL, CSV, parquet). PandasAI makes data analysis conversational using LLMs and RAG.
git clone https://github.com/sinaptik-ai/pandas-ai.git -
cocoindex
AI repositoriesIncremental engine for long horizon agents ๐ Star if you like it!
git clone https://github.com/cocoindex-io/cocoindex.git -
df0
AI repositoriesDF-0: Data processing Framework with Zero-overhead. Local-first C++20 data-processing infrastructure for deterministic, auditable, on-premise workflows. Supports 100+ formats, OCR, local AI, and opt-in cloud AI pipelines
git clone https://github.com/df0-io/df0.git