InnerVault

data-juicer

IndexedGitHub, datajuicer

Data processing for and with foundation models! ๐ŸŽ ๐Ÿ‹ ๐ŸŒฝ โžก๏ธ โžก๏ธ๐Ÿธ ๐Ÿน ๐Ÿท

Open the source (opens github.com) https://github.com/datajuicer/data-juicer

What it is

AI repositories from datajuicer.

The problem it solves and who it suits haven't been reviewed by InnerVault. The description above is the source's own.

How to get it

Get the code

git clone https://github.com/datajuicer/data-juicer.git

Standard git access to a public repository

Setup steps: not provided by the source. Follow the instructions on the source.

Related

  1. docetl

    AI repositories

    A system for agentic LLM-powered data processing and ETL

    Indexed GitHub, ucbepic 4,251 โ˜…MITUpdated yesterday

    git clone https://github.com/ucbepic/docetl.git
  2. DataMate

    AI repositories

    DataMate is an enterprise-level data processing platform designed for model fine-tuning and RAG retrieval.

    Stale GitHub, ModelEngine-Group 374 โ˜…MITUpdated 5 days ago

    git clone https://github.com/ModelEngine-Group/DataMate.git
  3. Curator

    AI repositories

    Scalable data pre processing and curation toolkit for LLMs

    Stale GitHub, NVIDIA-NeMo 1,841 โ˜…Apache-2.0Updated 17 days ago

    git clone https://github.com/NVIDIA-NeMo/Curator.git
  4. pandas-ai

    AI repositories

    Chat with your database or your datalake (SQL, CSV, parquet). PandasAI makes data analysis conversational using LLMs and RAG.

    Stale GitHub, sinaptik-ai 23.9k โ˜…Custom licence (see repository)Updated 12 months ago

    git clone https://github.com/sinaptik-ai/pandas-ai.git
  5. cocoindex

    AI repositories

    Incremental engine for long horizon agents ๐ŸŒŸ Star if you like it!

    Indexed GitHub, cocoindex-io 11.9k โ˜…Apache-2.0Updated 2 days ago

    git clone https://github.com/cocoindex-io/cocoindex.git
  6. df0

    AI repositories

    DF-0: Data processing Framework with Zero-overhead. Local-first C++20 data-processing infrastructure for deterministic, auditable, on-premise workflows. Supports 100+ formats, OCR, local AI, and opt-in cloud AI pipelines

    Indexed GitHub, df0-io 119 โ˜…Custom licence (see repository)Updated yesterday

    git clone https://github.com/df0-io/df0.git