Library
85,762 resources from 11 public sources. 53 checked by hand; the rest are unreviewed.
Results
-
dagster
Tools & appsAn orchestration platform for the development, production, and observation of data assets.
git clone https://github.com/dagster-io/dagster.git -
doit
Tools & appsCLI task management & automation tool
git clone https://github.com/pydoit/doit.git -
docetl
AI repositoriesA system for agentic LLM-powered data processing and ETL
git clone https://github.com/ucbepic/docetl.git -
data-juicer
AI repositoriesData processing for and with foundation models! 🍎 🍋 🌽 ➡️ ➡️🍸 🍹 🍷
git clone https://github.com/datajuicer/data-juicer.git -
DataMate
AI repositoriesDataMate is an enterprise-level data processing platform designed for model fine-tuning and RAG retrieval.
git clone https://github.com/ModelEngine-Group/DataMate.git -
Data pipelines API
Public APIsData Pipelines provides an interface for creating, updating, and managing recurring Data Analytics jobs.
-
whodb
MCP serversWhere data access meets operational intelligence
git clone https://github.com/clidey/whodb.git -
AWS Data Pipeline
Public APIsAWS Data Pipeline configures and manages a data-driven workflow called a pipeline. AWS Data Pipeline handles the details of scheduling and ensuring that data dependencies are met so that your application can focus on processing the data. AWS Data Pipeline provides a JAR implementation of a task runner called AWS Data Pipeline Task Runner. AWS Data Pipeline Task Runner provides logic for common…
-
extractous
AI repositoriesFast and efficient unstructured data extraction. Written in Rust with bindings for many languages.
git clone https://github.com/yobix-ai/extractous.git -
mcp-data-pipeline-connector
MCP serversUniversal data connector for CSV, Postgres, and REST APIs via DuckDB
mcp-data-pipeline-connector@1.0.1 -
sie
AI repositoriesOpen-source inference server and production cluster for all the models your agent needs.
git clone https://github.com/superlinked/sie.git -
agents
Tools & appsAI agent tooling for data engineering workflows.
git clone https://github.com/astronomer/agents.git -
dataplane
Tools & appsDataplane is an Airflow inspired unified data platform with additional data mesh and RPA capability to automate, schedule and design data pipelines and workflows. Dataplane is written in Golang with a React front end.
git clone https://github.com/dataplane-app/dataplane.git -
Data Pipeline taste
Prompts# Data Pipeline taste of a data engineer - Prefer ELT: land raw data unchanged first, then transform inside the warehouse. Confidence: 0.85 - Keep raw, staging and mart layers separate, and never let dashboards read…
-
covalent
Tools & appsPythonic tool for orchestrating machine-learning/high performance/quantum-computing workflows in heterogeneous compute environments.
git clone https://github.com/AgnostiqHQ/covalent.git -
mloda
AI repositoriesmloda.ai - Open Data Access for AI and ML. Plugin-based. Traceable. Framework-agnostic.
git clone https://github.com/mloda-ai/mloda.git -
genblaze
AI repositoriesGenblaze is an open source Python SDK for orchestrating generative AI media pipelines across video, audio, and image providers with built in provenance for every output.
git clone https://github.com/backblaze-labs/genblaze.git -
unstructured
AI repositoriesConvert documents to structured data effortlessly. Unstructured is open-source ETL solution for transforming complex documents into clean, structured formats for language models. Visit our website to learn more about our enterprise grade Platform product for production grade workflows, partitioning, enrichments, chunking and embedding.
git clone https://github.com/Unstructured-IO/unstructured.git -
dagu
MCP serversSelf-hostable workflow orchestrator for teams whose main work isn't orchestration. Declarative YAML over your scripts, SSH commands, containers, etc; keep workflows separate from business logic. One binary, no database, runs on limited H/W resources. Alternative to Airflow / Cron / Job Scheduler.
git clone https://github.com/dagucloud/dagu.git -
evidently
AI repositoriesEvidently is an open-source ML and LLM observability framework. Evaluate, test, and monitor any AI-powered system or data pipeline. From tabular data to Gen AI. 100+ metrics.
git clone https://github.com/evidentlyai/evidently.git -
JoinLayer
MCP serversOperate secure JoinLayer data pipelines through delegated OAuth.
-
Jitsu
MCP serversManage Jitsu data pipelines: destinations, streams, connections, functions, live events.
-
sling-cli
MCP serversSling CLI MCP server for data pipeline and replication management
-
fivetran-mcp
MCP serversMCP server for Fivetran API - manage syncs, check status, and control data pipelines
fivetran-mcp@0.3.1
Indexed entries aren't reviewed or tested by InnerVault. Details come straight from each source. Anything that can reach your accounts, files or browser can do damage, so read the source before you install it.