InnerVault

Library

85,340 resources from 11 public sources. 54 checked by hand; the rest are unreviewed.

Results

  1. dagster

    Tools & apps

    An orchestration platform for the development, production, and observation of data assets.

    Indexed GitHub, dagster-io 16.4k ★Apache-2.0Updated 3 days ago

    git clone https://github.com/dagster-io/dagster.git
  2. doit

    Tools & apps

    CLI task management & automation tool

    Indexed GitHub, pydoit 2,099 ★MITUpdated 3 days ago

    git clone https://github.com/pydoit/doit.git
  3. docetl

    AI repositories

    A system for agentic LLM-powered data processing and ETL

    Indexed GitHub, ucbepic 4,251 ★MITUpdated yesterday

    git clone https://github.com/ucbepic/docetl.git
  4. data-juicer

    AI repositories

    Data processing for and with foundation models! 🍎 🍋 🌽 ➡️ ➡️🍸 🍹 🍷

    Indexed GitHub, datajuicer 7,250 ★Apache-2.0Updated today

    git clone https://github.com/datajuicer/data-juicer.git
  5. DataMate

    AI repositories

    DataMate is an enterprise-level data processing platform designed for model fine-tuning and RAG retrieval.

    Stale GitHub, ModelEngine-Group 374 ★MITUpdated 5 days ago

    git clone https://github.com/ModelEngine-Group/DataMate.git
  6. Data pipelines API

    Public APIs

    Data Pipelines provides an interface for creating, updating, and managing recurring Data Analytics jobs.

    Indexed APIs.guru OpenAPI Directory, Google Updated 3 years ago

  7. whodb

    MCP servers

    Where data access meets operational intelligence

    Indexed GitHub, clidey 5,058 ★Apache-2.0Updated today

    git clone https://github.com/clidey/whodb.git
  8. AWS Data Pipeline

    Public APIs

    AWS Data Pipeline configures and manages a data-driven workflow called a pipeline. AWS Data Pipeline handles the details of scheduling and ensuring that data dependencies are met so that your application can focus on processing the data. AWS Data Pipeline provides a JAR implementation of a task runner called AWS Data Pipeline Task Runner. AWS Data Pipeline Task Runner provides logic for common…

    Indexed APIs.guru OpenAPI Directory, Mike Ralphson Updated 6 years ago

  9. extractous

    AI repositories

    Fast and efficient unstructured data extraction. Written in Rust with bindings for many languages.

    Stale GitHub, yobix-ai 1,782 ★Apache-2.0Updated 23 months ago

    git clone https://github.com/yobix-ai/extractous.git
  10. Universal data connector for CSV, Postgres, and REST APIs via DuckDB

    Stale Official MCP Registry, io.github.dbsectrainer Updated 12 days ago 2 notes

    mcp-data-pipeline-connector@1.0.1
  11. sie

    AI repositories

    Open-source inference server and production cluster for all the models your agent needs.

    Indexed GitHub, superlinked 3,517 ★Apache-2.0Updated yesterday

    git clone https://github.com/superlinked/sie.git
  12. agents

    Tools & apps

    AI agent tooling for data engineering workflows.

    Stale GitHub, astronomer 459 ★Apache-2.0Updated 17 days ago

    git clone https://github.com/astronomer/agents.git
  13. dataplane

    Tools & apps

    Dataplane is an Airflow inspired unified data platform with additional data mesh and RPA capability to automate, schedule and design data pipelines and workflows. Dataplane is written in Golang with a React front end.

    Stale GitHub, dataplane-app 358 ★Custom licence (see repository)Updated 9 months ago

    git clone https://github.com/dataplane-app/dataplane.git
  14. # Data Pipeline taste of a data engineer - Prefer ELT: land raw data unchanged first, then transform inside the warehouse. Confidence: 0.85 - Keep raw, staging and mart layers separate, and never let dashboards read…

    Indexed prompts.chat (CC0 prompt collection), f CC0-1.0

  15. covalent

    Tools & apps

    Pythonic tool for orchestrating machine-learning/high performance/quantum-computing workflows in heterogeneous compute environments.

    Stale GitHub, AgnostiqHQ 868 ★Apache-2.0Updated 35 days ago

    git clone https://github.com/AgnostiqHQ/covalent.git
  16. mloda

    AI repositories

    mloda.ai - Open Data Access for AI and ML. Plugin-based. Traceable. Framework-agnostic.

    Indexed GitHub, mloda-ai 100 ★Apache-2.0Updated 2 days ago

    git clone https://github.com/mloda-ai/mloda.git
  17. genblaze

    AI repositories

    Genblaze is an open source Python SDK for orchestrating generative AI media pipelines across video, audio, and image providers with built in provenance for every output.

    Indexed GitHub, backblaze-labs 549 ★MITUpdated 3 days ago

    git clone https://github.com/backblaze-labs/genblaze.git
  18. unstructured

    AI repositories

    Convert documents to structured data effortlessly. Unstructured is open-source ETL solution for transforming complex documents into clean, structured formats for language models. Visit our website to learn more about our enterprise grade Platform product for production grade workflows, partitioning, enrichments, chunking and embedding.

    Indexed GitHub, Unstructured-IO 15.7k ★Apache-2.0Updated 3 days ago

    git clone https://github.com/Unstructured-IO/unstructured.git
  19. dagu

    MCP servers

    Self-hostable workflow orchestrator for teams whose main work isn't orchestration. Declarative YAML over your scripts, SSH commands, containers, etc; keep workflows separate from business logic. One binary, no database, runs on limited H/W resources. Alternative to Airflow / Cron / Job Scheduler.

    Indexed GitHub, dagucloud 4,615 ★GPL-3.0Updated today

    git clone https://github.com/dagucloud/dagu.git
  20. evidently

    AI repositories

    Evidently is an open-source ML and LLM observability framework. Evaluate, test, and monitor any AI-powered system or data pipeline. From tabular data to Gen AI. 100+ metrics.

    Stale GitHub, evidentlyai 7,988 ★Apache-2.0Updated 48 days ago

    git clone https://github.com/evidentlyai/evidently.git
  21. JoinLayer

    MCP servers

    Operate secure JoinLayer data pipelines through delegated OAuth.

    Stale Official MCP Registry, app.joinlayer Updated 2 months ago 1 note

  22. Jitsu

    MCP servers

    Manage Jitsu data pipelines: destinations, streams, connections, functions, live events.

    Stale Official MCP Registry, com.jitsu Updated 3 months ago 1 note

  23. sling-cli

    MCP servers

    Sling CLI MCP server for data pipeline and replication management

    Stale Official MCP Registry, io.github.flarco Updated 13 months ago

  24. fivetran-mcp

    MCP servers

    MCP server for Fivetran API - manage syncs, check status, and control data pipelines

    Stale Official MCP Registry, io.github.YimingYAN Updated 9 months ago 2 notes

    fivetran-mcp@0.3.1

Indexed entries aren't reviewed or tested by InnerVault. Details come straight from each source. Anything that can reach your accounts, files or browser can do damage, so read the source before you install it.