InnerVault

Data Lineage Agent Skill

Indexedprompts.chat (CC0 prompt collection), ajillell_uhg

--- name: data-lineage-agent description: A skill for creating an agent to analyze data lineage and linkage across database scripts and stored procedures. --- # Data Lineage Agent Skill ## Purpose This skill assists in…

Open the source (opens github.com) https://github.com/f/prompts.chat

What it is

Prompts from ajillell_uhg.

The problem it solves and who it suits haven't been reviewed by InnerVault. The description above is the source's own.

The prompt

Fill in before using: ${repositoryUrl} ${platforms}

---
name: data-lineage-agent
description: A skill for creating an agent to analyze data lineage and linkage across database scripts and stored procedures.
---

# Data Lineage Agent Skill

## Purpose
This skill assists in creating an agent that can analyze and report on the data lineage and linkage within a database system. It is ideal for understanding how changes to tables can affect the overall system and helps in uncovering the dependencies across different platforms.

## Steps to Create the Agent
1. **Access the Repository:**
   - Link to the GitHub repository: [GitHub Repo](https://github.com/optuminsight-payer/COB-PARS_DB_SCRIPTS)
   - Clone the repository to access all database scripts and stored procedures.

2. **Analyze Data Lineage:**
   - Use tools to parse SQL scripts to identify table relationships and dependencies.
   - Map out the data flow from source tables to final tables.

3. **Identify Changes Impact:**
   - Implement logic to trace changes in intermediate tables to see which final tables are affected.
   - Use graph databases or lineage analysis tools for better visualization and impact assessment.

4. **Host the Agent:**
   - Choose a hosting platform (e.g., AWS, Azure) to deploy the agent for continuous analysis and reporting.

## Use Cases
- **Impact Analysis:** Determine the impact of changes in any table across the system.
- **Data Flow Mapping:** Visualize how data moves through the system from source to final tables.
- **Dependency Reporting:** Generate reports on table dependencies and affected platforms.

## Additional Features
- **Automated Alerts:** Notify users when potential impacts are detected.
- **Version Control Integration:** Link changes to specific commits in the repository for traceability.

## Example Variables
- `${repositoryUrl}`: The URL of the GitHub repository.
- `${platforms}`: List of platforms involved in the data flow.

This skill provides a structured approach to building an agent capable of comprehensive data lineage analysis, which can be crucial for database management and optimization tasks.

Written by the prompts.chat (CC0 prompt collection) community (ajillell_uhg). Not tested by InnerVault.

How to get it

Setup steps: not applicable.

Related

  1. Hyper-realistic 3D isometric masterpiece, set against a magnificent, endless traditional ink-wash historical parchment scroll unfurling across the background. The scene visualizes the historical lineage and cultural…

    Indexed prompts.chat (CC0 prompt collection), inanusame26@gmail.com CC0-1.0

  2. Give me a prompt to use in creating an interactive data analysis dashboard

    Indexed prompts.chat (CC0 prompt collection), sammyduwa2@gmail.com CC0-1.0

  3. # Data Validator You are a senior data integrity expert and specialist in input validation, data sanitization, security-focused validation, multi-layer validation architecture, and data corruption prevention across…

    Indexed prompts.chat (CC0 prompt collection), wkaandemir CC0-1.0

  4. --- name: csv-data-quality-profiler description: Profiles CSV and spreadsheet exports before they are trusted for analysis, imports, or dashboards - infers column types, measures missing values, duplicates, mixed…

    Indexed prompts.chat (CC0 prompt collection), f CC0-1.0

  5. # Mock Data Generator You are a senior test data engineering expert and specialist in realistic synthetic data generation using Faker.js, custom generation patterns, test fixtures, database seeds, API mock responses…

    Indexed prompts.chat (CC0 prompt collection), wkaandemir CC0-1.0

  6. I want you to act as a scientific data visualizer. You will apply your knowledge of data science principles and visualization techniques to create compelling visuals that help convey complex information, develop…

    Indexed prompts.chat (CC0 prompt collection), devisasari CC0-1.0