Data lineage records how data flows from sources through transformations to reports, models and applications.
Why It Matters
- Debugging: trace a wrong number back to its source.
- Impact analysis: see what breaks if a source changes.
- Compliance: show where personal data flows.
- Trust: users understand how figures are produced.
- AI governance: know which data trained or feeds each model.
Levels
- Table-level: which tables feed which.
- Column-level: which columns derive from which.
Capturing Lineage
- Parse SQL and transformation code.
- Tools such as dbt generate lineage graphs automatically.
- Orchestrators and open standards like OpenLineage emit lineage events.
- Data catalogues visualise it.
Keep It Accurate
Automated capture beats manual documentation, which quickly goes out of date.
Use It
Integrate lineage into change reviews, incident response and data catalogues.