Trace Dataset Lineage
A 3-step recipe with DataHub. We can help you get access.
Recipe · 3 steps
Trace Dataset Lineage
with DataHub · Information & Data Management
Walk downstream lineage from a dataset and hydrate the related entities.
- Retrieve the latest aspects for the dataset URN to confirm the entity exists before walking its lineage.
- Query the relationship graph for DownstreamOf edges from the dataset URN to discover datasets that depend on it.
- Batch fetch the latest aspects for the first downstream dataset discovered to enrich the lineage view.
What you'll need to have ready
- token: DataHub personal access token passed as a Bearer token.
- entityUrn: The dataset URN to trace lineage from.
- direction: Traversal direction relative to the entity (INCOMING or OUTGOING).
For your developer
Arazzo workflow datahub:trace-lineage, 3 operations: getEntityLatestAspects → getRelationships → batchGetEntities. Specs on APIs.io.