Upsert Dataset and Verify
A 2-step recipe with DataHub. We can help you get access.
Recipe · 2 steps
Upsert Dataset and Verify
with DataHub · Information & Data Management
Create or update a dataset's datasetProperties aspect and read it back.
- Upsert the datasetProperties aspect for the supplied dataset URN into the DataHub metadata graph.
- Retrieve the latest aspects for the dataset URN that was just written to confirm the entity exists in the metadata graph.
What you'll need to have ready
- token: DataHub personal access token passed as a Bearer token.
- entityUrn: The dataset URN to upsert (e.g. urn:li:dataset:(urn:li:dataPlatform:hive,SampleHiveDataset,PROD)).
- datasetProperties: The datasetProperties aspect value to write for the dataset.
- createEntityIfNotExists: When true, only create the entity if it does not already exist.
For your developer
Arazzo workflow datahub:upsert-dataset, 2 operations: upsertEntities → getEntityLatestAspects. Specs on APIs.io.