Observe and Materialize External Asset
A 2-step recipe with Dagster. We can help you get access.
Recipe · 2 steps
Observe and Materialize External Asset
with Dagster
Observe an external asset and then report its materialization with a shared data version.
- Record an observation of the external asset, capturing the current data version and any supplied metadata, partition, and description.
- Record the materialization of the same asset key, reusing the data version from the observation so the two events are correlated.
What you'll need to have ready
- apiToken: Dagster+ user API token sent in the Dagster-Cloud-Api-Token header.
- assetKey: The external asset key being observed and materialized.
- dataVersion: A user-supplied data version shared by both the observation and materialization.
- partition: The asset partition associated with the events.
- observationMetadata: Free-form key/value metadata about the observation.
- observationDescription: A human-readable description of the observation.
- materializationMetadata: Free-form key/value metadata about the materialization.
- materializationDescription: A human-readable description of the materialization.
For your developer
Arazzo workflow dagster:observe-then-materialize-asset, 2 operations: reportAssetObservation → reportAssetMaterialization. Specs on APIs.io.