capabilities.work

Publish Data Set

A 6-step recipe with Amazon Data Exchange. We can help you get access.

Recipe · 6 steps

Publish Data Set

Create a data set, revision, import job, and finalize the revision.

  1. Create a new owned data set that will hold the published revisions.
  2. Open a new, non-finalized revision on the data set to receive assets.
  3. Create an IMPORT_ASSETS_FROM_S3 job that loads the S3 object into the revision as an asset.
  4. Start the import job, transitioning it out of the WAITING state.
  5. Poll the job until it reaches a terminal state. Loops back while the job is still WAITING or IN_PROGRESS, branches to finalize on COMPLETED.
  6. Finalize the revision so it can be published to subscribers. Sets Finalized to true via an update to the revision.
What you'll need to have ready
  • name: The name for the new data set.
  • description: The description for the new data set.
  • assetType: The asset type for the data set and import job.
  • bucket: The S3 bucket holding the asset to import.
  • key: The S3 object key of the asset to import.
  • comment: A comment describing the revision.
For your developer

Arazzo workflow amazon-data-exchange:publish-data-set, 6 operations: CreateDataSet → CreateRevision → CreateJob → StartJob → GetJob → UpdateRevision. Specs on APIs.io.