Build Dataset and Poll Job
A 2-step recipe with Dataiku. We can help you get access.
Recipe · 2 steps
Build Dataset and Poll Job
with Dataiku
Start a dataset build job and poll it to a terminal state.
- Start a build job targeting the dataset as a single output.
- Poll the job status. While the job is NOT_STARTED or RUNNING, loop back and poll again; once it reaches DONE, FAILED, or ABORTED, the workflow branches to completion.
What you'll need to have ready
- apiKey: DSS API key passed as a Bearer token in the Authorization header.
- projectKey: Project key that owns the dataset to build.
- datasetName: Name of the dataset to build (used as the output id).
For your developer
Arazzo workflow dataiku:build-dataset-job, 2 operations: startJob → getJob. Specs on APIs.io.