Submit a One-time Run and Wait
A 3-step recipe with Azure Databricks. We can help you get access.
Recipe · 3 steps
Submit a One-time Run and Wait
with Azure Databricks
Submit a one-time notebook run and wait for it to finish.
- Submit a one-time run with a single notebook task on the existing cluster, capturing the run_id for polling.
- Retrieve the run state. Repeat until the run life_cycle_state is TERMINATED, then proceed to fetch the output.
- Retrieve the output of the finished run, capturing the notebook result and any error message.
What you'll need to have ready
- token: Databricks personal access token for the Authorization header.
- runName: Name for the one-time run.
- taskKey: Unique key identifying the single task within the run.
- notebookPath: Absolute workspace path of the notebook to run.
- existingClusterId: Id of an existing all-purpose cluster to run the task on.
For your developer
Arazzo workflow microsoft-azure-databricks:submit-one-time-run, 3 operations: submitRun → getJobRun → getJobRunOutput. Specs on APIs.io.