capabilities.work

Preflight and Create a Cluster

A 3-step recipe with Azure Databricks. We can help you get access.

Recipe · 3 steps

Preflight and Create a Cluster

with Azure Databricks · IT Infrastructure Management

Resolve a Spark version and node type, then create a cluster.

  1. List the available Databricks Runtime versions and capture the first version key to use for the cluster.
  2. List the supported Azure VM node types and capture the first node type id to use for the cluster.
  3. Create the cluster using the resolved Spark version and node type, capturing the returned cluster_id.
What you'll need to have ready
  • token: Databricks personal access token for the Authorization header.
  • clusterName: Name for the new cluster.
  • numWorkers: Number of worker nodes for the cluster.
For your developer

Arazzo workflow microsoft-azure-databricks:preflight-create-cluster, 3 operations: listSparkVersions → listNodeTypes → createCluster. Specs on APIs.io.

More recipes with Azure Databricks

Back Up a Notebook by Export and Re-importCancel an Active Job RunClean Up the Latest Completed Job RunCluster Health DiagnosticsCreate a Directory and Import a NotebookCreate a Job and Run It to CompletionSafely Delete a Workspace DirectoryImport a Notebook and Run ItPin the First Listed ClusterProvision a Cluster and Run a Job on It