capabilities.work

Create Job From Template and Track

A 3-step recipe with Google Cloud Dataflow. We can help you get access.

Recipe · 3 steps

Create Job From Template and Track

with Google Cloud Dataflow

Read template metadata, create a job from the template, then confirm it.

  1. Read the classic template metadata at the supplied Cloud Storage path to confirm the template exists and to inspect its parameters.
  2. Create a new Dataflow job from the classic template with the supplied job name and runtime parameters.
  3. Read the newly created job back to confirm it was registered and to capture its current state.
What you'll need to have ready
  • accessToken: Google Cloud OAuth 2.0 access token used as a Bearer credential.
  • projectId: The Google Cloud project id that owns the job.
  • location: The regional endpoint that contains the job (e.g. us-central1).
  • gcsPath: Cloud Storage path to the classic template (gs://...).
  • jobName: The name to assign to the created job.
  • parameters: Map of runtime template parameter name/value pairs.
For your developer

Arazzo workflow google-cloud-dataflow:create-job-from-template-and-track, 3 operations: getLocationTemplate → createLocationJobFromTemplate → getLocationJob. Specs on APIs.io.

More recipes with Google Cloud Dataflow

Cancel Running JobCapture Worker Debug DataCleanup Job SnapshotsDiagnose JobDrain Running JobLaunch Classic Template and MonitorLaunch Flex Template and MonitorList Jobs and SnapshotSnapshot Streaming Job