capabilities.work

List Jobs and Snapshot

A 3-step recipe with Google Cloud Dataflow. We can help you get access.

Recipe · 3 steps

List Jobs and Snapshot

with Google Cloud Dataflow

List jobs in a region, read the first one, and snapshot it.

  1. List the Dataflow jobs in the requested region and capture the first job id returned in the page.
  2. Read the first job from the list to inspect its current state before taking a snapshot.
  3. Create a snapshot of the inspected job, capturing its streaming state with the supplied retention window.
What you'll need to have ready
  • accessToken: Google Cloud OAuth 2.0 access token used as a Bearer credential.
  • projectId: The Google Cloud project id that owns the jobs.
  • location: The regional endpoint that contains the jobs (e.g. us-central1).
  • filter: Optional job state filter (e.g. ACTIVE, TERMINATED, ALL).
  • ttl: Snapshot retention duration as a duration string (e.g. 604800s).
For your developer

Arazzo workflow google-cloud-dataflow:list-jobs-and-snapshot, 3 operations: listLocationJobs → getLocationJob → snapshotLocationJob. Specs on APIs.io.

More recipes with Google Cloud Dataflow

Cancel Running JobCapture Worker Debug DataCleanup Job SnapshotsCreate Job From Template and TrackDiagnose JobDrain Running JobLaunch Classic Template and MonitorLaunch Flex Template and MonitorSnapshot Streaming Job