capabilities.work

Snapshot Streaming Job

A 3-step recipe with Google Cloud Dataflow. We can help you get access.

Recipe · 3 steps

Snapshot Streaming Job

with Google Cloud Dataflow

Confirm a streaming job is running, snapshot it, and read the snapshot.

  1. Read the job and confirm it is currently in the JOB_STATE_RUNNING state before creating a snapshot.
  2. Create a snapshot of the running streaming job, capturing its state for later reuse with the supplied retention window.
  3. Read the newly created snapshot back to confirm its state, source job, and creation metadata.
What you'll need to have ready
  • accessToken: Google Cloud OAuth 2.0 access token used as a Bearer credential.
  • projectId: The Google Cloud project id that owns the job.
  • location: The regional endpoint that contains the job (e.g. us-central1).
  • jobId: The id of the running streaming job to snapshot.
  • ttl: Snapshot retention duration as a duration string (e.g. 604800s).
  • description: A human-readable description for the snapshot.
For your developer

Arazzo workflow google-cloud-dataflow:snapshot-streaming-job, 3 operations: getLocationJob → snapshotLocationJob → getLocationSnapshot. Specs on APIs.io.

More recipes with Google Cloud Dataflow

Cancel Running JobCapture Worker Debug DataCleanup Job SnapshotsCreate Job From Template and TrackDiagnose JobDrain Running JobLaunch Classic Template and MonitorLaunch Flex Template and MonitorList Jobs and Snapshot