capabilities.work

Rewind Connector Offsets

A 6-step recipe with Apache Kafka. We can help you get access.

Recipe · 6 steps

Rewind Connector Offsets

with Apache Kafka

Alter a stopped connector's offsets to replay data, then resume it.

  1. Stop the connector. This is mandatory: Kafka Connect rejects offset alterations for connectors that are running or merely paused.
  2. Capture the connector's current offsets before altering them. This snapshot is the only rollback path if the rewind target turns out to be wrong.
  3. Write the target offsets to the stopped connector so that it will replay from the requested position when it resumes.
  4. Read the offsets back while the connector is still stopped, confirming the rewind landed before any data is reprocessed.
  5. Resume the connector so it begins processing from the rewound offsets.
  6. Confirm the connector returned to a healthy state and is replaying from the new position.
What you'll need to have ready
  • connectorName: The name of the connector whose offsets are being rewound.
  • offsets: The target offsets to write. Each entry carries the partition and offset objects in the shape the connector's plugin defines, which differs between source and s
For your developer

Arazzo workflow apache-kafka:rewind-connector-offsets, 6 operations: stopConnector → getConnectorOffsets → alterConnectorOffsets → getConnectorOffsets → resumeConnector → getConnectorStatus. Specs on APIs.io.

More recipes with Apache Kafka

Update a Connector ConfigurationDecommission a ConnectorTriage a Failed ConnectorPause and Resume a Connector for MaintenanceReset Connector OffsetsValidate and Deploy a ConnectorReview Consumer Group LagGrant a Principal Access to a TopicReview Cluster and Topic CapacityDecommission a Topic