capabilities.work

Reset Connector Offsets

A 6-step recipe with Apache Kafka. We can help you get access.

Recipe · 6 steps

Reset Connector Offsets

with Apache Kafka

Wipe a stopped connector's offsets and restart it from scratch.

  1. Stop the connector. Kafka Connect will not reset offsets for a connector that is running or paused, only for one that is fully stopped.
  2. Snapshot the offsets before they are deleted. The reset itself cannot be undone through the API, so this response is the only record of where the connector had reached.
  3. Delete the connector's offsets. On resume the connector behaves as if it had never run, reprocessing from its configured starting position.
  4. Read the offsets back while the connector is still stopped to confirm the reset cleared them before any reprocessing begins.
  5. Resume the connector so it begins reprocessing from a clean slate.
  6. Confirm the connector came back healthy and is reprocessing rather than failing on its first poll after the reset.
What you'll need to have ready
  • connectorName: The name of the connector whose offsets are being reset.
For your developer

Arazzo workflow apache-kafka:reset-connector-offsets, 6 operations: stopConnector → getConnectorOffsets → resetConnectorOffsets → getConnectorOffsets → resumeConnector → getConnectorStatus. Specs on APIs.io.

More recipes with Apache Kafka

Update a Connector ConfigurationDecommission a ConnectorTriage a Failed ConnectorPause and Resume a Connector for MaintenanceRewind Connector OffsetsValidate and Deploy a ConnectorReview Consumer Group LagGrant a Principal Access to a TopicReview Cluster and Topic CapacityDecommission a Topic