Triage a Failed Connector
A 7-step recipe with Apache Kafka. We can help you get access.
Recipe · 7 steps
Triage a Failed Connector
with Apache Kafka
Diagnose a connector failure down to the task and restart it.
- List the connectors on the worker with their status expanded, giving the caller the fleet-wide picture before drilling into one connector.
- Read the status of the target connector. The connector-level state tells the caller whether the connector itself failed or whether it is running with failed tasks underneath it.
- List the tasks belonging to the connector along with their per-task configuration, so the caller can see how the work was divided.
- Read the status of the individual task, capturing the state, the worker that owns it, and the stack trace that explains the failure.
- Restart just the failed task, which is the least disruptive recovery action because the connector's other tasks keep running.
- Restart the connector and all of its tasks, restarting only the failed ones so healthy tasks are not needlessly interrupted.
- Re-read the connector status to confirm the restart actually recovered the connector rather than assuming the restart call was enough.
What you'll need to have ready
- connectorName: The name of the connector to triage.
- taskId: The task id to inspect in detail. Defaults to the first task, which is task 0 on a single-task connector.
For your developer
Arazzo workflow apache-kafka:triage-failed-connector, 7 operations: listConnectors → getConnectorStatus → listConnectorTasks → getTaskStatus → restartTask → restartConnector → getConnectorStatus. Specs on APIs.io.