Retry
The Retry component lets you repeatedly try to run a connected component until it succeeds (or a maximum number of attempts is reached). This component is attached to another component using the grey component squiggly.
During the interval between retries, nothing is shown in the task panel, and it may appear that although the pipeline run hasn't completed yet, nothing is running. Once the current wait time is reached, the task will be added to the run for its next attempt and the pipeline will continue.
Properties
Name = string
A human-readable name for the component.
Number of Retries = integer
The maximum number of attempts to retry the connected component. The total number of times the attached component could be run is one more than the number of retries. The original run is not a retry. If the final retry fails, the failure link is followed. The first time the component succeeds, the success link is followed.
Retry Delay = drop-down
Certain kinds of transient failures may benefit from a delay before retrying. The Retry Delay parameter provides strategies for retrying quickly or slowly, with the ability to leave longer and longer pauses between attempts (known as backoff).
- Custom: Specify a custom delay value of hours, minutes, or seconds.
- Long delay: Waits approximately 15 seconds between retries.
- Long delay with backoff: Waits longer between each failure, at approximately 15, 30, 60, 120, 240... seconds.
- Retry immediately: Will immediately retry up to the maximum number of retries. This is the default setting.
- Short delay: Waits approximately 2 seconds between retries.
- Short delay with backoff: Waits longer between each failure, at approximately 1, 2, 5, 10, 20, 40... seconds.
Retry Interval = integer
An integer value of the unit specified below. The default value is 1. An error will occur if the value is below 0 or above 3600. An error will also occur if the value is not an integer. Only available when Retry Delay is set to Custom.
Retry Time Unit = drop-down
Choose Hour, Minute, or Second. Only available when Retry Delay is set to Custom.
| Snowflake | Databricks | Amazon Redshift |
|---|---|---|
| ✅ | ✅ | ✅ |