Tech note - failing pipelines

2022 - August 30th

Matillion plans to release an update to Data Loader that will affect continuously failing pipelines that don't move any rows of data.

If a pipeline run completes with a failure status 120 times in a row and moves no rows of data, the pipeline will be disabled.

When a pipeline is disabled, Data Loader will write a message to task_batch_history to confirm that the pipeline has been disabled.

Please review your pipelines if they are failing consecutively. If you require assistance with your pipelines, please contact support.