Run Shared Pipeline

Run a shared pipeline to completion. After the shared pipeline completes, other orchestration components can be linked to this one—depending upon success or failure.

Read Shared Pipelines for a full description of how to create a shared pipeline that can be referenced by this component.

Properties

Name = string

A human-readable name for the component.

Shared Pipeline = drop-down

Select a shared pipeline. The drop-down contains all pipelines that have been shared and published from any project.

Version = drop-down

Select the version of the shared pipeline that will be run. The special value [Latest] will select the last published version of the shared pipeline, and the component will automatically pick up new versions whenever they are published.

For more detail on versioning shared pipelines, read Versioning and release workflow.

Set Scalar Variables = column editor

Pipeline variables declared in the shared pipeline can be given new values through this property.

Read Variables for more information.

Variable: Select the variable in the shared pipeline that you want to assign a new value to.
Value: Enter a new value for the variable, which will be used when the shared pipeline runs. Ensure that the new value is of the correct type.

Click the Text Mode toggle at the bottom of the dialog to open a multi-line editor that lets you add items in a single block. For more information, read Text mode.

Set Grid Variables = column editor

Grid variables declared in the shared pipeline with a public scope can be used by the consuming pipeline. These variables can be given new values in the consuming pipeline through this property. Read Grid variables for more information.

Name: Lists every grid variable in the shared pipeline.
Status: Defines which values each grid variable will use when the shared pipeline runs. Options are:
- Use defaults: Use the defaults set in the shared pipeline's grid variable when the shared pipeline runs in this component.
- Set values: Lets you set new values for the shared pipeline's grid variable in this property. The values set here are used as the new defaults in the shared pipeline when it runs through this property only—they don't change any actual defaults that have been set in the shared pipeline.
- Use grid: Select a grid variable from the consuming pipeline and assign its values to the grid variable in the shared pipeline when the shared pipeline runs in this component. Use the Column Mapping drop-down menus to map each column in the shared pipeline's grid variable to a column from the consuming pipeline's grid variable. Take care to ensure you are mapping like-for-like data types.

Snowflake	Databricks	Amazon Redshift
✅	✅	✅