Run a transformation job to completion. After the transformation completes, other orchestration components can be linked to this one depending upon success or failure.
Name = string
A human-readable name for the component.
Transformation Job = drop-down
Choose an existing transformation job.
Set Scalar Variables = columns editor
- Variable: Select a scalar variable to be used by the called transformation job. Add a scalar variable by clicking + and then selecting from the dropdown list.
- Value: Assign a value to the scalar variable. The assigned value must be of the correct type as given when the variable was declared.
If a shared variable named 'Message' is passed using this method, it can be later exported from this component (keeping any changes to the value that occurred within the Run Transformation job) using the 'Message' export variable.
Set Grid Variables = columns editor
Grid variables for the transformation job being called are listed and, by default, are used by the called job in their default state. Selecting a grid variable and choosing an option other than Use Defaults in the Set Values dropdown menu allows users to overwrite grid variables data in that job.
- Values: Define individual values.
- Grid: Map columns using grid variables from the called transformation job. For more information, read Grid variables.
|Snowflake||Delta Lake on Databricks||Amazon Redshift||Google BigQuery||Azure Synapse Analytics|