Run Transformation

Overview

Run a transformation job to completion. After the transformation completes, other orchestration components can be linked to this one depending upon success or failure.

Properties

Name = string

A human-readable name for the component.

Transformation Job = drop-down

Choose an existing transformation job.

Set Scalar Variables = columns editor

Variable: Select a scalar variable to be used by the called transformation job. Add a scalar variable by clicking + and then selecting from the dropdown list.
Value: Assign a value to the scalar variable. The assigned value must be of the correct type as given when the variable was declared.

If a shared variable named 'Message' is passed using this method, it can be later exported from this component (keeping any changes to the value that occurred within the Run Transformation job) using the 'Message' export variable.

Set Grid Variables = columns editor

Grid variables for the transformation job being called are listed and, by default, are used by the called job in their default state. Selecting a grid variable and choosing an option other than Use Defaults in the Set Values dropdown menu allows users to overwrite grid variables data in that job.

Values: Define individual values.
Grid: Map columns using grid variables from the called transformation job. For more information, read Grid variables.

Snowflake	Delta Lake on Databricks	Amazon Redshift	Google BigQuery	Azure Synapse Analytics
✅	✅	✅	✅	✅