SQL
Write your own complete SQL SELECT statement.
This component can run queries on any tables in the project. You may link one or more inputs into the SQL component to indicate which data sources are used within the query. The SQL component can also be used as a source (e.g. the first component in the transformation job workflow) and thus does not strictly require any input links from other components.
To query a table from another component in the job, your SELECT statement must use an expression that references the component by name. This expression has the form $T{<component name>}
. For example, to select all from a table you have read with a Table Input component called "Table Input 1", use the following statement:
SELECT * FROM $T{Table Input 1}
If you require non-SELECT statements, the SQL Script orchestration component allows for custom non-SELECT statements where the output can be used as part of the orchestration flow.
Properties
Name
= string
A human-readable name for the component.
SQL Query
= script editor
The SQL Query. Variables can be referenced with the syntax: ${<variable name>}
.
Read Variables to learn more.
Strategy
Runs your own SELECT statement.
Snowflake | Delta Lake on Databricks | Amazon Redshift | Google BigQuery | Azure Synapse Analytics |
---|---|---|---|---|
✅ | ✅ | ✅ | ✅ | ✅ |