Upgrade: Filter🔗
The Data Productivity Cloud has a Filter component that's equivalent to the Matillion ETL Filter component, so Filter components will migrate automatically.
The Filter components for Databricks in Matillion ETL and the Data Productivity Cloud have some functionality difference in how single quotes ('), double quotes ("), and backticks (`) are handled in filter expressions. Manual intervention may be required after migration to ensure the filter expressions behave as expected.
Upgrade path for Databricks🔗
When migrating Matillion ETL Filter components that target Databricks, the quoting behavior of filter expressions may differ between Matillion ETL and the Data Productivity Cloud. This is due to differences in how the two platforms handle quotes in SQL expressions.
The following table summarizes how different uses of quotes in Matillion ETL Filter components will be handled during migration to the Data Productivity Cloud. If you have filter expressions that use quotes, you should review them after migration to ensure they behave as expected.
In the following table:
- Filter value is the value set in the Matillion ETL Filter component.
- Source column type is the data type of the column being filtered.
- SQL Matillion ETL is the SQL that is generated by the Matillion ETL Filter component.
- SQL Data Productivity Cloud is the SQL that would be generated if the filter value were used in a Data Productivity Cloud Filter component directly.
- Value on import is the value that will be set in the Data Productivity Cloud Filter component after migration.
- SQL Data Productivity Cloud imported is the resulting quoting of the SQL in the Data Productivity Cloud.
| Filter value | Source column type | SQL Matillion ETL | SQL Data Productivity Cloud | Value on import | SQL Data Productivity Cloud imported |
|---|---|---|---|---|---|
a |
string/text | 'a' |
'a' |
a |
'a' |
'a' |
string/text | 'a' |
'\'a\'' |
a |
'a' |
"a" |
string/text | `a` |
'"a"' |
`a` |
`a` |
`a` |
string/text | `a` |
`a` |
`a` |
`a` |
2025-11-24 |
datetime-like/boolean | '2025-11-24' |
'2025-11-24' |
2025-11-24 |
'2025-11-24' |
'2025-11-24' |
datetime-like/boolean | '2025-11-24' |
'2025-11-24' |
2025-11-24 |
'2025-11-24' |
"a" |
datetime-like/boolean | `a` |
'"a"' |
`a` |
`a` |
`a` |
datetime-like/boolean | `a` |
`a` |
`a` |
`a` |
1 |
anything else | '1' |
1 |
1 |
1 |
'1' |
anything else | '1' |
'1' |
1 |
1 |
"a" |
anything else | `a` |
"a" |
`a` |
`a` |
`a` |
anything else | `a` |
`a` |
`a` |
`a` |