1.72 release notes

Below, you can find release notes for Matillion ETL version 1.72.x

1.72 is a long-term support (LTS) release. Long-term support for version 1.61 has now ended. Read about Matillion ETL supported releases to learn more.

Matillion ETL version 1.72.14

2024 - July 24th

Improvements and bug fixes

All platforms

Fixed an issue where items in the Admin menu were duplicated when using stateless authentication.
Fixed an issue where the API Query component would return NULL for datetime fields due to result set caching issues.
Updated Guava dependencies to address the following vulnerabilities:
- CVE-2023-2976
- CVE-2020-8908

Driver updates

DynamoDB driver updated 23.0.8630.0 → 23.0.8817.0.
SurveyMonkey driver updated 22.0.8257.0 → 23.0.8901.0.

Matillion ETL version 1.72.13

2024 - July 5th

Improvements and bug fixes

All platforms

Added additional disk usage metrics to performance monitor.

Snowflake on AWS

Fixed an issue where sampling in a Database Query component connecting to SAP via the IBM DB2 driver could cause out of memory errors.

Driver updates

Dynamics 365 Query driver updated 21.0.8124.0 → 23.0.8839.0.

Matillion ETL version 1.72.12

2024 - June 25th

Improvements and bug fixes

Fixed an issue where using Database Query to load columns with a data type of JSON from a MySQL table was causing an error.
Fixed an issue where SAP ODP Extract was failing to write to an external table.

Driver updates

LinkedIn Ads driver updated 23.0.8770.0 → 23.0.8921.0.
Redshift driver updated 21.0.18 → 21.0.28.
QuickBooks Online driver updated 21.0.8137.0 → 23.0.8839.0.

Matillion ETL version 1.72.11

2024 - May 20th

Improvements and bug fixes

Fixed an issue that was preventing an upgrade to version 1.72.x from older versions of Matillion ETL.
Fixed an issue where the application would freeze when trying to log in to the server.
Fixed an issue that was causing certain shared jobs to fail due to JSON syntax being incorrectly parsed.
Fixed a number of reported vulnerabilities.
Fixed an issue where clients could not connect if all optional features were disabled.
Improve logging under high websocket loads.
Fixed an issue with the Salesforce Output component where single quotes were not escaped properly when building the "Insert into" cloud data warehouse SQL statement for errored/rejected records.

Driver updates

Apache Hive and Apache Spark

Apache Hive driver updated 22.0.8326.0 → 23.0.8839.0.
Apache Spark driver updated 22.0.8322.0 → 23.0.8839.0.

Warning

These driver updates are a breaking change. You will need to replace any Apache Hive and Apache Spark components with fresh versions of each component.

Facebook and Facebook Ads

Facebook driver updated 23.0.8565.0 → 23.0.8889.0.
Facebook and Facebook Ads driver updated to use Marketing API version v19.

Warning

The Facebook Marketing API v17.0 expires on May 14th, 2024. Use the Connection Options property to manually set the API version to a current version—for example, v18.0 or v19.0.

To do this:

Open the Connection Options property.
Click +.
Set Parameter to "Other".
Set Value to, for example, "MarketingAPIVersion=19.0" or "GraphAPIVersion=19.0".

Read Available Marketing API Versions for more information.

Matillion ETL version 1.72.10

2024 - May 8th

Improvements and bug fixes

Secured Matillion ETL against the following CVEs:
- CVE-2023-26119
- CVE-2023-44981
Removed an unused SQLite 2015 library.
Added an improvement to assign more reasonable partition sizes for released images.
Improved session invalidation.

Matillion ETL version 1.72.8

2024 - April 15th

Improvements and bug fixes

Fixed an issue where scheduled jobs would not trigger.
Fixed an issue where Matillion ETL could become unresponsive when using Git integration.
Fixed an issue where task_batch_history indexes were not created.
Security and vulnerability fixes.

Matillion ETL version 1.72.7

2024 - March 1st

Improvements and bug fixes

Added an improvement to ensure that special characters and whitespace can be used in S3 buckets and keys.
Added an improvement to ensure that telemetry events created before instance start-up and acceptance are discarded.
Added an improvement to preserve "Ignore misfires" status when migrating schedules between instances.
Fixed an issue where the Join Expression Parameter dialog's default size was unreasonable.
Fixed an issue where the Redshift data types were cast as "serial" and "bigserial".
Fixed an issue in SharePoint Query to ensure that the AllSites.Read permission is requested instead of AllSites.Manage when creating an OAuth profile.
Miscellaneous security fixes.

Driver updates

LinkedIn API driver updated 22.0.8431.0 → 23.0.8770.0
LinkedIn Ads API driver updated 22.0.8389.0 → 23.0.8770.0

Matillion ETL version 1.72.6

2024 - February 9th

Improvements

Allowed SQL queries to be stored in full in the Tomcat logs, rather than the default "trim" behaviour, using a menu toggle.

Driver updates

Jira API driver updated 23.0.8579.0 → 23.0.8677.0.
MongoBD API driver updated 22.0.8389.0 → 23.0.8749.0. This driver update fixes an issue where jobs could hang at validation.
Salesforce API driver updated 22.0.8523.0 → 23.0.8669.0. This driver update fixes an issue where the component would hang when running JOIN or UNION queries.

Matillion ETL version 1.72.5

2024 - January 22nd

Improvements and bug fixes

Increased the maximum number of environments per instance to 9999 (was 999) for Hub users.
Fixed a security vulnerability around URL redirects.

Matillion ETL version 1.72.4

2023 - December 22nd

Improvements and bug fixes

Updated the Hazelcast license key. This new license expires on 31st March, 2026. The maximum number of nodes in a cluster is consequently increased from the current 6 nodes to 9,999 nodes, which greatly increases potential throughput if needed. Read Instances update note for Hazelcast v3 to learn more.

Matillion ETL version 1.72.3

2023 - November 21st

Improvements and bug fixes

Fixed an issue where the SSL certificate chain file could be overwritten in /etc/tomcat/server.xml.
Fixed an issue where SQS messages would not run in order under heavy load.
Fixed a caching issue on Delta Lake on Databricks instances where new tables were not recognized.
Added caching to retrieval of schemas in Azure Synapse instances to alleviate performance issues during and after migration.

Matillion ETL version 1.72.2

2023 - November 9th

Improvements and bug fixes

Fixed an issue where sampling and parameter changes were only possible for five minutes following job validation.
Reduced the runtime of the Salesforce Output component when capturing reject records from Snowflake.
Fixed an issue where non-fully qualified masking policies for Snowflake columns were producing null pointer exceptions.

Matillion ETL version 1.72.1

2023 - September 20th

New features and improvements

All platforms

Logo and branding updates to the Matillion ETL UI.
Updated Matillion ETL from Apache Tomcat version 10.1.2 to version 10.1.11.
Improved Task History to display schedule completion time.

Snowflake, Delta Lake on Databricks, Amazon Redshift

The Run dbt Command component has been renamed to Commands for dbt Core and the component has been updated in the following ways:
- Added a Profile Config parameter for users to assign additional output parameters or override existing parameters of the profiles.yml file.
- Renamed the parameter Map Environment Variables to Map dbt Environment Variables.

Delta Lake on Databricks

Added the JDBC Incremental Load component.
Added the Salesforce Incremental Load component.
Added support for the Metadata API endpoint.
Updated the Start Cluster component to always use the environment's default cluster.
Updated the Run Delta Live Table component to allow selection of pipeline—by name—from a drop-down menu, instead of entering an ID string.

Bug fixes

Improved Git Integration performance by running certain repository transactions as batch processes.
Added an improvement to ensure that admin customizations are preserved in the server.xml file.
Added an improvement for batch job loading for better performance when opening large projects.
Fixed an issue where the Schedule Completed column in Task History was displaying incorrectly formatted values.
Added an improvement to optimize memory usage when there are many connected sessions.
Added an improvement to prevent temporary file handles from being lost when staging from empty tables.

Driver updates

Snowflake JDBC driver updated 3.13.26 → 3.13.28
Dynamics 365 Business Central API driver updated 21.0.8011.0 → 22.0.8545.0. This update fixes a bug where users could experience timeout issues when setting filters.
DynamoDB API driver updated 23.0.8587.0 → 23.0.8630.0
Facebook API driver updated 21.0.8137.0 → 23.0.8565.0
Facebook Ads API driver updated 22.0.8391.0 → 23.0.8565.0
Google Ads API driver updated 22.0.8432.0 → 23.0.8649.0
Jira API driver updated 22.0.8322.0 → 23.0.8579.0. This update fixes a bug where custom column values were not returned correctly beyond the first page.

Note

For Facebook Query and Facebook Ads Query, the Version connection option has been removed. This is a breaking change and any components with this option set will fail validation. Both drivers now default to v16.0 of their respective API.