1.75 release notes

Below, you can find release notes for the long-term support (LTS) version 1.75 of Matillion ETL. Read more about Matillion ETL supported releases.

For release notes on all long-term support versions, read Matillion ETL long-term support (LTS) release notes to stay up-to-date with releases to both this version and other LTS versions.

Matillion ETL version 1.75.5

2024 - July 24th

Improvements and bug fixes

All platforms

Fixed an issue where items in the Admin menu were duplicated when using stateless authentication.
Fixed an issue where threads used in SQS processing were not closed, leading to resource exhaustion.
Fixed an issue where the validation state of components was not cached, leading to unexpected invalidation of components.
Fixed an issue where staged files were not being deleted when using Extract components.
Fixed an issue found in version 1.75.2 where extracting tables from SAP ODP to an Amazon S3 bucket would fail due to the bucket not being found.

Driver updates

DynamoDB driver updated 23.0.8630.0 → 23.0.8817.0.
SurveyMonkey driver updated 22.0.8257.0 → 23.0.8901.0.

Matillion ETL version 1.75.4

2024 - July 5th

Improvements and bug fixes

All platforms

Improved the logging of validation errors so that users can better identify the root cause of a validation failure.
Added additional disk usage metrics to performance monitor.

Snowflake on AWS

Fixed an issue where sampling in a Database Query component connecting to SAP via the IBM DB2 driver could cause out of memory errors.

Driver updates

Dynamics 365 Query driver updated 21.0.8124.0 → 23.0.8839.0.
LinkedIn Ads Query driver updated 23.0.8770.0 → 23.0.8921.0.

Matillion ETL version 1.75.3

2024 - June 25th

Improvements and bug fixes

Fixed an issue where using Database Query to load columns with a data type of JSON from a MySQL table was causing an error.
Fixed an issue where SAP ODP Extract was failing to write to an external table.

Driver updates

LinkedIn Ads driver updated 23.0.8770.0 → 23.0.8921.0.
Redshift driver updated 21.0.18 → 21.0.28.
QuickBooks Online driver updated 21.0.8137.0 → 23.0.8839.0.

Matillion ETL version 1.75.2

2024 - May 20th

Improvements and bug fixes

Fixed an issue where timestamps were showing only the date when loading data into Databricks.
Fixed a number of reported vulnerabilities.
Fixed an issue where clients could not connect if all optional features were disabled.
Improve logging under high websocket loads.
Fixed an issue with the Salesforce Output component where single quotes were not escaped properly when building the "Insert into" cloud data warehouse SQL statement for errored/rejected records.

Driver updates

Apache Hive and Apache Spark

Apache Hive driver updated 22.0.8326.0 → 23.0.8839.0.
Apache Spark driver updated 22.0.8322.0 → 23.0.8839.0.

Warning

These driver updates are a breaking change. You will need to replace any Apache Hive and Apache Spark components with fresh versions of each component.

Facebook and Facebook Ads

Facebook driver updated 23.0.8565.0 → 23.0.8889.0.
Facebook and Facebook Ads driver updated to use Marketing API version v19.

Warning

The Facebook Marketing API v17.0 expires on May 14th, 2024. Use the Connection Options property to manually set the API version to a current version—for example, v18.0 or v19.0.

To do this:

Open the Connection Options property.
Click +.
Set Parameter to "Other".
Set Value to, for example, "MarketingAPIVersion=19.0" or "GraphAPIVersion=19.0".

Read Available Marketing API Versions for more information.

Matillion ETL version 1.75.0

Warning

If you're using Matillion ETL on Azure, this release is available as version 1.75.1 in the Azure marketplace. However, within Matillion ETL, the version will read correctly as 1.75.0.

Warning

After further testing of our automatic security updates feature, we have discovered that certain customer configurations may experience system instability. Therefore, we have temporarily disabled this feature in 1.75.0.

Users can still perform security upgrades by logging in to their instances and running the normal Yum update command yum update --security. As always, Matillion ETL should be restarted after such updates.

2024 - May 2nd

Key Updates

All platforms

The underlying operating system Matillion ETL runs on has been upgraded to CentOS Stream 9.
The latest versions of the dbt libraries don't work with Matillion ETL, so we provide library versions that are known to work.
Migration of credentials to a new Matillion ETL instance is performed faster, and migration is completed more efficiently.
Improved performance of OpenID authentication.
Allowed the installation of the end-of-life Python 2 version by default.
Allowed SQL queries to be stored in full in the Tomcat logs, rather than the default "trim" behaviour, using a menu toggle.

Snowflake

When a job including the Commands for dbt Core component was cancelled, the queries sent from dbt to Snowflake would continue to run until completion. This behaviour has been changed so the dbt query is cancelled if the job is cancelled.

New features and improvements

All platforms

Following a Shopify API driver update, the App ID property has been removed from the Shopify Query component.
Removed some included libraries that may have led to potential security vulnerabilities.

Bug fixes

All platforms

Fixed an issue that could cause large numbers of threads to be created when uploading to an S3 storage bucket.
Fixed an issue in the Salesforce Output component where certain column mappings could cause the component to fail to run.
Fixed an issue with filters not working correctly in the SAP ODP Extract component.
Added an optional feature to allow disabling of the Store in component field in all components' password dialogs.
Fixed an issue where scheduled jobs would not trigger.
Fixed an issue where Matillion ETL could become unresponsive when using Git integration.
Fixed an issue where task_batch_history indexes were not created.
Security and vulnerability fixes.

Snowflake

Fixed an issue that was causing the Azure SQL Bulk Output component to fail.
Fixed an issue where the Snowflake Cloud Storage Load Generator was failing on GCP.
Fixed an issue that was causing the storage integrations drop-down to show no integrations when creating an external stage.
Fixed an issue where incorrect case was being assigned to column alias names in the Extract Nested Data component.
Fixed an issue in the Query Result to Scalar component that was causing it to fail in certain circumstances.
Fixed an issue that was causing an error following in-place upgrades of certain versions of Matillion ETL.

Delta Lake on Databricks

Fixed an issue that was causing the Calculator component to fail in certain scenarios.

Amazon Redshift

Fixed an issue where the IAM Role ARN property in the S3 Load component was a required field and should have been optional.
Fixed an issue in the OData Query component by issuing a new driver version.
Fixed an issue where Matillion ETL would become unresponsive when attempting to commit changes to a running job.

Driver updates

Facebook Ads driver updated 23.0.8565.0 → 23.0.8831.0.
Google Ads driver updated 23.0.8649.0 → 23.0.8770.0.
HubSpot driver updated 21.0.8130.0 → 23.0.8767.0.
Jira driver updated 23.0.8579.0 → 23.0.8677.0.
LinkedIn driver updated 22.0.8389.0 → 23.0.8770.0. This affects both LinkedIn Query and LinkedIn Ads Query components.
MongoDB driver updated 23.0.8749.0 → 23.0.8799.0. This fixes an issue where instances of the MongoDB Query component could incorrectly return NULL rows.
OData driver updated 21.0.8180.0 → 23.0.8771.0. This update fixes a bug that was causing OData Query to fail.
Shopify API driver updated 21.0.8137.0 → 23.0.8771.0.
org.postgresql:postgresql library updated 42.5.4 → 42.7.2 to address a critical vulnerability in the library.