Skip to content

1.75 release notes

Below, you can find release notes for the long-term support (LTS) version 1.75 of Matillion ETL. Read more about Matillion ETL supported releases.

For release notes on all long-term support versions, read Matillion ETL long-term support (LTS) release notes to stay up-to-date with releases to both this version and other LTS versions.

Matillion ETL version 1.75.15

2024 - November 20th

Improvements and bug fixes

All platforms

  • Fixed an issue that was causing an error when setting the Access URL option for the SurveyMonkey Query connector.
  • Fixed an issue that was causing intermittent errors in the Sync File Source component.
  • Fixed an issue that was causing the Run job in clone option when creating a schedule to show as "Enterprise only", even when the instance was using an Enterprise license.
  • Fixed an issue that was causing transformation jobs to intermittently fail with the error Input component <component name> is not in a valid state.

Amazon Redshift

  • Fixed an issue that was preventing the S3 Manifest Builder component from listing files in subdirectories.

Matillion ETL version 1.75.14

2024 - November 7th

Improvements and bug fixes

  • Fixed an issue where OAuth for Dynamics 365 would not refresh. Now, Matillion ETL automatically sets InitiateOAuth=GETANDREFRESH for Dynamics 365 to auto refresh the OAuth.
  • Enabled the use of a deprecated MongoDB connector to avoid existing jobs breaking, due to persistence issues with the current MongoDB connector.
  • Improved Matillion ETL FIFO queues in the SQS Message component to include MessageID and MessageDeDuplicationID parameters to circumvent error software.amazon.awssdk.services.sqs.model.SqsException: The request must contain the parameter MessageGroupId. (Service: Sqs, Status Code: 400, Request ID: ea63b15d-a78d-52be-9b37-eccd69056a3b)..
  • Fixed an issue in Matillion ETL for Delta Lake on Databricks where views were not displaying in the Views drop-down menu in the Environments panel.

Matillion ETL version 1.75.13

2024 - October 23rd

Improvements and bug fixes

All platforms

  • Fixed an issue where the Data Transfer component would time out while attempting to authenticate to an SFTP service.
  • Added a feature switch to allow disabling of password autocompletion in the user's browser.
  • Fixed some potential security vulnerabilities in the user interface.
  • Fixed an issue in transformation jobs where it was not possible to select and delete all components on the canvas, though it was possible to select and delete some components.

AWS Redshift

  • Fixed an issue that caused intermittent failures in transformation jobs that include a Table Input component.

Google BigQuery

  • Fixed a bug that was causing an error when the API Extract component created a table.

Driver updates

  • Google Ads driver updated 23.0.8649.0 → 24.0.9029.0, to allow the use of API v16.

Matillion ETL version 1.75.12

2024 - October 9th

Improvements and bug fixes

All platforms

  • Fixed a bug where the Performance tab wasn't displaying any performance metrics.

AWS Redshift

  • Fixed an issue where connectors were unable to access S3 buckets in the me-south-1 location.

Driver updates

  • SharePoint driver updated 21.0.8151.0 → 24.0.9001.0, to resolve an issue that was preventing queries of SharePoint lists exceeding 5000 items.

Note

Following this driver update, you may need to recreate any existing OAuth connections with SharePoint. Read SharePoint Query authentication guide to get started.

Matillion ETL version 1.75.11

2024 - October 4th

Improvements and bug fixes

All platforms

  • Fixed an issue where the Send Email component was giving an "Invalid Address" error when sending to recipients with a .teams.ms address.
  • Fixed an issue where jobs were not cancelling correctly in some circumstances.
  • SFTP in the Data Transfer component now supports newer encryption algorithms (ssh-rsa is no longer supported).
  • Fixed an issue where the Data Transfer component was failing when performing transfers between two different Amazon S3 bucket folders.
  • Fixed a bug with the Anaplan Bulk component to ensure complete and accurate Anaplan exports by caching and combining split rows across pages, while maintaining thread safety for reliable data processing.

AWS Redshift

Driver updates

  • Google Ads API driver updated 22.0.8432.0 → 23.0.8649.0.

Matillion ETL version 1.75.10

2024 - September 20th

Improvements and bug fixes

All platforms

  • Fixed an issue where importing/exporting jobs or downloading server logs was producing a misleading error message when the license limit was exceeded.
  • Fixed an issue where details of applied licenses weren't displayed after the instance was restarted.
  • Security and vulnerability fixes.

Snowflake on AWS

  • Fixed an issue where thread counts would continue to increase until the instance stopped responding.

Delta Lake on Databricks

  • Fixed an issue that could cause a "loading, please wait" message when accessing an instance.

Matillion ETL version 1.75.9

2024 - September 11th

Improvements and bug fixes

Snowflake on AWS

  • Fixed an issue where SAP NetWeaver Query data was being loaded to Snowflake tables as VARCHAR regardless of original data type.
  • Fixed an issue where a BYOL licence would not be inherited correctly, blocking user activity and environment configuration.

Snowflake on AWS and GCP

  • Fixed an issue where migration wasn't bringing multiple versions across, thus breaking Git integration.

Snowflake and Redshift on AWS

  • Fixed an issue where child jobs that failed validation were showing green, not red, on the canvas.

AWS Redshift

  • Fixed an issue where thread availability could block execution of tasks.

Delta Lake on Databricks

  • Fixed an issue that was slowing the validation of transformation jobs.

Matillion ETL version 1.75.8

2024 - August 30th

Improvements and bug fixes

Snowflake on AWS

Snowflake on Azure

  • Fixed an issue that was causing out-of-memory errors on High Availability clusters.
  • Fixed an issue where jobs could fail if a large number of them were queued due to a network outage.

AWS Redshift

  • Fixed an issue where deleted API Query Profiles would be reinstated by a filesync.
  • Optimized metadata queries to align with AWS Redshift latest recommendations.

Driver updates

  • LinkedIn driver updated 23.0.8921.0 → 24.0.8963.0. This affects both LinkedIn Query and LinkedIn Ads Query components. This removes support for the APIVersion connection property, as the driver now automatically uses the appropriate API version. You will need to remove this connection option if you have it set.
  • OData Query driver updated 23.0.8771.0 → 23.0.8948.0.

Matillion ETL version 1.75.7

2024 - August 13th

Improvements and bug fixes

Amazon Redshift

  • Fixed an issue that was causing intermittent screen freezes when opening a project.

Matillion ETL version 1.75.6

2024 - August 6th

Improvements and bug fixes

Databricks

  • Fixed an issue where SQL scripts may fail to validate when using DDL commands.
  • Fixed an issue where jobs may fail to validate due to Delta Lake environment defaults not persisting.

Amazon Redshift

  • Fixed an issue where the Database Query component was failing to run when S3 was selected for staging.
  • Fixed an issue where the Oracle Output component wouldn't recognize valid column names with changed case.

Google BigQuery

Driver updates

Matillion ETL version 1.75.5

2024 - July 24th

Improvements and bug fixes

All platforms

  • Fixed an issue where items in the Admin menu were duplicated when using stateless authentication.
  • Fixed an issue where threads used in SQS processing were not closed, leading to resource exhaustion.
  • Fixed an issue where the validation state of components was not cached, leading to unexpected invalidation of components.
  • Fixed an issue where staged files were not being deleted when using Extract components.
  • Fixed an issue found in version 1.75.2 where extracting tables from SAP ODP to an Amazon S3 bucket would fail due to the bucket not being found.

Driver updates

  • DynamoDB driver updated 23.0.8630.0 → 23.0.8817.0.
  • SurveyMonkey driver updated 22.0.8257.0 → 23.0.8901.0.

Matillion ETL version 1.75.4

2024 - July 5th

Improvements and bug fixes

All platforms

  • Improved the logging of validation errors so that users can better identify the root cause of a validation failure.
  • Added additional disk usage metrics to performance monitor.

Snowflake on AWS

  • Fixed an issue where sampling in a Database Query component connecting to SAP via the IBM DB2 driver could cause out of memory errors.

Driver updates

Matillion ETL version 1.75.3

2024 - June 25th

Improvements and bug fixes

  • Fixed an issue where using Database Query to load columns with a data type of JSON from a MySQL table was causing an error.
  • Fixed an issue where SAP ODP Extract was failing to write to an external table.

Driver updates

  • LinkedIn Ads driver updated 23.0.8770.0 → 23.0.8921.0.
  • Redshift driver updated 2.1.0.18 → 2.1.0.28.
  • QuickBooks Online driver updated 21.0.8137.0 → 23.0.8839.0.

Matillion ETL version 1.75.2

2024 - May 20th

Improvements and bug fixes

  • Fixed an issue where timestamps were showing only the date when loading data into Databricks.
  • Fixed a number of reported vulnerabilities.
  • Fixed an issue where clients could not connect if all optional features were disabled.
  • Improve logging under high websocket loads.
  • Fixed an issue with the Salesforce Output component where single quotes were not escaped properly when building the "Insert into" cloud data warehouse SQL statement for errored/rejected records.

Driver updates

Apache Hive and Apache Spark

  • Apache Hive driver updated 22.0.8326.0 → 23.0.8839.0.
  • Apache Spark driver updated 22.0.8322.0 → 23.0.8839.0.

Warning

These driver updates are a breaking change. You will need to replace any Apache Hive and Apache Spark components with fresh versions of each component.

Facebook and Facebook Ads

  • Facebook driver updated 23.0.8565.0 → 23.0.8889.0.
  • Facebook and Facebook Ads driver updated to use Marketing API version v19.

Warning

The Facebook Marketing API v17.0 expires on May 14th, 2024. Use the Connection Options property to manually set the API version to a current version—for example, v18.0 or v19.0.

To do this:

  1. Open the Connection Options property.
  2. Click +.
  3. Set Parameter to "Other".
  4. Set Value to, for example, "MarketingAPIVersion=19.0" or "GraphAPIVersion=19.0".

Read Available Marketing API Versions for more information.

Matillion ETL version 1.75.0

Warning

If you're using Matillion ETL on Azure, this release is available as version 1.75.1 in the Azure marketplace. However, within Matillion ETL, the version will read correctly as 1.75.0.

Warning

After further testing of our automatic security updates feature, we have discovered that certain customer configurations may experience system instability. Therefore, we have temporarily disabled this feature in 1.75.0.

Users can still perform security upgrades by logging in to their instances and running the normal Yum update command yum update --security. As always, Matillion ETL should be restarted after such updates.

2024 - May 2nd

Key Updates

All platforms

  • The underlying operating system Matillion ETL runs on has been upgraded to CentOS Stream 9.
  • The latest versions of the dbt libraries don't work with Matillion ETL, so we provide library versions that are known to work.
  • Migration of credentials to a new Matillion ETL instance is performed faster, and migration is completed more efficiently.
  • Improved performance of OpenID authentication.
  • Allowed the installation of the end-of-life Python 2 version by default.
  • Allowed SQL queries to be stored in full in the Tomcat logs, rather than the default "trim" behaviour, using a menu toggle.

Snowflake

  • When a job including the Commands for dbt Core component was cancelled, the queries sent from dbt to Snowflake would continue to run until completion. This behaviour has been changed so the dbt query is cancelled if the job is cancelled.

New features and improvements

All platforms

  • Following a Shopify API driver update, the App ID property has been removed from the Shopify Query component.
  • Removed some included libraries that may have led to potential security vulnerabilities.

Bug fixes

All platforms

  • Fixed an issue that could cause large numbers of threads to be created when uploading to an S3 storage bucket.
  • Fixed an issue in the Salesforce Output component where certain column mappings could cause the component to fail to run.
  • Fixed an issue with filters not working correctly in the SAP ODP Extract component.
  • Added an optional feature to allow disabling of the Store in component field in all components' password dialogs.
  • Fixed an issue where scheduled jobs would not trigger.
  • Fixed an issue where Matillion ETL could become unresponsive when using Git integration.
  • Fixed an issue where task_batch_history indexes were not created.
  • Security and vulnerability fixes.

Snowflake

  • Fixed an issue that was causing the Azure SQL Bulk Output component to fail.
  • Fixed an issue where the Snowflake Cloud Storage Load Generator was failing on GCP.
  • Fixed an issue that was causing the storage integrations drop-down to show no integrations when creating an external stage.
  • Fixed an issue where incorrect case was being assigned to column alias names in the Extract Nested Data component.
  • Fixed an issue in the Query Result to Scalar component that was causing it to fail in certain circumstances.
  • Fixed an issue that was causing an error following in-place upgrades of certain versions of Matillion ETL.

Delta Lake on Databricks

  • Fixed an issue that was causing the Calculator component to fail in certain scenarios.

Amazon Redshift

  • Fixed an issue where the IAM Role ARN property in the S3 Load component was a required field and should have been optional.
  • Fixed an issue in the OData Query component by issuing a new driver version.
  • Fixed an issue where Matillion ETL would become unresponsive when attempting to commit changes to a running job.

Driver updates

  • Facebook Ads driver updated 23.0.8565.0 → 23.0.8831.0.
  • Google Ads driver updated 23.0.8649.0 → 23.0.8770.0.
  • HubSpot driver updated 21.0.8130.0 → 23.0.8767.0.
  • Jira driver updated 23.0.8579.0 → 23.0.8677.0.
  • LinkedIn driver updated 22.0.8389.0 → 23.0.8770.0. This affects both LinkedIn Query and LinkedIn Ads Query components.
  • MongoDB driver updated 23.0.8749.0 → 23.0.8799.0. This fixes an issue where instances of the MongoDB Query component could incorrectly return NULL rows.
  • OData driver updated 21.0.8180.0 → 23.0.8771.0. This update fixes a bug that was causing OData Query to fail.
  • Shopify API driver updated 21.0.8137.0 → 23.0.8771.0.
  • org.postgresql:postgresql library updated 42.5.4 → 42.7.2 to address a critical vulnerability in the library.
© Copyright 2024 Matillion Ltd | Legal | Privacy Policy | Disclaimer | Modern Slavery Statement