Skip to content

Matillion ETL long-term support (LTS) release notes

This page lists updates to the long-term support (LTS) versions of Matillion ETL.

Read Matillion ETL support lifecycle to learn more.

Read Matillion ETL supported releases to check whether your instance's version is marked for long-term support (LTS).


Tech notes

Hazelcast upgrade requirement

Matillion ETL users will be required to upgrade to LTS or patch their instances to patch requirements concerning Hazelcast v3 before 1st April, 2024.

Matillion ETL for Redshift

If you're experiencing out-of-memory (OOM) exceptions or high CPU usage since updating to version 1.68.7 or above, read Tech note - Redshift RingBuffer exceeding expected limits for a workaround.


2024 - May 20th

Improvements and bug fixes

Item LTS versions
Fixed an issue where timestamps were showing only the date when loading data into Databricks. 1.75.2, 1.72.11
Fixed a number of reported vulnerabilities. 1.75.2, 1.72.11
Fixed an issue where clients could not connect if all optional features were disabled. 1.75.2, 1.72.11, 1.68.24
Improve logging under high websocket loads. 1.75.2, 1.72.11, 1.68.24
Fixed an issue where single quotes were not escaped properly when building the "Insert into" cloud data warehouse SQL statement. 1.75.2, 1.72.11, 1.68.24

Driver updates

Facebook and Facebook Ads

  • Facebook driver updated 23.0.8565.023.0.8889.0.
  • Facebook and Facebook Ads driver updated to use Marketing API version v19.

Warning

The Facebook Marketing API v17.0 expires on May 14th, 2024. Use the Connection Options property to manually set the API version to a current version—for example, v18.0 or v19.0.

To do this:

  1. Open the Connection Options property.
  2. Click +.
  3. Set Parameter to "Other".
  4. Set Value to, for example, "MarketingAPIVersion=19.0" or "GraphAPIVersion=19.0".

Read Available Marketing API Versions for more information.


2024 - April 15th

Improvements and bug fixes

Item LTS versions
Fixed an issue where scheduled jobs would not trigger. 1.74.6, 1.72.8, 1.68.23
Fixed an issue where Matillion ETL could become unresponsive when using Git integration. 1.74.6, 1.72.8, 1.68.23
Fixed an issue where task_batch_history indexes were not created. 1.74.6, 1.72.8, 1.68.23
Security and vulnerability fixes. 1.74.6, 1.72.8, 1.68.23

2024 - March 1st

Improvements and bug fixes

Item LTS versions
Added an improvement to ensure that special characters and whitespace can be used in S3 buckets and keys. 1.72.7
Added an improvement to ensure that telemetry events created before instance start-up and acceptance are discarded. 1.72.7
Added an improvement to preserve "Ignore misfires" status when migrating schedules between instances. 1.72.7
Added an improvement to ensure that concurrent user count is validated correctly in containerized environments. 1.72.7
Fixed an issue where the Join Expression Parameter dialog's default size was unreasonable. 1.72.7
Fixed an issue where the Redshift data types were cast as "serial" and "bigserial". 1.72.7
Fixed an issue in SharePoint Query to ensure that the AllSites.Read permission is requested instead of AllSites.Manage when creating an OAuth profile. 1.72.7, 1.68.22

Driver updates

Item LTS versions
LinkedIn API driver updated 22.0.8431.023.0.8770.0 1.72.7, 1.68.22
LinkedIn Ads API driver updated 22.0.8389.023.0.8770.0 1.72.7, 1.68.22

2024 - February 9th

Improvements and bug fixes

Item LTS versions
Fixed an issue where users couldn't load JSON data into Google BigQuery using API Extract. 1.68.21, 1.64.21
Fixed an issue where API Extract was not accepting Boolean as a last page parameter for page-based pagination. 1.68.21, 1.64.21

Driver updates

Item LTS versions
Jira API driver updated 23.0.8579.023.0.8677.0. 1.72.6, 1.68.21, 1.64.21
MongoBD API driver updated 22.0.8389.023.0.8749.0. This driver update fixes an issue where jobs could hang at validation. 1.72.6, 1.68.21, 1.64.21
Salesforce API driver updated 22.0.8523.023.0.8669.0. This driver update fixes an issue where the component would hang when running JOIN or UNION queries. 1.72.6, 1.68.21

2024 - January 22nd

Improvements and bug fixes

Item LTS versions
Increased the maximum number of environments per instance to 9999 (was 999) for Hub users. 1.72.5
Fixed a security vulnerability around URL redirects. 1.72.5, 1.68.20, 1.64.20

2023 - December 22nd

Improvements and bug fixes

Item LTS versions
Updated the Hazelcast license key. This new license expires on 31st March, 2026. The maximum number of nodes in a cluster is consequently increased from the current 6 nodes to 9,999 nodes, which greatly increases potential throughput if needed. Read Instances update note for Hazelcast v3 to learn more. 1.72.4, 1.68.19, 1.64.19
Fixed an issue where the Matillion ETL UI could be unresponsive after upgrading to version 1.68.16. 1.68.19

2023 - November 21st

Improvements and bug fixes

Item LTS versions
Fixed an issue where the SSL certificate chain file could be overwritten in /etc/tomcat/server.xml. 1.72.3
Fixed an issue where SQS messages would not run in order under heavy load. 1.72.3, 1.68.18
Fixed a caching issue on Delta Lake on Databricks instances where new tables were not recognized. 1.72.3, 1.68.18
Added caching to retrieval of schemas in Azure Synapse instances to alleviate performance issues during and after migration. 1.72.3, 1.68.18

2023 - November 9th

Improvements and bug fixes

Item LTS versions
Fixed an issue where sampling and parameter changes were only possible for five minutes following job validation. 1.72.2
Fixed an issue where non-fully qualified masking policies for Snowflake columns were producing null pointer exceptions. 1.72.2
Reduced the runtime of the Salesforce Output component when capturing reject records from Snowflake. 1.72.2, 1.68.17
Fixed an issue where users couldn't delete stale Git branches in the local repository in Matillion ETL. 1.68.17
Improved Git Integration performance by running certain repository transactions as batch processes. 1.68.17
Fixed an issue that caused a project to break if a job was deleted before validation had finished. 1.68.17

2023 - October 26th

Bug fixes

Item LTS versions
Fixed an issue where validated transformation jobs could become invalidated and require revalidation. 1.68.16

2023 - October 20th

Driver updates

Item LTS versions
Snowflake JDBC driver updated 3.13.183.13.26. 1.68.15, 1.64.17

2023 - October 2nd

Bug fixes

Item LTS versions
Fixed an issue where some users couldn't perform an in-place upgrade using the Matillion ETL UI to versions 1.68.8 or higher. 1.68.14
Fixed an issue where Matillion ETL could become unresponsive and schedules could stop running when performing a Git checkout. 1.68.14
Fixed an issue where the Schedule Completed column in Task History was displaying incorrectly formatted values. 1.68.14
Fixed an issue where a Matillion ETL instance's protocol could be inadvertently set to HTTPS instead of HTTP. 1.68.14

Driver updates

Item LTS versions
Postgres JDBC driver updated 42.3.442.5.4 1.68.14
MongoDB API driver updated 21.0.8221.022.0.8389.0. 1.68.14

2023 - August 21st

New features and improvements

Item LTS versions
Added a Performance monitor that displays key real-time performance metrics for the Matillion ETL instance. 1.68.13
Added an improvement to prevent temporary file handles from being lost when staging from empty tables. 1.68.13, 1.64.16
Added an improvement to ensure that admin customizations are preserved in the server.xml file. 1.68.13
Added an improvement for batch job loading for better performance when opening large projects. 1.68.13
Improved Task History to display schedule completion time. 1.68.13

Driver updates

Item LTS versions
Dynamics 365 Business Central API driver updated 21.0.8011.022.0.8545.0. This update fixes a bug where users could experience timeout issues when setting filters. 1.68.13
Jira API driver updated 21.0.8137.023.0.8579.0. This update fixes a bug where custom column values were not returned correctly beyond the first page. 1.68.13, 1.64.16

2023 - June 15th

Improvements

Item LTS versions
The maximum number of environments for Hub instances has been increased to 9999 (previously 999). 1.68.12

Bug fixes

Item LTS versions
Fixed an issue where the Task tab was displaying activity at a project group level instead of a project level. 1.68.12
Fixed an issue where users were unable to create or edit an environment on Matillion ETL for Redshift after updating to version 1.68.7. 1.68.12

2023 - June 5th

Improvements

Item LTS versions
Added an improvement to enable TLS protocols to be restricted in the SSL menu. 1.68.11
Improved the performance of script editors when a project includes large numbers of jobs. 1.68.11
Added a security patch to instruct search engines to not index Matillion ETL. 1.68.11, 1.64.15, 1.61.10

Bug fixes

Item LTS versions
Reduced memory requirements for the Task History view. 1.68.11
Fixed a validation error when environment variables are used to configure shared jobs. 1.68.11
Fixed an issue where 'UpdatedTaskQueue' messages were unintentionally included in the audit log. 1.64.15, 1.61.10
Fixed an issue where the RDS Bulk Output component did not work as expected with MySQL and Postgres. 1.64.15, 1.61.10

2023 - May 18th

Bug fixes

Item LTS versions
Fixed an issue where the RDS Bulk Output component did not work as expected with MySQL and Postgres. 1.68.10
Fixed an issue where required roles would be missing from Tomcat user configuration when using the universal installer. 1.68.10
Fixed an issue where a Matillion ETL major version was not being parsed properly on the universal installer, leading to failure to build specific 1.70 releases. 1.68.10
Reinstated missing out-of-memory script property for universal installer on 1.68 and earlier versions. 1.68.10
Resolved issues preventing login on RHEL8 instances after running the universal installer. 1.68.10
In the Data Transfer component, FTP would always use the port 21 and ignore any host:port part of a configuration. Now, FTP will respect the :port part of any URL, allowing the component to use non-standard FTP ports for connection. 1.68.10
Fixed an issue where the Data Transfer component encountered a "pipe closed" error when transferring a zip file and unpacking it to the target location. 1.68.10
Fixed an issue where 'UpdatedTaskQueue' messages were unintentionally included in the audit log. 1.68.10

2023 - May 5th

Bug fixes

Item LTS versions
Fixed an issue where the Salesforce Output component would fail because fields that began with a comma were not being enclosed in double quotes. 1.68.9
Fixed an issue where the Google Analytics Query component would not return any data when the query included an IS LIKE clause. 1.68.9
Fixed an issue where the Google Analytics Query component was incorrectly using a page size of 200 immutably. The page size now defaults to the maximum value, 10,000, and the connection option works as expected if you wish to lower this number. 1.68.9
Fixed an issue where an instance migration would complete without successfully exporting Matillion ETL users stored in a Matillion ETL database. 1.68.9, 1.64.14, 1.61.9
Fixed an issue to improve clarity of logging with regards to task and job execution status. 1.64.14, 1.61.9
Fixed an issue to allow script variable and output size limits to be defined via environment variables (MAX_SCRIPT_SIZE default 5000000; MAX_VARIABLE_SIZE default 1000) to enable control of potential out-of-memory (OOM) on scripting components. 1.64.14, 1.61.9
Fixed an issue where a user's selected environment would not persist on logging out and back in and would instead default to the project's default environment. Now, when a user logs out and back in, their most recently selected environment will be the environment they selected before logging out. 1.64.14
Upgraded Manage Change Data Capture (CDC) S3 Creation Lambda function to Python 3.9 (was 3.6). 1.61.9
Updated base CentOS image from 7.7 to 7.9 for published VM images. In-place upgrade customers are not affected by this change. 1.61.9
Fixed an issue where an outdated cryptography library provided by a JDBC driver might be used for new connections, causing connection errors with specific encryption methods. 1.61.9
Fixed an issue in Matillion ETL for Redshift where the Create External Table component parameter Table Metadata didn't open successfully when the value of the data type in the dialog was NULL. 1.61.9
Fixed an issue in Matillion ETL for Delta Lake on Databricks where certain components would not present metadata in the correct casing when using aliasing on columns. 1.61.9
Fixed an issue where additional parameters didn't pass in the request to get the Access Token when configuring an API OAuth, when Grant Type = Client Credentials. 1.61.9

Driver updates

  • Google Analytics driver updated 21.0.8137.022.0.8516.0
  • Salesforce driver updated 22.0.8466.022.0.8511.0

2023 - May 2nd

New features and improvements

Item LTS versions
Added the option to allow users of Git integration to switch branches while jobs are still running. 1.68.8

Bug fixes

Item LTS versions
Fixed an issue to improve clarity of logging with regards to task and job execution status. 1.68.8
Fixed an issue to allow script variable and output size limits to be defined via environment variables (MAX_SCRIPT_SIZE default 5000000; MAX_VARIABLE_SIZE default 1000) to enable control of potential out-of-memory (OOM) on scripting components. 1.68.8

2023 - March 31st

New features and improvements

Item LTS versions
Added a drop-down menu for selecting long-term support (LTS) version updates. If you're running the latest LTS version, there will be no available version to update to. 1.68.7, 1.64.13, 1.61.8
A scheduled job that misses its scheduled time (by default, within 30 seconds of its scheduled time) is declared a misfire. When a misfire is detected, it will now show in the task history decorated with a new "misfire" icon. This should make it clearer when misfires are detected and what that means for misfire handling. These events will not appear when the Ignore Misfire option is selected when creating a schedule. 1.68.7, 1.64.13, 1.61.8

Bug fixes

Item LTS versions
Fixed an issue where the Data Transfer component encountered a "pipe closed" error when transferring a zip file and unpacking it to the target location. 1.68.7
Fixed an issue where application performance could be limited by an excessive message task queue size. 1.68.7, 1.64.13
Fixed an issue where API Extract requests were not handling null responses as expected. 1.68.7, 1.64.13
Fixed an issue where a feature flag was stopping stateless authentication from working as expected. 1.68.7
Fixed an issue where the Data Transfer component did not timeout during an SFTP file transfer. 1.68.7
Fixed an issue where when a variable was being used in a URL path and / was appended to the end, the variable would be duplicated in the path. 1.68.7, 1.64.13, 1.61.8
Fixed an issue where Git "fetch" operations were failing due to a bug in Apache on Azure. 1.64.13, 1.61.8

Driver updates

Item LTS versions
Salesforce API driver updated 22.0.8356.022.0.8466.0 1.68.7
Google Ads API driver updated 22.0.8353.022.0.8432.0 1.68.7, 1.64.13, 1.61.8
Couchbase API driver updated 21.0.8011.022.0.8322.0 1.64.13, 1.61.8