Skip to content

1.72 release notes

Below, you can find release notes for Matillion ETL version 1.72.x

1.72 is a long-term support (LTS) release. Long-term support for version 1.61 has now ended. Read about Matillion ETL supported releases to learn more.

Matillion ETL version 1.72.23

2024 - November 20th

Improvements and bug fixes

All platforms

Matillion ETL version 1.72.22

2024 - November 7th

Improvements and bug fixes

  • Fixed an issue where OAuth for Dynamics 365 would not refresh. Now, Matillion ETL automatically sets InitiateOAuth=GETANDREFRESH for Dynamics 365 to auto refresh the OAuth.
  • Enabled the use of a deprecated MongoDB connector to avoid existing jobs breaking, due to persistence issues with the current MongoDB connector.
  • Improved Matillion ETL FIFO queues in the SQS Message component to include MessageID and MessageDeDuplicationID parameters to circumvent error software.amazon.awssdk.services.sqs.model.SqsException: The request must contain the parameter MessageGroupId. (Service: Sqs, Status Code: 400, Request ID: ea63b15d-a78d-52be-9b37-eccd69056a3b)..
  • Added an improvement to use an alternative algorithm for masking secrets in the log files that does not risk out-of-memory issues.
  • Fixed an issue in Matillion ETL for Delta Lake on Databricks where views were not displaying in the Views drop-down menu in the Environments panel.

Matillion ETL version 1.72.21

2024 - October 23rd

Improvements and bug fixes

All platforms

  • Fixed an issue where the Data Transfer component would time out while attempting to authenticate to an SFTP service.
  • Added a feature switch to allow disabling of password autocompletion in the user's browser.
  • Fixed a potential security vulnerability in the user interface.
  • Fixed a bug in the Performance monitor that was preventing metrics being displayed in the Performance tab.

AWS Redshift

  • Fixed an issue that caused intermittent failures in transformation jobs that include a Table Input component.

Google BigQuery

  • Fixed a bug that was causing an error when the API Extract component created a table.

Driver updates

  • Google Ads driver updated 23.0.8649.0 → 24.0.9029.0, to allow the use of API v16.
  • SharePoint driver updated 21.0.8151.0 → 24.0.9001.0, to resolve an issue that was preventing queries of SharePoint lists exceeding 5000 items.

Matillion ETL version 1.72.20

2024 - October 4th

Improvements and bug fixes

All platforms

  • Fixed an issue where the Send Email component was giving an "Invalid Address" error when sending to recipients with a .teams.ms address.
  • SFTP in the Data Transfer component now supports newer encryption algorithms (ssh-rsa is no longer supported).
  • Fixed an issue where the Data Transfer component was failing when performing transfers between two different Amazon S3 bucket folders.
  • Fixed a bug with the Anaplan Bulk component to ensure complete and accurate Anaplan exports by caching and combining split rows across pages, while maintaining thread safety for reliable data processing.

AWS Redshift

Driver updates

  • Google Ads API driver updated 22.0.8432.0 → 23.0.8649.0.

Matillion ETL version 1.72.19

2024 - September 20th

Improvements and bug fixes

All platforms

  • Fixed an issue where importing/exporting jobs or downloading server logs was producing a misleading error message when the license limit was exceeded.
  • Fixed an issue where details of applied licenses weren't displayed after the instance was restarted.

Delta Lake on Databricks

  • Fixed an issue that could cause a "loading, please wait" message when accessing an instance.

Matillion ETL version 1.72.18

2024 - September 11th

Improvements and bug fixes

Snowflake on AWS

  • Fixed an issue where SAP NetWeaver Query data was being loaded to Snowflake tables as VARCHAR regardless of original data type.
  • Fixed an issue where a BYOL licence would not be inherited correctly, blocking user activity and environment configuration.

Snowflake and Redshift on AWS

  • Fixed an issue where child jobs that failed validation were showing green, not red, on the canvas.

AWS Redshift

  • Fixed an issue where thread availability could block execution of tasks.

Delta Lake on Databricks

  • Fixed an issue that was slowing the validation of transformation jobs.

Matillion ETL version 1.72.17

2024 - August 30th

Improvements and bug fixes

Snowflake on AWS

Snowflake on Azure

  • Fixed an issue that was causing out-of-memory errors on High Availability clusters.
  • Fixed an issue where jobs could fail if a large number of them were queued due to a network outage.

AWS Redshift

  • Fixed an issue where deleted API Query Profiles would be reinstated by a filesync.
  • Optimized metadata queries to align with AWS Redshift latest recommendations.

Driver updates

  • OData Query driver updated 23.0.8771.0 → 23.0.8948.0.

Matillion ETL version 1.72.16

2024 - August 13th

Improvements and bug fixes

Amazon Redshift

  • Fixed an issue that was causing intermittent screen freezes when opening a project.

Matillion ETL version 1.72.15

2024 - August 6th

Improvements and bug fixes

Databricks

  • Fixed an issue where jobs may fail to validate due to Delta Lake environment defaults not persisting.

Amazon Redshift

  • Fixed an issue where the Oracle Output component wouldn't recognize valid column names with changed case.

Google BigQuery

Driver updates

Matillion ETL version 1.72.14

2024 - July 24th

Improvements and bug fixes

All platforms

  • Fixed an issue where items in the Admin menu were duplicated when using stateless authentication.
  • Fixed an issue where the API Query component would return NULL for datetime fields due to result set caching issues.
  • Updated Guava dependencies to address the following vulnerabilities:
    • CVE-2023-2976
    • CVE-2020-8908

Driver updates

  • DynamoDB driver updated 23.0.8630.0 → 23.0.8817.0.
  • SurveyMonkey driver updated 22.0.8257.0 → 23.0.8901.0.

Matillion ETL version 1.72.13

2024 - July 5th

Improvements and bug fixes

All platforms

Snowflake on AWS

  • Fixed an issue where sampling in a Database Query component connecting to SAP via the IBM DB2 driver could cause out of memory errors.

Driver updates

Matillion ETL version 1.72.12

2024 - June 25th

Improvements and bug fixes

  • Fixed an issue where using Database Query to load columns with a data type of JSON from a MySQL table was causing an error.
  • Fixed an issue where SAP ODP Extract was failing to write to an external table.

Driver updates

  • LinkedIn Ads driver updated 23.0.8770.0 → 23.0.8921.0.
  • Redshift driver updated 2.1.0.18 → 2.1.0.28.
  • QuickBooks Online driver updated 21.0.8137.0 → 23.0.8839.0.

Matillion ETL version 1.72.11

2024 - May 20th

Improvements and bug fixes

  • Fixed an issue that was preventing an upgrade to version 1.72.x from older versions of Matillion ETL.
  • Fixed an issue where the application would freeze when trying to log in to the server.
  • Fixed an issue that was causing certain shared jobs to fail due to JSON syntax being incorrectly parsed.
  • Fixed a number of reported vulnerabilities.
  • Fixed an issue where clients could not connect if all optional features were disabled.
  • Improve logging under high websocket loads.
  • Fixed an issue with the Salesforce Output component where single quotes were not escaped properly when building the "Insert into" cloud data warehouse SQL statement for errored/rejected records.

Driver updates

Apache Hive and Apache Spark

  • Apache Hive driver updated 22.0.8326.0 → 23.0.8839.0.
  • Apache Spark driver updated 22.0.8322.0 → 23.0.8839.0.

Warning

These driver updates are a breaking change. You will need to replace any Apache Hive and Apache Spark components with fresh versions of each component.

Facebook and Facebook Ads

  • Facebook driver updated 23.0.8565.0 → 23.0.8889.0.
  • Facebook and Facebook Ads driver updated to use Marketing API version v19.

Warning

The Facebook Marketing API v17.0 expires on May 14th, 2024. Use the Connection Options property to manually set the API version to a current version—for example, v18.0 or v19.0.

To do this:

  1. Open the Connection Options property.
  2. Click +.
  3. Set Parameter to "Other".
  4. Set Value to, for example, "MarketingAPIVersion=19.0" or "GraphAPIVersion=19.0".

Read Available Marketing API Versions for more information.

Matillion ETL version 1.72.10

2024 - May 8th

Improvements and bug fixes

  • Secured Matillion ETL against the following CVEs:
    • CVE-2023-26119
    • CVE-2023-44981
  • Removed an unused SQLite 2015 library.
  • Added an improvement to assign more reasonable partition sizes for released images.
  • Improved session invalidation.

Matillion ETL version 1.72.8

2024 - April 15th

Improvements and bug fixes

  • Fixed an issue where scheduled jobs would not trigger.
  • Fixed an issue where Matillion ETL could become unresponsive when using Git integration.
  • Fixed an issue where task_batch_history indexes were not created.
  • Security and vulnerability fixes.

Matillion ETL version 1.72.7

2024 - March 1st

Improvements and bug fixes

  • Added an improvement to ensure that special characters and whitespace can be used in S3 buckets and keys.
  • Added an improvement to ensure that telemetry events created before instance start-up and acceptance are discarded.
  • Added an improvement to preserve "Ignore misfires" status when migrating schedules between instances.
  • Fixed an issue where the Join Expression Parameter dialog's default size was unreasonable.
  • Fixed an issue where the Redshift data types were cast as "serial" and "bigserial".
  • Fixed an issue in SharePoint Query to ensure that the AllSites.Read permission is requested instead of AllSites.Manage when creating an OAuth profile.
  • Miscellaneous security fixes.

Driver updates

  • LinkedIn API driver updated 22.0.8431.0 → 23.0.8770.0
  • LinkedIn Ads API driver updated 22.0.8389.0 → 23.0.8770.0

Matillion ETL version 1.72.6

2024 - February 9th

Improvements

  • Allowed SQL queries to be stored in full in the Tomcat logs, rather than the default "trim" behaviour, using a menu toggle.

Driver updates

  • Jira API driver updated 23.0.8579.0 → 23.0.8677.0.
  • MongoBD API driver updated 22.0.8389.0 → 23.0.8749.0. This driver update fixes an issue where jobs could hang at validation.
  • Salesforce API driver updated 22.0.8523.0 → 23.0.8669.0. This driver update fixes an issue where the component would hang when running JOIN or UNION queries.

Matillion ETL version 1.72.5

2024 - January 22nd

Improvements and bug fixes

  • Increased the maximum number of environments per instance to 9999 (was 999) for Hub users.
  • Fixed a security vulnerability around URL redirects.

Matillion ETL version 1.72.4

2023 - December 22nd

Improvements and bug fixes

  • Updated the Hazelcast license key. This new license expires on 31st March, 2026. The maximum number of nodes in a cluster is consequently increased from the current 6 nodes to 9,999 nodes, which greatly increases potential throughput if needed. Read Instances update note for Hazelcast v3 to learn more.

Matillion ETL version 1.72.3

2023 - November 21st

Improvements and bug fixes

  • Fixed an issue where the SSL certificate chain file could be overwritten in /etc/tomcat/server.xml.
  • Fixed an issue where SQS messages would not run in order under heavy load.
  • Fixed a caching issue on Delta Lake on Databricks instances where new tables were not recognized.
  • Added caching to retrieval of schemas in Azure Synapse instances to alleviate performance issues during and after migration.

Matillion ETL version 1.72.2

2023 - November 9th

Improvements and bug fixes

  • Fixed an issue where sampling and parameter changes were only possible for five minutes following job validation.
  • Reduced the runtime of the Salesforce Output component when capturing reject records from Snowflake.
  • Fixed an issue where non-fully qualified masking policies for Snowflake columns were producing null pointer exceptions.

Matillion ETL version 1.72.1

2023 - September 20th

New features and improvements

All platforms

  • Logo and branding updates to the Matillion ETL UI.
  • Updated Matillion ETL from Apache Tomcat version 10.1.2 to version 10.1.11.
  • Improved Task History to display schedule completion time.

Snowflake, Delta Lake on Databricks, Amazon Redshift

  • The Run dbt Command component has been renamed to Commands for dbt Core and the component has been updated in the following ways:
    • Added a Profile Config parameter for users to assign additional output parameters or override existing parameters of the profiles.yml file.
    • Renamed the parameter Map Environment Variables to Map dbt Environment Variables.

Delta Lake on Databricks

Bug fixes

  • Improved Git Integration performance by running certain repository transactions as batch processes.
  • Added an improvement to ensure that admin customizations are preserved in the server.xml file.
  • Added an improvement for batch job loading for better performance when opening large projects.
  • Fixed an issue where the Schedule Completed column in Task History was displaying incorrectly formatted values.
  • Added an improvement to optimize memory usage when there are many connected sessions.
  • Added an improvement to prevent temporary file handles from being lost when staging from empty tables.

Driver updates

  • Snowflake JDBC driver updated 3.13.26 → 3.13.28
  • Dynamics 365 Business Central API driver updated 21.0.8011.0 → 22.0.8545.0. This update fixes a bug where users could experience timeout issues when setting filters.
  • DynamoDB API driver updated 23.0.8587.0 → 23.0.8630.0
  • Facebook API driver updated 21.0.8137.0 → 23.0.8565.0
  • Facebook Ads API driver updated 22.0.8391.0 → 23.0.8565.0
  • Google Ads API driver updated 22.0.8432.0 → 23.0.8649.0
  • Jira API driver updated 22.0.8322.0 → 23.0.8579.0. This update fixes a bug where custom column values were not returned correctly beyond the first page.

Note

For Facebook Query and Facebook Ads Query, the Version connection option has been removed. This is a breaking change and any components with this option set will fail validation. Both drivers now default to v16.0 of their respective API.

© Copyright 2024 Matillion Ltd | Legal | Privacy Policy | Disclaimer | Modern Slavery Statement