1.64 release notes

Below, you can find release notes for Matillion ETL version 1.64.x

Warning

Long-term support (LTS) for version 1.64 has now ended. Read Matillion ETL supported releases to view currently supported versions.

Matillion ETL version 1.64.21

2024 - February 9th

Improvements and bug fixes

Fixed an issue where users couldn't load JSON data into Google BigQuery using API Extract.
Fixed an issue where API Extract was not accepting Boolean as a last page parameter for page-based pagination.

Driver updates

Jira API driver updated 23.0.8579.0 → 23.0.8677.0.
MongoDB API driver updated 22.0.8389.0 → 23.0.8749.0. This driver update fixes an issue where jobs could hang at validation.

Matillion ETL version 1.64.20

2024 - January 22nd

Improvements and bug fixes

Fixed a security vulnerability around URL redirects.

Matillion ETL version 1.64.19

2023 - December 22nd

Improvements and bug fixes

Updated the Hazelcast license key. This new license expires on 31st March, 2026. The maximum number of nodes in a cluster is consequently increased from the current 6 nodes to 9,999 nodes, which greatly increases potential throughput if needed. Read Instances update note for Hazelcast v3 to learn more.

Matillion ETL version 1.64.17

2023 - October 20th

Driver updates

Snowflake JDBC driver updated 3.13.18 → 3.13.26.

Matillion ETL version 1.64.16

2023 - August 21st

Improvements

Added an improvement to prevent temporary file handles from being lost when staging from empty tables.

Driver updates

Jira API driver updated 21.0.8137.0 → 23.0.8579.0
- This update fixes a bug where custom column values were not returned correctly beyond the first page.

Matillion ETL version 1.64.15

2023 - June 5th

Improvements

Added a security patch to instruct search engines to not index Matillion ETL.

Bug fixes

Fixed an issue where 'UpdatedTaskQueue' messages were unintentionally included in the audit log.
Fixed an issue where the RDS Bulk Output component did not work as expected with MySQL and Postgres.

Matillion ETL version 1.64.14

2023 - May 5th

Bug fixes

Fixed an issue where an instance migration would complete without successfully exporting Matillion ETL users stored in a Matillion ETL database.
Fixed an issue to improve clarity of logging with regards to task and job execution status.
Fixed an issue to allow script variable and output size limits to be defined via environment variables (MAX_SCRIPT_SIZE default 5000000; MAX_VARIABLE_SIZE default 1000) to enable control of potential out-of-memory (OOM) on scripting components.
Fixed an issue where a user's selected environment would not persist on logging out and back in and would instead default to the project's default environment. Now, when a user logs out and back in, their most recently selected environment will be the environment they selected before logging out.

Matillion ETL version 1.64.13

2023 - March 31st

New features and improvements

Added a drop-down menu for selecting long-term support (LTS) version updates. If you're running the latest LTS version, there will be no available version to update to.
A scheduled job that misses its scheduled time (by default, within 30 seconds of its scheduled time) is declared a misfire. When a misfire is detected, it will now show in the task history decorated with a new "misfire" icon. This should make it clearer when misfires are detected and what that means for misfire handling. These events will not appear when the Ignore Misfire option is selected when creating a schedule.

Bug fixes

Fixed an issue where application performance could be limited by an excessive message task queue size.
Fixed an issue where API Extract requests were not handling null responses as expected.
Fixed an issue where when a variable was being used in a URL path and / was appended to the end, the variable would be duplicated in the path.
Fixed an issue where Git "fetch" operations were failing due to a bug in Apache on Azure.

Driver updates

Google Ads API driver updated 22.0.8353.0 → 22.0.8432.0
Couchbase API driver updated 21.0.8011.0 → 22.0.8322.0

Matillion ETL version 1.64.11

2022 - August 9th

Upgraded Manage Change Data Capture (CDC) S3 Creation Lambda function to Python 3.9 (was 3.6).

Matillion ETL version 1.64.10

2022 - July 25th

Added EU Central Sandbox to the list of endpoints available in the Zuora Bulk Query component.

Matillion ETL version 1.64.9

2022 - July 22nd

Fixed an issue in Manage SQS Configuration where SQS cancellation queue was not being reloaded at server startup.
Fixed an issue where sending a batch too large to Salesforce using the Salesforce Output component would cause Matillion ETL to hang until cancelled.
Updated the list of Zuora endpoints for Zuora Query, and now allow arbitrary endpoints to be configured.

Matillion ETL version 1.64.8

2022 - July 15th

Provided the option to post 'cancelled' Matillion ETL jobs to an SQS queue, similar to the 'success' and 'failure' queues.
Fixed an issue where an outdated cryptography library provided by a JDBC driver might be used for new connections, causing connection errors with specific encryption methods.
Updated base CentOS image from 7.7 to 7.9 for published VM images. In-place upgrade customers are not affected by this change.

Matillion ETL version 1.64.7

2022 - June 21st

Tech notes

New features and improvements

All platforms

Versioned the Shopify Query component (deprecated the component and replaced it with a new version of the Shopify Query component).
Versioned the Splunk Query component (deprecated the component and replaced it with a new version of the Splunk Query component).
Updated the Gmail Query component to include a new parameter, Data Schema. Users can set this to either IMAP or REST.
Updated the Calculator component to include a grid variable dialog as an alternative to the expression editor.
Updated Manage Schedules dialog. When you click into a schedule's Task Info, a separate Task Info dialog opens. Click OK to close this Task Info dialog and return to Manage Schedules.
NULL values in Matillion ETL now display as italicized, capitalized, and with a grey text color (#757575). This change is to avoid confusion where a non-NULL value is Null. For example, if a person's surname is literally Null, for example, Jane Null or Tom Null.
Updated Zero Copy Clone in the following ways:
- Added Run job in clone functionality. You can run any transformation or orchestration job using a cloned database. This lets you to test the job on data that mirrors that in your production environment, without affecting your production data.
- Improved error messages in the clone environment and database dialog.
New Shared Job Git API endpoints are available including:
- Switch commit
- Delete branch
- Get state (logs)
- Create branch (on current commit)
The Payload field in Manage Error Reporting is no longer editable when using a payload template that isn't [Custom]. These payloads are now read-only. Use Manage Webhook Payloads to edit payloads.

Amazon Redshift

The Avro file format is now available for the following components for Matillion ETL for Redshift:

Deprecation

All platforms

The Google AdWords Query component is now disabled. This component was deprecated in version 1.62.7.

Bug fixes

All platforms

Fixed an issue where maliciously altered exported jobs could be used for a Cross-Site Scripting (XSS) attack on import.
Fixed an issue to make sure that Excel Query components running in iterators are consistently associated with their files.
Updated Snowflake JDBC driver to latest version (3.13.18). This corrects a proxy regression, among other improvements.
Fixed an issue where the API Extract component and Manage Extract Profiles wizard didn't pass a correct bearer token when Authentication Type = Bearer Token.
Fixed an issue where additional parameters didn't pass in the request to get the Access Token when configuring an API OAuth, when Grant Type = Client Credentials.

Delta Lake on Databricks

Fixed an issue where row counts were reported as 0 when Query components had executed despite the actual number of staged rows displaying correctly during job execution.
Fixed an issue where certain components would not present metadata in the correct casing when using aliasing on columns.

Amazon Redshift, Azure Synapse Analytics

Fixed an issue where the Create External Table component parameter Table Metadata didn't open successfully when the value of the data type in the dialog was NULL.

Driver updates

Bing Search API driver updated. 20.0.7662.0 → 21.0.8152.0
Dynamics 365 API driver updated. 19.0.7156.0 → 21.0.8137.0
Elasticsearch API driver updated. 20.0.7662.0 → 21.0.8137.0
Email API driver updated. 19.0.7354.0 → 21.0.8137.0
Excel API driver updated. 21.0.7829.0 → 21.0.8137.0
HubSpot API driver updated. 21.0.7907.0 → 21.0.8130.0
Google BigQuery API driver updated. 21.0.7930.0 → 21.0.8152.0
LDAP API driver updated. 15.0.6121.0 → 21.0.8137.0
Sage Intacct API driver updated. 19.0.7121.0 → 21.0.8137.0
ServiceNow API driver updated. 21.0.7930.0 → 21.0.8137.0
Shopify API driver updated. 19.0.7485.0 → 21.0.8137.0
Splunk API driver updated. 19.0.7216.0 → 21.0.8137.0
Square API driver updated. 21.0.7867.0 → 21.0.8137.0
SurveyMonkey API driver updated. 20.0.7662.0 → 21.0.8137.0
YouTube Analytics API driver updated. 20.0.7628.0 → 21.0.8137.0
Zoho CRM API driver updated. 20.0.7662.0 → 21.0.8137.0

Community ideas

The following community ideas were selected for development for this release.