1.72 release notes
Below, you can find release notes for Matillion ETL version 1.72.x
1.72 is a long-term support (LTS) release. Long-term support for version 1.61 has now ended. Read about Matillion ETL supported releases to learn more.
Matillion ETL version 1.72.21
2024 - October 23rd
Improvements and bug fixes
All platforms
- Fixed an issue where the Data Transfer component would time out while attempting to authenticate to an SFTP service.
- Added a feature switch to allow disabling of password autocompletion in the user's browser.
- Fixed a potential security vulnerability in the user interface.
- Fixed a bug in the Performance monitor that was preventing metrics being displayed in the Performance tab.
AWS Redshift
- Fixed an issue that caused intermittent failures in transformation jobs that include a Table Input component.
Google BigQuery
- Fixed a bug that was causing an error when the API Extract component created a table.
Driver updates
- Google Ads driver updated
23.0.8649.0
→24.0.9029.0
, to allow the use of API v16. - SharePoint driver updated
21.0.8151.0
→24.0.9001.0
, to resolve an issue that was preventing queries of SharePoint lists exceeding 5000 items.
Matillion ETL version 1.72.20
2024 - October 4th
Improvements and bug fixes
All platforms
- Fixed an issue where the Send Email component was giving an "Invalid Address" error when sending to recipients with a
.teams.ms
address. - SFTP in the Data Transfer component now supports newer encryption algorithms (ssh-rsa is no longer supported).
- Fixed an issue where the Data Transfer component was failing when performing transfers between two different Amazon S3 bucket folders.
- Fixed a bug with the Anaplan Bulk component to ensure complete and accurate Anaplan exports by caching and combining split rows across pages, while maintaining thread safety for reliable data processing.
AWS Redshift
- Fixed an issue where overlapping transactions in different jobs called by Run Transformation or Run Orchestration components were causing serialization violation errors.
Driver updates
- Google Ads API driver updated
22.0.8432.0
→23.0.8649.0
.
Matillion ETL version 1.72.19
2024 - September 20th
Improvements and bug fixes
All platforms
- Fixed an issue where importing/exporting jobs or downloading server logs was producing a misleading error message when the license limit was exceeded.
- Fixed an issue where details of applied licenses weren't displayed after the instance was restarted.
Delta Lake on Databricks
- Fixed an issue that could cause a "loading, please wait" message when accessing an instance.
Matillion ETL version 1.72.18
2024 - September 11th
Improvements and bug fixes
Snowflake on AWS
- Fixed an issue where SAP NetWeaver Query data was being loaded to Snowflake tables as VARCHAR regardless of original data type.
- Fixed an issue where a BYOL licence would not be inherited correctly, blocking user activity and environment configuration.
Snowflake and Redshift on AWS
- Fixed an issue where child jobs that failed validation were showing green, not red, on the canvas.
AWS Redshift
- Fixed an issue where thread availability could block execution of tasks.
Delta Lake on Databricks
- Fixed an issue that was slowing the validation of transformation jobs.
Matillion ETL version 1.72.17
2024 - August 30th
Improvements and bug fixes
Snowflake on AWS
- Fixed an intermittent validation error that was affecting the Microsoft SQL Server Output component.
- Fixed an issue where a required connection property couldn't be set in the Dynamics CRM Query component.
Snowflake on Azure
- Fixed an issue that was causing out-of-memory errors on High Availability clusters.
- Fixed an issue where jobs could fail if a large number of them were queued due to a network outage.
AWS Redshift
- Fixed an issue where deleted API Query Profiles would be reinstated by a filesync.
- Optimized metadata queries to align with AWS Redshift latest recommendations.
Driver updates
- OData Query driver updated
23.0.8771.0
→23.0.8948.0
.
Matillion ETL version 1.72.16
2024 - August 13th
Improvements and bug fixes
Amazon Redshift
- Fixed an issue that was causing intermittent screen freezes when opening a project.
Matillion ETL version 1.72.15
2024 - August 6th
Improvements and bug fixes
Databricks
- Fixed an issue where jobs may fail to validate due to Delta Lake environment defaults not persisting.
Amazon Redshift
- Fixed an issue where the Oracle Output component wouldn't recognize valid column names with changed case.
Google BigQuery
- Fixed an issue where the Query Result to Scalar component wasn't handling null values.
Driver updates
- Marketo Query driver updated
23.0.8565.0
→23.0.8669.0
.
Matillion ETL version 1.72.14
2024 - July 24th
Improvements and bug fixes
All platforms
- Fixed an issue where items in the Admin menu were duplicated when using stateless authentication.
- Fixed an issue where the API Query component would return NULL for datetime fields due to result set caching issues.
- Updated Guava dependencies to address the following vulnerabilities:
- CVE-2023-2976
- CVE-2020-8908
Driver updates
- DynamoDB driver updated
23.0.8630.0
→23.0.8817.0
. - SurveyMonkey driver updated
22.0.8257.0
→23.0.8901.0
.
Matillion ETL version 1.72.13
2024 - July 5th
Improvements and bug fixes
All platforms
- Added additional disk usage metrics to performance monitor.
Snowflake on AWS
- Fixed an issue where sampling in a Database Query component connecting to SAP via the IBM DB2 driver could cause out of memory errors.
Driver updates
- Dynamics 365 Query driver updated
21.0.8124.0
→23.0.8839.0
.
Matillion ETL version 1.72.12
2024 - June 25th
Improvements and bug fixes
- Fixed an issue where using Database Query to load columns with a data type of JSON from a MySQL table was causing an error.
- Fixed an issue where SAP ODP Extract was failing to write to an external table.
Driver updates
- LinkedIn Ads driver updated
23.0.8770.0
→23.0.8921.0
. - Redshift driver updated
21.0.18
→21.0.28
. - QuickBooks Online driver updated
21.0.8137.0
→23.0.8839.0
.
Matillion ETL version 1.72.11
2024 - May 20th
Improvements and bug fixes
- Fixed an issue that was preventing an upgrade to version 1.72.x from older versions of Matillion ETL.
- Fixed an issue where the application would freeze when trying to log in to the server.
- Fixed an issue that was causing certain shared jobs to fail due to JSON syntax being incorrectly parsed.
- Fixed a number of reported vulnerabilities.
- Fixed an issue where clients could not connect if all optional features were disabled.
- Improve logging under high websocket loads.
- Fixed an issue with the Salesforce Output component where single quotes were not escaped properly when building the "Insert into" cloud data warehouse SQL statement for errored/rejected records.
Driver updates
Apache Hive and Apache Spark
- Apache Hive driver updated
22.0.8326.0
→23.0.8839.0
. - Apache Spark driver updated
22.0.8322.0
→23.0.8839.0
.
Warning
These driver updates are a breaking change. You will need to replace any Apache Hive and Apache Spark components with fresh versions of each component.
Facebook and Facebook Ads
- Facebook driver updated
23.0.8565.0
→23.0.8889.0
. - Facebook and Facebook Ads driver updated to use Marketing API version
v19
.
Warning
The Facebook Marketing API v17.0 expires on May 14th, 2024. Use the Connection Options property to manually set the API version to a current version—for example, v18.0 or v19.0.
To do this:
- Open the Connection Options property.
- Click +.
- Set Parameter to "Other".
- Set Value to, for example, "MarketingAPIVersion=19.0" or "GraphAPIVersion=19.0".
Read Available Marketing API Versions for more information.
Matillion ETL version 1.72.10
2024 - May 8th
Improvements and bug fixes
- Secured Matillion ETL against the following CVEs:
- CVE-2023-26119
- CVE-2023-44981
- Removed an unused SQLite 2015 library.
- Added an improvement to assign more reasonable partition sizes for released images.
- Improved session invalidation.
Matillion ETL version 1.72.8
2024 - April 15th
Improvements and bug fixes
- Fixed an issue where scheduled jobs would not trigger.
- Fixed an issue where Matillion ETL could become unresponsive when using Git integration.
- Fixed an issue where
task_batch_history
indexes were not created. - Security and vulnerability fixes.
Matillion ETL version 1.72.7
2024 - March 1st
Improvements and bug fixes
- Added an improvement to ensure that special characters and whitespace can be used in S3 buckets and keys.
- Added an improvement to ensure that telemetry events created before instance start-up and acceptance are discarded.
- Added an improvement to preserve "Ignore misfires" status when migrating schedules between instances.
- Fixed an issue where the Join Expression Parameter dialog's default size was unreasonable.
- Fixed an issue where the Redshift data types were cast as "serial" and "bigserial".
- Fixed an issue in SharePoint Query to ensure that the
AllSites.Read
permission is requested instead ofAllSites.Manage
when creating an OAuth profile. - Miscellaneous security fixes.
Driver updates
- LinkedIn API driver updated
22.0.8431.0
→23.0.8770.0
- LinkedIn Ads API driver updated
22.0.8389.0
→23.0.8770.0
Matillion ETL version 1.72.6
2024 - February 9th
Improvements
- Allowed SQL queries to be stored in full in the Tomcat logs, rather than the default "trim" behaviour, using a menu toggle.
Driver updates
- Jira API driver updated
23.0.8579.0
→23.0.8677.0
. - MongoBD API driver updated
22.0.8389.0
→23.0.8749.0
. This driver update fixes an issue where jobs could hang at validation. - Salesforce API driver updated
22.0.8523.0
→23.0.8669.0
. This driver update fixes an issue where the component would hang when running JOIN or UNION queries.
Matillion ETL version 1.72.5
2024 - January 22nd
Improvements and bug fixes
- Increased the maximum number of environments per instance to 9999 (was 999) for Hub users.
- Fixed a security vulnerability around URL redirects.
Matillion ETL version 1.72.4
2023 - December 22nd
Improvements and bug fixes
- Updated the Hazelcast license key. This new license expires on 31st March, 2026. The maximum number of nodes in a cluster is consequently increased from the current 6 nodes to 9,999 nodes, which greatly increases potential throughput if needed. Read Instances update note for Hazelcast v3 to learn more.
Matillion ETL version 1.72.3
2023 - November 21st
Improvements and bug fixes
- Fixed an issue where the SSL certificate chain file could be overwritten in
/etc/tomcat/server.xml
. - Fixed an issue where SQS messages would not run in order under heavy load.
- Fixed a caching issue on Delta Lake on Databricks instances where new tables were not recognized.
- Added caching to retrieval of schemas in Azure Synapse instances to alleviate performance issues during and after migration.
Matillion ETL version 1.72.2
2023 - November 9th
Improvements and bug fixes
- Fixed an issue where sampling and parameter changes were only possible for five minutes following job validation.
- Reduced the runtime of the Salesforce Output component when capturing reject records from Snowflake.
- Fixed an issue where non-fully qualified masking policies for Snowflake columns were producing null pointer exceptions.
Matillion ETL version 1.72.1
2023 - September 20th
New features and improvements
All platforms
- Logo and branding updates to the Matillion ETL UI.
- Updated Matillion ETL from Apache Tomcat version 10.1.2 to version 10.1.11.
- Improved Task History to display schedule completion time.
Snowflake, Delta Lake on Databricks, Amazon Redshift
- The Run dbt Command component has been renamed to Commands for dbt Core and the component has been updated in the following ways:
- Added a
Profile Config
parameter for users to assign additional output parameters or override existing parameters of theprofiles.yml
file. - Renamed the parameter
Map Environment Variables
toMap dbt Environment Variables
.
- Added a
Delta Lake on Databricks
- Added the JDBC Incremental Load component.
- Added the Salesforce Incremental Load component.
- Added support for the Metadata API endpoint.
- Updated the Start Cluster component to always use the environment's default cluster.
- Updated the Run Delta Live Table component to allow selection of pipeline—by name—from a drop-down menu, instead of entering an ID string.
Bug fixes
- Improved Git Integration performance by running certain repository transactions as batch processes.
- Added an improvement to ensure that admin customizations are preserved in the
server.xml
file. - Added an improvement for batch job loading for better performance when opening large projects.
- Fixed an issue where the Schedule Completed column in Task History was displaying incorrectly formatted values.
- Added an improvement to optimize memory usage when there are many connected sessions.
- Added an improvement to prevent temporary file handles from being lost when staging from empty tables.
Driver updates
- Snowflake JDBC driver updated
3.13.26
→3.13.28
- Dynamics 365 Business Central API driver updated
21.0.8011.0
→22.0.8545.0
. This update fixes a bug where users could experience timeout issues when setting filters. - DynamoDB API driver updated
23.0.8587.0
→23.0.8630.0
- Facebook API driver updated
21.0.8137.0
→23.0.8565.0
- Facebook Ads API driver updated
22.0.8391.0
→23.0.8565.0
- Google Ads API driver updated
22.0.8432.0
→23.0.8649.0
- Jira API driver updated
22.0.8322.0
→23.0.8579.0
. This update fixes a bug where custom column values were not returned correctly beyond the first page.
Note
For Facebook Query and Facebook Ads Query, the Version
connection option has been removed. This is a breaking change and any components with this option set will fail validation. Both drivers now default to v16.0 of their respective API.