Skip to content

1.68 release notes

Below, you can find release notes for Matillion ETL version 1.68.x

Tech notes

Matillion ETL for Redshift

If you're experiencing out-of-memory (OOM) exceptions or high CPU usage since updating to version 1.68.7 or above, read Tech note - Redshift RingBuffer exceeding expected limits for a workaround.

Matillion ETL version 1.68.26

2024 - October 4th

Improvements and bug fixes

  • Added an improvement to preserve "Ignore misfires" status when migrating schedules between instances.

Matillion ETL version 1.68.25

2024 - July 16th

Improvements

  • Updated base CentOS image from CentOS Linux 7 to CentOS Stream 9 for published virtual machine (VM) images.

Driver updates

  • LinkedIn Ads driver updated 23.0.8843.0 → 23.0.8921.0.
  • QuickBooks Online driver updated 21.0.8137.0 → 23.0.8839.1.

Matillion ETL version 1.68.24

2024 - June 4th

Improvements and bug fixes

  • Fixed an issue where clients could not connect if all optional features were disabled.
  • Improve logging under high websocket loads.
  • Fixed an issue with the Salesforce Output component where single quotes were not escaped properly when building the "Insert into" cloud data warehouse SQL statement for errored/rejected records.

Driver updates

Facebook and Facebook Ads

  • LinkedIn Ads driver updated 23.0.8770.0 → 23.0.8921.0.
  • QuickBooks Online driver updated 21.0.8137.0 → 23.0.8839.1.
  • Facebook driver updated 23.0.8565.0 → 23.0.8889.0.
  • Facebook and Facebook Ads driver updated to use Marketing API version v19.

Warning

The Facebook Marketing API v17.0 expires on May 14th, 2024. Use the Connection Options property to manually set the API version to a current version—for example, v18.0 or v19.0.

To do this:

  1. Open the Connection Options property.
  2. Click +.
  3. Set Parameter to "Other".
  4. Set Value to, for example, "MarketingAPIVersion=19.0" or "GraphAPIVersion=19.0".

Read Available Marketing API Versions for more information.

Matillion ETL version 1.68.23

2024 - April 15th

Improvements and bug fixes

  • Fixed an issue where scheduled jobs would not trigger.
  • Fixed an issue where Matillion ETL could become unresponsive when using Git integration.
  • Fixed an issue where task_batch_history indexes were not created.
  • Security and vulnerability fixes.

Matillion ETL version 1.68.22

2024 - March 1st

Improvements and bug fixes

  • Fixed an issue in SharePoint Query to ensure that the AllSites.Read permission is requested instead of AllSites.Manage when creating an OAuth profile.

Driver updates

  • LinkedIn API driver updated 22.0.8431.0 → 23.0.8770.0
  • LinkedIn Ads API driver updated 22.0.8389.0 → 23.0.8770.0

Matillion ETL version 1.68.21

2024 - February 9th

Improvements and bug fixes

  • Fixed an issue where users couldn't load JSON data into Google BigQuery using API Extract.
  • Fixed an issue where API Extract was not accepting Boolean as a last page parameter for page-based pagination.

Driver updates

  • Jira API driver updated 23.0.8579.0 → 23.0.8677.0.
  • MongoDB API driver updated 22.0.8389.0 → 23.0.8749.0. This driver update fixes an issue where jobs could hang at validation.
  • Salesforce API driver updated 22.0.8523.0 → 23.0.8669.0. This driver update fixes an issue where the component would hang when running JOIN or UNION queries.

Matillion ETL version 1.68.20

2024 - January 22nd

Improvements and bug fixes

  • Fixed a security vulnerability around URL redirects.

Matillion ETL version 1.68.19

2023 - December 22nd

Improvements and bug fixes

  • Updated the Hazelcast license key. This new license expires on 31st March, 2026. The maximum number of nodes in a cluster is consequently increased from the current 6 nodes to 9,999 nodes, which greatly increases potential throughput if needed. Read Instances update note for Hazelcast v3 to learn more.
  • Fixed an issue where the Matillion ETL UI could be unresponsive after upgrading to version 1.68.16.

Matillion ETL version 1.68.18

2023 - November 21st

Improvements and bug fixes

  • Fixed an issue where SQS messages would not run in order under heavy load.
  • Fixed a caching issue on Delta Lake on Databricks instances where new tables were not recognized.
  • Added caching to retrieval of schemas in Azure Synapse instances to alleviate performance issues during and after migration.

Matillion ETL version 1.68.17

2023 - November 9th

Improvements and bug fixes

  • Fixed an issue where users couldn't delete stale Git branches in the local repository in Matillion ETL.
  • Improved Git Integration performance by running certain repository transactions as batch processes.
  • Fixed an issue that caused a project to break if a job was deleted before validation had finished.
  • Reduced the runtime of the Salesforce Output component when capturing reject records from Snowflake.

Matillion ETL version 1.68.16

2023 - October 26th

Bug fixes

  • Fixed an issue where validated transformation jobs could become invalidated and require revalidation.

Matillion ETL version 1.68.15

2023 - October 20th

Driver updates

  • Snowflake JDBC driver updated 3.13.18 → 3.13.26.

Matillion ETL version 1.68.14

2023 - October 2nd

Bug fixes

  • Fixed an issue where some users couldn't perform an in-place upgrade using the Matillion ETL UI to versions 1.68.8 or higher.
  • Fixed an issue where Matillion ETL could become unresponsive and schedules could stop running when performing a Git checkout.
  • Fixed an issue where the Schedule Completed column in Task History was displaying incorrectly formatted values.
  • Fixed an issue where a Matillion ETL instance's protocol could be inadvertently set to HTTPS instead of HTTP.

Driver updates

  • Postgres JDBC driver updated 42.3.4 → 42.5.4
  • MongoDB API driver updated 21.0.8221.0 → 22.0.8389.0.

Matillion ETL version 1.68.13

2023 - August 21st

New features and improvements

  • Added a Performance monitor that displays key real-time performance metrics for the Matillion ETL instance.
  • Added an improvement to prevent temporary file handles from being lost when staging from empty tables.
  • Added an improvement to ensure that admin customizations are preserved in the server.xml file.
  • Added an improvement for batch job loading for better performance when opening large projects.
  • Improved Task History to display schedule completion time.

Driver updates

  • Dynamics 365 Business Central API driver updated 21.0.8011.0 → 22.0.8545.0
    • This update fixes a bug where users could experience timeout issues when setting filters.
  • Jira API driver updated 21.0.8137.0 → 23.0.8579.0
    • This update fixes a bug where custom column values were not returned correctly beyond the first page.

Matillion ETL version 1.68.12

2023 - June 15th

Improvements

  • The maximum number of environments for Hub instances has been increased to 9999 (previously 999).

Bug fixes

  • Fixed an issue where the Task tab was displaying activity at a project group level instead of a project level.
  • Fixed an issue where users were unable to create or edit an environment on Matillion ETL for Redshift after updating to version 1.68.7.

Matillion ETL version 1.68.11

2023 - June 5th

Improvements

  • Added an improvement to enable TLS protocols to be restricted in the SSL menu.
  • Improved the performance of script editors when a project includes large numbers of jobs.
  • Added a security patch to instruct search engines to not index Matillion ETL.

Bug fixes

  • Reduced memory requirements for the Task History view.
  • Fixed a validation error when environment variables are used to configure shared jobs.

Matillion ETL version 1.68.10

2023 - May 18th

Bug fixes

  • Fixed an issue where the RDS Bulk Output component did not work as expected with MySQL and Postgres.
  • Fixed an issue where required roles would be missing from Tomcat user configuration when using the universal installer.
  • Fixed an issue where a Matillion ETL major version was not being parsed properly on the universal installer, leading to failure to build specific 1.70 releases.
  • Reinstated missing out-of-memory script property for universal installer on 1.68 and earlier versions.
  • Resolved issues preventing login on RHEL8 instances after running the universal installer.
  • In the Data Transfer component, FTP would always use the port 21 and ignore any host:port part of a configuration. Now, FTP will respect the :port part of any URL, allowing the component to use non-standard FTP ports for connection.
  • Fixed an issue where the Data Transfer component encountered a "pipe closed" error when transferring a zip file and unpacking it to the target location.
  • Fixed an issue where 'UpdatedTaskQueue' messages were unintentionally included in the audit log.

Matillion ETL version 1.68.9

2023 - May 5th

Bug fixes

  • Fixed an issue where the Salesforce Output component would fail because fields that began with a comma were not being enclosed in double quotes.
  • Fixed an issue where the Google Analytics Query component would not return any data when the query included an IS LIKE clause.
  • Fixed an issue where the Google Analytics Query component was incorrectly using a page size of 200 immutably. The page size now defaults to the maximum value, 10,000, and the connection option works as expected if you wish to lower this number.
  • Fixed an issue where an instance migration would complete without successfully exporting Matillion ETL users stored in a Matillion ETL database.

Driver updates

  • Google Analytics driver updated 21.0.8137.0 → 22.0.8516.0
  • Salesforce driver updated 22.0.8466.0 → 22.0.8511.0

Matillion ETL version 1.68.8

2023 - May 2nd

Bug fixes

  • Fixed an issue to improve clarity of logging with regards to task and job execution status.
  • Fixed an issue to allow script variable and output size limits to be defined via environment variables (MAX_SCRIPT_SIZE default 5000000; MAX_VARIABLE_SIZE default 1000) to enable control of potential out-of-memory (OOM) on scripting components.

Matillion ETL version 1.68.7

2023 - March 31st

New features and improvements

  • Added a drop-down menu for selecting long-term support (LTS) version updates. If you're running the latest LTS version, there will be no available version to update to.
  • A scheduled job that misses its scheduled time (by default, within 30 seconds of its scheduled time) is declared a misfire. When a misfire is detected, it will now show in the task history decorated with a new "misfire" icon. This should make it clearer when misfires are detected and what that means for misfire handling. These events will not appear when the Ignore Misfire option is selected when creating a schedule.

Bug fixes

  • Fixed an issue where the Data Transfer component encountered a "pipe closed" error when transferring a zip file and unpacking it to the target location.
  • Fixed an issue where application performance could be limited by an excessive message task queue size.
  • Fixed an issue where API Extract requests were not handling null responses as expected.
  • Fixed an issue where a feature flag was stopping stateless authentication from working as expected.
  • Fixed an issue where the Data Transfer component did not timeout during an SFTP file transfer.
  • Fixed an issue where when a variable was being used in a URL path and / was appended to the end, the variable would be duplicated in the path.

Driver updates

  • Google Ads API driver updated 22.0.8353.0 → 22.0.8432.0
  • Salesforce API driver updated 22.0.8356.0 → 22.0.8466.0

Matillion ETL version 1.68.6

2023 - March 10th

  • Fixed an issue where application performance could be limited by an excessive message task queue size.
  • AWS Redshift JDBC driver updated 1.2.55.1083 → 2.1.0.9

Matillion ETL version 1.68.5

2023 - February 6th

  • Fixed an issue where external columns were not being retrieved as expected after a Redshift cluster upgrade.

Matillion ETL version 1.68.4

2023 - January 13th

Matillion ETL version 1.68.3

2022 - December 20th

New features and improvements

All platforms

  • Improved Matillion ETL's support of Python.
    • Added a Manage Interpreters dialog. Create a named "interpreter" and point it at your preferred Python version. Matillion ETL now distributes with Python 3.6 and 3.8 but any version of Python can be installed as per user requirements.
    • Manage Interpreters also lets you disable Python versions as required.
  • Versioned the following components. Existing jobs using the old version of the component will continue to work as expected. New instances of the components will use the new version. When making new jobs with the new version of these components, you may need to configure fresh OAuth entries (where applicable):
  • Added CSV and ZIP-CSV content types to the Salesforce Output component's Content Type parameter.
  • Improved Add OAuth Entry dialog readability by alphabetizing third-party services.
  • Improved the Salesforce Query component by adding an "Other" option to the Authentication Method parameter. When this option is chosen, use the Connection Options to specify an OAuth access token. Read the component documentation for more details.
  • Improved the API v1 - Metadata endpoint.

Snowflake, Amazon Redshift, and Google BigQuery

  • Updated the Salesforce Output component:
    • Added the ability to capture and truncate batch results.
    • Added the ability to truncate rejected records.

Delta Lake on Databricks

  • Added support for Databricks Unity Catalog at the Matillion ETL environment level. Users can now connect to a specific catalog on the Delta Lake Defaults page when setting up an environment or project in Matillion ETL for Delta Lake on Databricks.
  • Added a Run Delta Live Table component, which lets you start a Delta Live Tables pipeline from Matillion ETL.
  • Added the ability to cancel a running Databricks pipeline. Right-click a running pipeline in the Tasks tab, and click Cancel.

Bug fixes

All platforms

  • Fixed an issue where components that referenced a deleted secret manager secret could no longer be updated to point at a different secret.
  • Fixed an issue where the Salesforce Query component wasn't able to authenticate using JWT Token Access.
  • Fixed an issue where the Data Transfer component was failing to unpack zip files.

Snowflake, Delta Lake on Databricks, and Amazon Redshift

  • Fixed an issue where some commands in CloudFormation templates were failing, causing Matillion ETL to not start in some cases.

Snowflake

  • Fixed an issue where Git "fetch" operations were failing due to a bug in Apache on Azure.
  • Fixed an issue where refreshing or logging out and back in to Matillion ETL always opened the default environment, regardless of which environment the user was previously using. The previously selected environment will now be selected automatically when logging back in.
  • Fixed an issue where attempting to view the Task History of a very large scheduled job could result in out-of-memory errors.

Delta Lake on Databricks

  • Fixed an issue where Table Metadata wasn't correctly saving and displaying zero values in the Size or Scale fields.

Driver updates

  • Apache Hive API driver updated 20.0.7627.0 → 22.0.8326.0
  • Apache Spark SQL API driver updated 18.0.6934.0 → 22.0.8322.0
  • Couchbase API driver updated 21.0.8011.0 → 22.0.8322.0
  • NetSuite API driver updated 20.0.7662.0 → 22.0.8322.0
  • Salesforce API driver updated 21.0.8129.0 → 22.0.8356.0
  • SugarCRM API driver updated 18.0.6705.0 → 22.0.8322.0
© Copyright 2024 Matillion Ltd | Legal | Privacy Policy | Disclaimer | Modern Slavery Statement