Skip to content

July 2024 changelog

Here you'll find the July 2024 changelog for the Data Productivity Cloud. Just want to read about new features? Read our New Features blog.

30th July

Data Productivity Cloud APINew features 🎉

  • The Pipeline execution API now supports overriding scalar or grid variables when making a call. This enhancement allows for greater flexibility and customization during pipeline execution.

CDCImprovements 🔧

25th July

DesignerNew features 🎉

  • Added the Cloud Pub/Sub component, which allows messages to be published to a topic on Google Cloud Platform (GCP). Other applications can subscribe to these topics to receive such messages.

23rd July

DesignerNew features 🎉

  • Google Cloud Storage is now available for Snowflake projects in the following areas:
    • Added the Google Cloud Storage Load component, which lets you load data stored on the Google Cloud Storage service into an existing Snowflake table.
    • Added the Google Cloud Storage Unload component, which writes data from a Snowflake table or view into a specified Google Cloud Storage (GCS) bucket in your specified file format (CSV, JSON, or Parquet).
    • Added Google Cloud Storage as a staging platform to all "Query" components (Facebook Query, Salesforce Query, Shopify Query, and so on).
  • Added Google Cloud Storage as a source and destination to the Data Transfer component.
  • Added Google Cloud Storage as a source and destination to the Excel Query component.
  • Added Google Cloud Storage as a source and destination to the File Iterator component.

Note

To interact with Google Cloud Platform services, you'll need to set up GCP cloud credentials and associate your credentials with your environment.

CDCImprovements 🔧

  • Updated CDC agent version from 2.95.1 to 2.95.21.
  • Fixed an issue where the thread cap for table writers could be reached when capturing changes on a large number of tables at once and cause the agent to stop streaming.
  • The Oracle connector will now gracefully handle skipping transactions when the retention.ms property is configured.
  • Library updates and security fixes.

18th July

DesignerNew features 🎉Improvements 🔧

  • Updated the font across the Data Productivity Cloud to a more modern, readable font.
  • Added HTML as a supported data format to the Chunk Text component.
  • Added the ability to use multiple Azure Key Vault vaults to store secrets. When you add a new secret definition, you can choose which of your key vaults the secret is stored in.

16th July

DesignerNew features 🎉

  • Added a JDBC orchestration component for the hybrid SaaS offering (customer-hosted agent). The JDBC component allows you to run queries on a JDBC-compatible data source that you have a driver for. You can upload your drivers to the Data Productivity Cloud, and so connect to any sources that Matillion doesn't provide drivers for as standard.
  • Added a Chunk Text orchestration component, which performs pushdown text chunking using a Python user-defined function (UDF) in Snowflake via the computational power of your Snowflake warehouse. You can choose text or Markdown as your data format.
  • Added the following Flex connectors for developing data pipelines:
  • Added a Refresh Table orchestration component, which invalidates cached entries of a specified table or view, including both data and metadata. Databricks projects only.

4th July

DesignerNew features 🎉

2nd July

DesignerNew features 🎉Improvements 🔧

© Copyright 2024 Matillion Ltd | Legal | Privacy Policy | Disclaimer | Modern Slavery Statement