December 2024 changelog🔗
Here you'll find the December 2024 changelog for the Data Productivity Cloud. Just want to read about new features? Read our New Features blog.
12th December🔗
DesignerNew features 🎉
- Added the
Retrieve Runendpoint to the dbt Cloud Flex connector.
AgentImprovements 🔧
- The agent template for Azure now deploys with an environment type of "Workload profile - Dedicated" (was previously "Consumption Only"). This allows the agent to better facilitate complex networking, while keeping the ability for the agent to auto-update.
9th December🔗
CDC
- Updated the CDC agent version from
2.98.7to2.101.2. - For customers who may have experienced an out-of-memory issue with the agent, we have added a new advanced property
matillion.compact-historythat can be set totruein any affected pipeline definition. This will reduce the memory footprint of the agent by compacting the schema history of the pipeline. - For pipelines that stream data directly to Snowflake, the agent will create a new column
MTLN_CDC_LOAD_TIMESTAMPin each target table to store the load timestamp of each row. - Library updates and security fixes.
6th December🔗
APINew Endpoints 🎉
The following endpoints have been added to the Data Productivity Cloud REST API:
Credit consumption
| Method | Endpoint | Description |
|---|---|---|
| GET | /v1/consumption | Get a breakdown of your credit consumption for flat-rated products |
| GET | /v1/consumption/etl-users | Get a breakdown of your credit consumption for ETL users |
5th December🔗
DesignerNew features 🎉
- Added the new Skip on run action to the component action bar. This allows you to temporarily disable a component in a pipeline, without removing it. For more information, read Skip components.
New transformation component:
- Cortex Parse Document is a transformation component that uses Snowflake Cortex to extract content from a document on an internal or external stage in the form of an object that contains JSON-encoded objects as strings.
4th December🔗
DesignerNew features 🎉
- Added the option to copy and paste pipelines and pipeline folders in Designer. For more information, read Managing pipelines and Copying pipeline folders.
3rd December🔗
DesignerNew features 🎉
- Added the option to rename pipeline folders in Designer. For more information, read Pipeline folders.
- Added a new Logging tab to the detailed view that appears when you click a task in the Task history tab. This shows a detailed log of each step in a task, as described in Logging.
StreamingImprovements 🔧
- Added a graph of number of rows changed over time to the Manage streaming pipelines dashboard.
Got feedback or spotted something we can improve?
We'd love to hear from you. Join the conversation in the Documentation forum!