June 2024 changelog
Here you'll find the June 2024 changelog for the Data Productivity Cloud. Just want to read about new features? Read our What's New blog.
25th June
DesignerNew features 🎉
- Connecting your own Azure DevOps repo to Data Productivity Cloud projects is now generally available. This feature lets you connect your Azure DevOps repository when you create a project in the Data Productivity Cloud. Follow the documentation to get started:
- Added the following Flex connectors for developing data pipelines:
- Added an SAP ODP orchestration component, for connecting directly through SAP ODP to access available data sources in SAPI and ABAP CDS views.
- Added the ability to upload external drivers to allow you to enable third-party connectors that don't have a driver supplied by default in a hybrid SaaS configuration, such as SAP ODP.
- Added support for the OAuth 2.0 client credentials authentication type in Designer when using custom connectors.
- Updated data sampling for orchestration components to include a drop-down menu where you can set the number of rows sampled, for example 1, 10, 250, 1000. The default is 25 rows.
20th June
CDCImprovements 🔧
- Updated the CDC agent version from
2.93.8to2.95.1. - Added an option to map date and time source columns to the corresponding Snowflake data types when using Snowflake as a target.
- Changed the
MTLN_CDC_LAST_COMMIT_TIMESTAMPcolumn when using Snowflake as a target with the Change Log transformation type. - Library updates and security fixes.
18th June
DesignerNew features 🎉
- Added a component action bar that will be displayed when you click on a component in the canvas. The action bar currently supports copying the component and deleting the component.
- Updated data sampling for transformation components to include a drop-down menu where you can set the number of rows sampled, for example 1, 10, 250, 1000. The default is 25 rows.
- Added an Append To Grid component, which lets you append or prepend data to a pre-existing grid variable in the Data Productivity Cloud. Running this component can add rows to existing columns, but doesn't add columns to the grid.
- Added the following Flex connectors for developing data pipelines:
10th June
DesignerNew features 🎉
- Project administrators can now delete projects.
6th June
DesignerNew features 🎉
- Added support for GPT-4o to the OpenAI Prompt component. When this model is selected, the Image input type is available. Images should be in either Base64 format or a direct, public URL of the image. If you're feeding images in Base64 format, you will need to add
data:image/{format_of_your_image};base64,before the encoded image. - Added a Volume to Delta Table orchestration component for Databricks, which lets users transfer data from a pre-existing volume in Databricks in to a Delta Lake table without replacing or deleting any existing data.
- Added a Convert String To Struct transformation component, which takes a string input and converts it to a struct data type.
- Renamed the Extract Nested Data component to Extract Structured Data for Databricks. This transformation component unpacks arrays of structured data into columns and rows of data in a table. Any existing pipelines will still display an Extract Nested Data component.
- The Query Result To Grid component is now available for Databricks projects.
- Added the following Flex connectors for developing data pipelines:
- A user's account ID is now visible in the user menu (top right of the Hub UI), to help users easily identify their account.