October 2024 changelog

Here you'll find the October 2024 changelog for the Data Productivity Cloud. Just want to read about new features? Read our New Features blog.

9th October

CDC

DesignerNew features 🎉

New orchestration components:

Azure Document Intelligence. This component uses the Azure AI Document Intelligence API to automate the extraction of text, handwriting, layout elements, and other key data from forms and documents. The output format can be either Markdown or text.
Azure Speech Transcribe. This component uses the Azure Speech service to transcribe speech to text from an audio file in your specified Azure Blob location and Speech resource endpoint. Speaker diarization clarifies which speaker spoke and when, increasing the accuracy of your transcriptions.

New transformation components:

Databricks Vector Search. This component lets you perform a search on an input table to find content that best answers specific questions, using vector embeddings to identify suitable answers within data located in your Databricks account. Only available for Databricks projects.

DesignerNew features 🎉

New orchestration components:

Add Partition. This orchestration component lets users define the S3 directory structure for partitioned external table data. Amazon Redshift projects only.
Create External Table. This orchestration component creates a table to reference data stored in an Amazon S3 bucket. The table references external data, meaning the table itself does not hold the data. Amazon Redshift projects only.

CDCImprovements 🔧

Updated the CDC agent version from 2.95.33 to 2.97.12.
Improved the process of agent shutdowns so that on clean shutdown the agent status shows as Stopped rather than Unknown.
Library updates and security fixes.