September 2024 changelog
Here you'll find the September 2024 changelog for the Data Productivity Cloud. Just want to read about new features? Read our New Features blog.
26th September
DesignerImprovements 🔧
Projects:
- Snowflake projects now allow the choice of key pair authentication, so a Snowflake private key can be used.
- Databricks projects now require a Databricks personal access token for authentication. Username/password has been deprecated by Databricks and can no longer be used.
Git version control:
- Additional options are available for Git reset, allowing a reset to your selected working state.
New orchestration components:
- Bash Pushdown. This component enables users running Full SaaS configurations (Matillion-hosted agents) to use SSH connections to run their Bash scripts in their own instances.
24th September
DesignerNew features 🎉
New orchestration components:
- Snowflake Vector Upsert. This component converts data into vector embeddings in a Snowflake table.
Component updates:
- You can now cross-query two databases with the Table Input and Multi Table Input transformation components for Amazon Redshift projects.
Designer UI:
- You can now reorder your pipeline tabs in Designer with click-and-drag.
12th September
DesignerNew features 🎉
New transformation components:
- Vector Search. This component uses Snowflake vectors to perform a retrieval augmented generation (RAG) search on an input table. This component is available in public preview for Snowflake projects.
Component updates:
- Added SFTP as a data input type in the File Iterator component.
- Table Iterator is now available on Amazon Redshift projects.
Designer:
- The Git Commit dialog now lists all uncommitted changes.
- Added a command palette to the Designer. In its first phase, the following command is supported:
- Use
cmd + korctrl + kto activate a file explorer dialog. Alternatively, click the search icon in the upper-right corner of the UI.
- Use
10th September
CDCImprovements 🔧
- Updated the CDC agent version from
2.95.27to2.95.33. - Library updates and security fixes.
5th September
DesignerNew features 🎉
New orchestration components:
- Amazon Textract. This component uses the Textract API to extract text, handwriting, layout elements, and data from scanned documents. You can optionally choose to include footers and page numbers in the extraction process.
- Amazon Transcribe. This component uses the Transcribe API to extract data from media and audio files and then converts that data into transcriptions.
Component updates:
- Chunk Text is now out of public preview and generally available for all Snowflake projects.
3rd September
DesignerNew features 🎉
New components:
- Cortex Embed. This transformation component lets you convert English-language text into a Cortex vector embedding.
- NetSuite SuiteAnalytics. This orchestration component uses NetSuite SuiteAnalytics Connect to retrieve data and load it into a table.
- Remove From Grid. This orchestration component takes in grid variable data and remove data based on the user's definition.