May 2024 changelog
Here you'll find the May 2024 changelog for the Data Productivity Cloud. Just want to read about new features? Read our New Features blog.
31st May
Custom ConnectorNew features 🎉
- Added a Script paging option for connector pagination. Paging scripts give you complete control over response pagination in Custom Connector.
30th May
DesignerNew features 🎉
- Copilot for the Data Productivity Cloud is now available in public preview for transformation pipelines in Snowflake projects. Copilot lets you prompt generative AI to create data pipelines, improving your efficiency in managing and processing data. Read our docs to get started:
- The Query Result to Scalar component is now available for Databricks projects. This orchestration component allows you to query a table and return a scalar value. This value can then be mapped to a project or pipeline variable for use in other pipeline components.
23rd May
DesignerNew features 🎉
- Added Amazon Bedrock as an embedding provider and added Titan Embeddings G1 - Text as an embedding model for the following AI components:
- Added the ability to configure agents to work with a proxy server in AWS and Azure environments.
21st May
DesignerNew features 🎉
- The Snowpark Container Prompt is now available in public preview. This orchestration component lets you host your large language models within your Snowpark Container Services.
- The Pinecone Vector Upsert component is now available for Databricks and Amazon Redshift projects.
- Added the following Flex connectors for developing data pipelines:
- The Data Productivity Cloud agent for Azure is now available in public preview. This lets you run a Hybrid SaaS configuration with the Matillion agent hosted in your own Azure infrastructure.
16th May
DesignerNew features 🎉
- The AI prompt components are now available for Databricks projects:
- The following new components that support Snowflake Cortex LLM operations are available for Snowflake projects:
14th May
DesignerNew features 🎉
- The AI prompt components are now available for Amazon Redshift projects:
- Added two new connectors:
- Gmail, which lets you query the Gmail API to retrieve data and load it into a table. You can then use transformation components to enrich and manage the data in permanent tables.
- SurveyMonkey, which lets you query the SurveyMonkey API to retrieve data and load it into a table. You can then use transformation components to enrich and manage the data in permanent tables.
- Added the following components for Snowflake projects:
- Azure Queue Storage Message lets you post a message to Azure Queue Storage. Other applications can read those messages and perform further processing.
- JDBC Table Metadata to Grid takes the metadata from a JDBC table and uses this data to populate a grid variable.
- Table Metadata to Grid takes the metadata from a table and uses this data to populate a grid variable with data.
- The Git menu can now be accessed by clicking the active branch.
- The Data Transfer component now supports SFTP as a target.
10th May
CDCImprovements 🔧
- Updated CDC agent version from
2.93.1to2.93.8. - Improved messaging and logging for some scenarios.
- Library updates and security fixes.
2nd May
DesignerGA release 🎉
- The Python Pushdown component is now generally available for Snowflake users. This component lets you execute a Python script using the Snowpark service in your Snowflake account.
1st May
DesignerNew features 🎉
- Amazon Redshift is now generally available as a cloud data warehouse in the Data Productivity Cloud.