October 2023 changelog
31st October
DesignerNew features 🎉
- Added the following connectors for developing data pipelines:
- Added Azure Storage as a storage destination for the following connectors:
- ActiveCampaign
- Amplitude
- Anaplan
- Braze
- Brevo
- Chargebee
- CircleCI
- Concord
- Confluence
- Datadog
- Delighted
- Eventbrite
- Freshdesk
- Gong
- Klaviyo
- LaunchDarkly
- PagerDuty
- PayPal
- Pendo
- Productboard
- Recurly
- Slack
- Smartsheet
- Snyk
- TikTok
- Toggl
- Twilio
27th October
DesignerNew features 🎉
- Added the Anaplan connector.
26th October
DesignerImprovements 🔧
- Updated the Add Components panel with clickable filter buttons under the search bar. Click a filter button to only display components tagged for that filter. You can activate multiple filter buttons.
- Updated the Add component call-to-action (CTA) dialog to include an output connection setting. When adding a component to the canvas, you can now confirm whether that component should be run:
- On success (green connection line).
- Unconditionally (grey connection line).
- On failure (red connection line).
- You can now sample Query components in orchestration pipelines. To do this:
- Click on a validated Query component in your orchestration pipeline, e.g. Salesforce Query.
- Click the Sample tab.
- Click Sample data.
- Added row count when sampling components in a transformation pipeline. To view the total rows:
- Click on a validated transformation component, e.g, Table Input.
- Click the Sample tab.
- Click the refresh button.
Custom ConnectorNew features 🎉
- The ability to import pre-existing connectors using the Custom Connector import feature. This feature supports two types of connectors:
- Custom connectors that have been previously exported.
- Matillion ETL connectors.
18th October
DesignerNew features 🎉
-
Added support for Flex connectors to Designer. In the Data Productivity Cloud, Flex connectors let you connect to a curated set of endpoints to load data. 20 Flex connectors are initially available for Designer:
- Amplitude
- Brevo
- CircleCI
- Concord
- Confluence
- Datadog
- Delighted
- Freshdesk
- Klaviyo
- LaunchDarkly
- PagerDuty
- Pendo
- Productboard
- Recurly
- Smartsheet
- Snyk
- TikTok
- Toggl
- Twilio
16th October
BatchNew features 🎉
- Added the following Flex connector for developing Batch pipelines:
13th October
BatchNew features 🎉
- Added the following Flex connectors for developing Batch pipelines:
12th October
DesignerNew features 🎉
- Added the Assert View component, which lets you verify that certain conditions are true of a view, or otherwise stop the query.
10th October
DesignerNew features 🎉Improvements 🔧
- Updated the Add Components panel to un-nest components. We believe this will make finding the component you're looking for much easier. Components are listed alphabetically and include a descriptor keyword, e.g. "Connectors" or "Flow". You can use these descriptors to filter out components that don't match that keyword. For example, typing "flow" in the search bar will return only the Flow components (And, End Failure, End Success, If, Or, Retry, Restart). The search also includes a number of synonym keywords to help filter components. For example, typing "logic" into the search bar will also return the Flow components.
- Updated the pipeline canvas to include a + call-to-action button. When you select a component on the canvas, the + button will appear to the right. Clicking this button will open the Add component dialog. This dialog works similarly to the Add Component panel.
- Components are listed alphabetically.
- Descriptor and synonym keywords help you refine your search.
- Clicking a component in this dialog will add that component to the canvas in place of the + button and close the dialog. The new component will be connected to the previously selected component.
- This newly added component will become the selected component, meaning the + button will shift to the right.
- Added the Table Update component, which lets you update a target table with a set of input rows. The rows to update are based on matching keys.
5th October
DesignerImprovements 🔧
- The Git Commit changes and push option has been split into two separate operations: Commit and Push local changes.
2nd October
BatchNew features 🎉
- Added the following Flex connector for developing Batch pipelines: