Setup guide - Hybrid SaaS Snowflake on Azure

This document describes the necessary steps to follow to set up your first working project in the Data Productivity Cloud for the following configuration options:

Deployment type:

Hybris SaaS

Cloud platform:

Azure

Cloud data warehouse:

Snowflake

---

Prerequisites

Azure requirements

• An Azure subscription with appropriate permissions to provision cloud resources in the Azure environment and manage access control, specifically for managing:
  • Resource groups.
  • Virtual networks.
  • Key vaults.
  • Container apps.
• A suitable resource group already defined in your Azure environment.
• A suitable virtual network already defined in your Azure environment. The virtual network must:
  • Be fully configured, including routing to on-premises resources.
  • Allow egress to Matillion's Data Productivity Cloud IP ranges.
  • Have room for one additional subnet with at least /27 IP range.
• A suitable key vault. You can use an existing key vault or a new one will be created as part of the setup process.
• Minimum permissions to include the following:
  • Create subnet.
  • Create managed identity.
  • Create key vault.
  • Create log analytics workspace.
  • Create container app and container app environment.
  • Modify subnet delegation.
• Role assignments in the resource group and key vault.

Snowflake requirements

• A Snowflake account with the following information:
  • Your Snowflake account name and region (found in the URL you use to log in to Snowflake).
  • Your Snowflake login credentials (Snowflake private key).
  • A Snowflake role, warehouse, database, and schema.

Connectivity requirements

• Access enabled for the IP addresses listed under the Hybrid SaaS section of Allowing IP addresses.

Git requirements

If you choose to use your own Git provider instead of the Matillion-hosted Git option, you need the following:

• The Matillion Git app installed in your organization's account with one of the supported Git providers:
  • GitHub.
  • Azure DevOps.
  • GitLab.
  • Bitbucket.

---

Setup steps

1. Register for a Data Productivity Cloud account.
2. Create accounts for users and admins who will be active in the Data Productivity Cloud.
3. Create an agent in the Data Productivity Cloud.
4. Deploy a Container App agent in Azure using the recommended ARM template.
5. Create a project, making the following choices:
   • Select Advanced settings.
   • Select the agent you created and deployed previously.
   • Select the Git provider you wish to use.
6. Create an environment using your Snowflake credentials.
7. Set up secret definitions for passwords, API keys, and tokens.
8. Create a Git branch in which to begin pipeline work.
9. Create your first pipeline.

Got feedback or spotted something we can improve?

We'd love to hear from you. Join the conversation in the Documentation forum!