Setup guide - Hybrid SaaS Snowflake on Snowpark
This document describes the necessary steps to follow to set up your first working project in the Data Productivity Cloud for the following configuration options:
Prerequisites
Snowflake requirements
- A Snowflake account with the following information:
- Your Snowflake account name and region (found in the URL you use to log in to Snowflake).
- Your Snowflake login credentials (Snowflake private key).
- A Snowflake role, warehouse, database, and schema.
To deploy the Data Productivity Cloud agent to Snowpark Container Services, the following are also required:
- A Snowflake role with permissions to create:
- Integrations.
- Databases.
- Applications.
- Compute pools.
- A warehouse that the role has usage permission on. This can be an existing warehouse, or a new warehouse can be created.
Connectivity requirements
- Access enabled for the IP addresses listed under the Hybrid SaaS section of Allowing IP addresses.
Git requirements
If you choose to use your own Git provider instead of the Matillion-hosted Git option, you need the following:
- The Matillion Git app installed in your organization's account with one of the supported Git providers:
Setup steps
- Register for a Data Productivity Cloud account.
- Create accounts for users and admins who will be active in the Data Productivity Cloud.
- Create an agent in the Data Productivity Cloud.
- Install the agent into Snowflake.
- Configure the agent application in Snowflake.
- Create a project, making the following choices:
- Select Advanced settings.
- Select the agent you created and deployed previously.
- Select the Git provider you wish to use.
- Create an environment using your Snowflake credentials.
- Set up secret definitions for passwords, API keys, and tokens.
- Create a Git branch in which to begin pipeline work.
- Create your first pipeline.