Skip to content

Environments

An environment defines the connection between a project and your chosen cloud data warehouse. Environments include useful defaults such as a default warehouse, database, and schema, that can be used to pre-populate component configurations in the Designer.

Not added a project yet? Read Add project.

Add an environment

  1. From the Your projects menu, select your project.
  2. Navigate to the Environments tab.
  3. Click Add new environment.
Parameter Description
Environment name A unique name for the environment. Max 255 characters.
Agent A working agent. This is only required if you are using a Hybrid SaaS solution. To learn how to create an agent, read Create an agent.

Click Continue.

Specify cloud data warehouse credentials

Parameter Description
Account Enter your Snowflake account name and region (part of the URL you use to log into Snowflake). Uses the format [accountName].[region_id].
Username Your Snowflake username.
Secret name A named entry created in AWS Secrets Manager.
Secret key A named secret key tied to your secret name.
Property Description
Instance name Your Databricks instance name. Read the Databricks documentation to learn how to determine your instance name.
Username Your Delta Lake user name.
Password For Full SaaS deployment model only. Your Snowflake password.
Parameter Description
Endpoint The physical address of the leader node. This will be either a name or an IP address.
Port This is usually 5439 or 5432, but it can be configured differently when setting up your Amazon Redshift cluster.
Use SSL Select this to encrypt communications between Data Productivity Cloud and Amazon Redshift. Some Amazon Redshift clusters may be configured to require this.
Username The username for the environment connection.
Password For Full SaaS deployment model only. Your Redshift password.
Secret name For Hybrid SaaS deployment model only. A named entry created in AWS Secrets Manager.
Secret key For Hybrid SaaS deployment model only. A named secret key tied to your secret name.

Click Continue.

Select data warehouse defaults

Property Description
Default role The default Snowflake role for this environment connection. Read Overview of Access Control to learn more.
Default warehouse The default Snowflake warehouse for this environment connection. Read Overview of Warehouses to learn more.
Default database The default Snowflake database for this environment connection. Read Database, Schema, and Share DDL to learn more.
Default schema The default Snowflake schema for this environment connection. Read Database, Schema, and Share DDL to learn more.
Property Description
Endpoint/Cluster The Databricks cluster that Data Productivity Cloud will connect to.
Catalog Choose a Databricks Unity Catalog to connect to.
Database Choose a Delta Lake database to connect to.
Property Description
Default database The database you created when setting up your Amazon Redshift cluster. You may run with multiple database names—in which case, choose the one you want to use for this environment.
Default schema This is public by default, but if you have configured multiple schemas within your Amazon Redshift database, you should specify the schema you want to use.

Click Finish.

Your new environment is listed in the Environment menu.

To edit an environment, click ... for that environment and click Edit environment.

Note

You can sort the Environment menu by name, default agent, or cloud data warehouse account name.

Associate cloud provider credentials with an environment

Each environment in your project must have at least one set of cloud credentials associated with it. This will allow you to access account resources on different platforms other than that hosting your project. For example, if your project is on AWS and you want to access resources in Azure, you need to associate your Azure cloud credentials with the environment.

You can associate credentials from multiple providers, but only one set of credentials for each cloud provider. For example, you can associate both AWS and Azure credentials, but not two different AWS credentials.

You can associate credentials with an environment when you first Create cloud provider credentials, or you can associate them later as follows:

  1. In your project, click the Environments tab.
  2. Click the more button ... on the corresponding row of the environment you want to associate, and select Associate Credentials.
  3. Select the credentials from the drop-down lists. You can associate one set of credentials for each cloud provider.
  4. Click Associate.