An environment defines the connection between a project and your chosen cloud data warehouse. Environments include useful defaults such as a default warehouse, database, and schema, that can be used to pre-populate component configurations in the Designer.
Not added a project yet? Read Add project.
Add an environment
- From the Your projects menu, select your project.
- Navigate to the Environments tab.
- Click Add new environment.
|Environment name||A unique name for the environment. Max 255 characters.|
|Agent||A working agent. This is only required if you are using a Hybrid SaaS solution. To learn how to create an agent, read Create an agent.|
Specify cloud data warehouse credentials
|Account||Enter your Snowflake account name and region (part of the URL you use to log into Snowflake). Uses the format [accountName].[region_id].|
|Username||Your Snowflake username.|
|Secret name||A named entry created in AWS Secrets Manager.|
|Secret key||A named secret key tied to your secret name.|
|Instance name||Your Databricks instance name. Read the Databricks documentation to learn how to determine your instance name.|
|Username||Your Delta Lake user name.|
|Password||For Full SaaS deployment model only. Your Snowflake password.|
|Endpoint||The physical address of the leader node. This will be either a name or an IP address.|
|Port||This is usually 5439 or 5432, but it can be configured differently when setting up your Amazon Redshift cluster.|
|Use SSL||Select this to encrypt communications between Data Productivity Cloud and Amazon Redshift. Some Amazon Redshift clusters may be configured to require this.|
|Username||The username for the environment connection.|
|Password||For Full SaaS deployment model only. Your Redshift password.|
|Secret name||For Hybrid SaaS deployment model only. A named entry created in AWS Secrets Manager.|
|Secret key||For Hybrid SaaS deployment model only. A named secret key tied to your secret name.|
Select data warehouse defaults
|Default role||The default Snowflake role for this environment connection. Read Overview of Access Control to learn more.|
|Default warehouse||The default Snowflake warehouse for this environment connection. Read Overview of Warehouses to learn more.|
|Default database||The default Snowflake database for this environment connection. Read Database, Schema, and Share DDL to learn more.|
|Default schema||The default Snowflake schema for this environment connection. Read Database, Schema, and Share DDL to learn more.|
|Endpoint/Cluster||The Databricks cluster that Data Productivity Cloud will connect to.|
|Catalog||Choose a Databricks Unity Catalog to connect to.|
|Database||Choose a Delta Lake database to connect to.|
|Default database||The database you created when setting up your Amazon Redshift cluster. You may run with multiple database names—in which case, choose the one you want to use for this environment.|
|Default schema||This is public by default, but if you have configured multiple schemas within your Amazon Redshift database, you should specify the schema you want to use.|
Your new environment is listed in the Environment menu.
To edit an environment, click ... for that environment and click Edit environment.
You can sort the Environment menu by name, default agent, or cloud data warehouse account name.
Associate cloud provider credentials with an environment
Each environment in your project must have at least one set of cloud credentials associated with it. This will allow you to access account resources on different platforms other than that hosting your project. For example, if your project is on AWS and you want to access resources in Azure, you need to associate your Azure cloud credentials with the environment.
You can associate credentials from multiple providers, but only one set of credentials for each cloud provider. For example, you can associate both AWS and Azure credentials, but not two different AWS credentials.
You can associate credentials with an environment when you first Create cloud provider credentials, or you can associate them later as follows:
- In your project, click the Environments tab.
- Click the more button ... on the corresponding row of the environment you want to associate, and select Associate Credentials.
- Select the credentials from the drop-down lists. You can associate one set of credentials for each cloud provider.
- Click Associate.