Create project (Snowflake)
A Matillion ETL project is a logical grouping of configuration settings and resources—such as jobs—required to use Matillion ETL. When users first log in to their Matillion ETL instance, they will be required to click Confirm in the Product Improvement Metrics dialog, and then they must create a project when no existing projects are available to select.
These instructions assume you have already successfully launched a Matillion ETL instance.
To create a new project, there are two routes:
- The first route is situated in the Join Project dialog, which will appear automatically upon first loading an instance.
- The second route can be accessed by clicking Project, then clicking Switch Project, and then (for both methods) clicking Create Project.
There are no practical limits to the number of projects you can create. However, only one project is used by the client session at a time, and each project must have a unique name.
Create project
The following section describes how to create a Project in Matillion ETL for Snowflake on AWS instances.
1. Project Details
- Project Group: Use the drop-down menu to specify an existing name for the project group. Projects are logically arranged in project groups.
- Project Name: Enter a name for your new project.
- Project Description: Describe your project. This setting is optional.
- Private Project: Check this box to make this new project private. Only users granted access can view and work in this project.
- Include Samples: Uncheck this box if you do not want to include sample jobs in this project.
2. AWS Connection
- Environment Name: Enter a name for your new Matillion ETL environment.
- AWS Credentials: Use the drop-down menu to choose credentials for the AWS cloud platform. 'Instance Credentials' is selected by default. Click Manage to add a new set of credentials. See Manage Credentials for more information.
- Azure Credentials: Use the drop-down menu to choose credentials for the Azure cloud platform. 'Instance Credentials' is selected by default. Click Manage to add a new set of credentials. See *Manage Credentials for more information.
- GCP Credentials: Use the drop-down menu to choose credentials for the GCP cloud platform. 'Instance Credentials' is selected by default. Click Manage to add a new set of credentials. See Manage Credentials for more information.
Note
Ensure your Instance Credentials are correctly configured for the required cloud platform. For example, the Azure Blob Storage Load component relies on credentials with access to Blob Storage.
3. Snowflake Connection
-
Account: Enter your Snowflake account name and region (part of the URL you use to log in to Snowflake). Do not include "snowflakecomputing.com".
- Uses the format {AccountName}.{region_id}
- Azure users must include the ".azure" part of the URL.
- GCP users must include the ".gcp" part of the URL string.
Note
Matillion ETL alters Snowflake account names that include an underscore and replaces the underscore with a hyphen. Please use hyphens instead of underscores in your Snowflake account name.
The following is a direct quote from the Snowflake documentation on this topic:
URLs that include underscores can sometimes cause issues for certain features, such as Okta SSO/SCIM. For this reason, Snowflake also supports a version of the account name that substitutes the hyphen character (-) in place of the underscore character. For example both of the following URLs are supported:
URL with underscores:
https://acme-marketing_test_account.snowflakecomputing.com
URL with dashes:
https://acme-marketing-test-account.snowflakecomputing.com
-
Username: Enter your Snowflake account username. Make sure your Snowflake account has the above roles and privileges attached.
- Password Type: Use the drop-down menu to select your password type. Choose between Password and Private Key.
- Password: Enter your Snowflake account password.
- Private Key & Passphrase: If you selected Private Key in the Password Type drop-down menu earlier, Snowflake supports using key pair authentication, if you want to use this rather than a password authentication. For more information, read Snowflake Key Pair Authentication.
- Advanced Connection Settings: Optionally, you can add additional connection options to your Snowflake connection. Click Manage to open the JDBC Connection Attributes pop-up dialog. Use the add icon to add connection attributes, and enter Parameter and Value information in the fields provided. For more information, read Configuring the JDBC Driver
4. Snowflake Defaults
- Default Role: Use the drop-down menu to specify the default Snowflake Role this project assumes. This field can be left empty if no changes are needed to the user's role.
- Default Warehouse: Use the drop-down menu to specify the name of the warehouse on your Snowflake account to use by default.
- Default Database: Use the drop-down menu to specify the name of the database on your Snowflake account to use by default.
- Default Schema: Use the drop-down menu to specify the schema you would like to use. This is set as 'public' by default, but if you have configured multiple schemas within your database, specify your preferred schema.
- Default Tag: If you intend to use Snowflake query tagging in your jobs, select a default query tag configuration from the drop-down menu. If you select None, you can still select a tag configuration when the job runs. Read Snowflake query tag configuration to learn more.
- Concurrent Connections: Specify the number of configured, concurrent connections for existing jobs you want to use, that run in the Snowflake environment. For more information, read Multiple Environment Connections.
Note
To test the connection you must ensure all fields are populated with information in the Snowflake Connection and Snowflake Defaults dialogs. Click Test when you are ready.
Click Finish to create your project and environment.
Further reading
If you need to create new Snowflake resources to connect to, read Snowflake Configuration for Matillion ETL.
For help connecting to your Matillion ETL instance, read:
- Accessing the Matillion ETL Client (AWS
- Accessing the Matillion ETL Client (Azure)
- Accessing the Matillion ETL Client (Google Cloud Platform)
For help adding credentials, read Manage Credentials
When you first log in to Matillion ETL, we recommend that you replace your default username and password with your own secure login credentials. Read User configuration in the Admin Menu to learn more.