Skip to content

Create Project (Amazon Redshift)

A Matillion ETL project is a logical grouping of configuration settings and resources—such as jobs—required to use Matillion ETL. When users first log in to their Matillion ETL instance, they will be required to click Confirm in the Product Improvement Metrics dialog, and then they must create a project when no existing projects are available to select.

These instructions assume you have already successfully launched a Matillion ETL instance.

To create a new project, there are two routes:

  1. The first route is situated in the Join Project dialog, which will appear automatically upon first loading an instance.
  2. The second route can be accessed by clicking Project, then clicking Switch Project, and then (for both methods) clicking Create Project.

There are no practical limits to the number of projects you can create. However, only one project is used by the client session at a time, and each project must have a unique name.

Note

You can connect to a serverless cluster if desired.

Creating a Redshift project on AWS

The following section describes how to create a Project in Matillion ETL for Redshift on AWS instances.

1. Project Details

  • Project Group: Use the drop-down menu to specify an existing name for the project group. Projects are logically arranged in project groups.
  • Project Name: Enter a suitable name for your new project.
  • Project Description: Describe your project. This setting is optional.
  • Private Project: Check this box to make this new project private. Only users granted access can view and work in this project.
  • Include Samples: Uncheck this box if you don't want to include sample jobs in this project.

2. AWS Connection

  • Environment Name: Enter a name for your new Matillion ETL environment.
  • AWS Credentials: Use the drop-down menu to choose credentials for the AWS cloud platform. 'Instance Credentials' is selected by default. Click Manage to add a new set of credentials. Read Manage Credentials for more information.

3. Redshift Connection

  • Redshift Cluster: Use the drop-down menu to select either Custom or an existing Redshift cluster. This can be a serverless cluster. If you select Custom, you will be required to enter information manually into all of the fields situated on this page of the wizard, all of which are described below. However, if you have created an IAM Role, this drop-down menu will list your role-specific Redshift clusters in the same region as your Matillion ETL instance, and the Endpoint, Port, and Username fields will be automatically populated with your Redshift cluster settings.
  • Endpoint: Enter a connection endpoint. This will be the database name or I.P. address.
  • Port: Enter the database port number, this is typically 5439 or 5432. This setting is optional.
  • Username: Enter your username for the environment connection.
  • Password: Enter your password for the environment connection.
  • Enable SSL: Unchecked by default, tick this checkbox if you want to encrypt communications between Matillion and AWS Redshift. Some Redshift clusters may be configured to require this.

Optionally, you can add advanced connection settings to your Redshift connection. Click Manage to open the JDBC Connection Attributes pop-up dialog. Use + to add connection attributes, and enter parameter and value information in the fields provided. For more information, read Configuring connections in Amazon Redshift.

4. Redshift Defaults

  • Database: This will be automatically populated if you selected your Redshift cluster details in the Redshift Cluster drop-down menu earlier. Alternatively, enter the database name manually.
  • Default Schema: This is set to 'public' by default, but if you have configured multiple schemas within your Redshift database, enter the schema you want to use.
  • Default Bucket: Use the drop-down menu to select an S3 bucket where project data will be staged.
  • Concurrent Connections: Specify the number of configured, concurrent connections for existing jobs you want to use, that run in the Redshift environment. For more information, read Multiple environment Connections.

Note

To test the connection you must ensure all fields are populated with information in the Redshift Connection, Redshift Defaults and the JDBC Connection Attributes dialogs. Click Test when you are ready.

Click Finish to create your project and environment.

Further reading