Matillion ETL instance creation
This article provides information about how to create a Matillion ETL instance in the Hub.
The below table shows currently available Matillion ETL products for each cloud provider, and cloud data platform.
| Platform | Amazon Web Services | Google Cloud Platform | Microsoft Azure |
|---|---|---|---|
| Snowflake | Yes | Coming Soon | Yes |
| Redshift | Yes | No | No |
| Delta Lake on Databricks | Yes | No | Yes |
| BigQuery | No | Coming Soon | No |
| Synapse | No | No | Yes |
Prerequisites
- Register for a Hub account. For more information, read Registration.
- Create a trial instance that you will need to associate with your Hub account. As part of this process, you will be required to do the following:
- Configure your Cloud Provider and Cloud Data Platform. It's important you have the correct permissions and account details to enable you to proceed.
- Select a Cloud Provider, Cloud Data Platform, and delivery methods. Since you will need to set up a working Matillion ETL instance, it's important that you are aware of your organization's preferences, and have the correct permissions to configure resources in those respective services.
Creating a Matillion ETL instance
To create a new Matillion ETL instance make sure you have previously registered for a Hub account. Once you have logged in, select Add new Matillion ETL instance from the Services tab of Select your service.
You will now be guided through a series of selections that will define your Matillion ETL instance. Below we outline all potential choices.
Note
- Depending on your choices, some of the below may not be necessary and will not appear to you.
- To launch GCP instances from the Hub, refer to Launching Matillion ETL for GCP for more information.
- Cloud Provider: Select the Cloud Provider you wish to use to host your Matillion ETL instance. It should be noted that this choice determines the available Cloud Data Warehouses and other services (such as storage) as these can be reliant on the services available with that Cloud Platform. The table above outlines which Cloud Data Warehouses are available on each Cloud Platform.
- Cloud Data Platform: Select the type of Cloud Data Platform your Matillion ETL instance will connect to. The data warehouse itself is not set up as part of this launch process; Contact your administrator for details on which Cloud Data Platform to use and how to connect to it. The choices available here will depend on the Cloud Provider you chose in the previous step.
- Delivery method: Depending on your selections so far, you may be given a choice of which method to use to launch your instance, such as from a Machine Image or a template. Choose your deliver method to continue.
- Region: Select the geographic region in which you want to host your Matillion ETL instance. This is potentially important if you have existing resources in a certain region.
- Virtual Private Cloud (VPC): Select a deployment method. For some of these methods, you will be asked to choose between launching the instance in an existing VPC (should you have one) or setting up a new one.
- Template Choice: If you chose to launch using a template as your Delivery Method, you will be prompted to choose between predetermined templates. If, instead, you are launching via a Machine Image, your launch choices will come when selecting the size of the Virtual Machine. For more information, see the following guides:
- Based on your selections so far, Hub will pre-populate your template ready for you to review. To finalize this process, click the Continue in [Cloud Provider] button. Alternatively, click Share with a team member if you don't have the required permissions. This nominated team member will be able to choose the configuration for you.
- You will now be required to configure your new instance within your chosen Cloud Provider. For detailed information on launching your instance for each Cloud Provider, read Launching Matillion ETL overview.
-
Now you have created a Matillion ETL instance, you're required to associate your Matillion ETL Instance with your Hub account.
Note
If you want to know how to configure a connection between your Matillion ETL instance and your Hub account, read, Configuring a connection from Matillion ETL to the Hub.
Max users and environments
Max users
For Hub customers, the maximum number of concurrent users on a Matillion ETL instance is 16 multiplied by the number of physical CPU cores. If an instance has two cores, there can be 32 concurrent users. For more information, read Physical Cores by Amazon EC2 Instance Type.
Max environments
A Hub customer can have up to 9999 environments on their Matillion ETL instance.