Hybrid SaaS setup guide (AWS)

This topic outlines the accounts and resources you need for Snowflake and AWS before you can set up the Data Productivity Cloud as a Hybrid SaaS solution for creating your data pipelines.

---

Prerequisites

Snowflake

You need a Snowflake account and access to both your login credentials and your account URL.

AWS - account and permissions

• You need an AWS account.
• Your AWS account requires privileges/permissions to use the CloudFormation template and the ability to create the following AWS resources:
  • ECS Clusters
  • Task Definitions
  • IAM roles for task execution. For more information, read IAM roles for Amazon ECS.
  • S3 Buckets
  • CloudWatch Log Groups
  • AWS Secrets Manager.
  • The AWSServiceRoleForECS role.

For a visualization of the deployed resources, read Created resources in agent installation using a CloudFormation quick-create link.

AWS resources

• Your AWS account also needs access to the following AWS resources:
  • A virtual private cloud (VPC).
  • A subnet (private)
  • A security group, minimally allowing access. For more information, read Allowing IP addresses.
  • A secrets manager to store your passwords, API keys, bearer tokens, and so on.

---

Launching process

Before you begin using the Data Productivity Cloud, you need to:

• Register for a Hub account
• Set up and deploy the agent
• Store required credentials

Getting started in the Matillion Hub

• Register for a Matillion Hub account. For more information, read Registration. By default, newly registered Hub accounts start the 14-day free trial. For more information, read Free trial.
• Create accounts in the Hub for all users and admins who will be active during the trial.
• It's recommended that you set up a Pay-Go subscription. This subscription isn't required for the period of your trial, but having a subscription in place will prevent system lockout when the trial period expires.

Agent setup

• Create a new Data Productivity Cloud agent in the Data Productivity Cloud.
• Deploy a Fargate agent in AWS using the recommended CloudFormation method.
• Check out the video walkthrough to learn how to create a Data Productivity Cloud agent and see how you can run AWS CloudFormation.

Required credentials

• Matillion lets you create referential secret definitions to store passwords, credentials, and secrets. You'll use secret definitions for connecting to any cloud data platforms, APIs, and data sources (Facebook, Salesforce, and so on) using passwords, API keys, and bearer tokens.
• If you're using cloud storage, such as Amazon S3, Azure Blob storage, or Google Cloud Storage, you are required to set up cloud provider credentials with your cloud provider.

---

Create a project

Once you have satisfied the prerequisites for getting started:

1. Log in to Matillion Hub or register for an account.
2. Select your account.
3. From the dashboard, click ☰ → Designer.
4. Click Add new project and create your new project.