Upload file
Thank you for registering your interest in our Upload file feature experiment. We are investigating how we can make the process of you uploading files to your cloud storage service easier.
Using cloud storage for your files
Matillion supports Amazon S3, Azure Blob Storage, and Google Cloud Storage as "direct to storage" locations. These storage locations are also usable as temporary staging areas when you load your data to a cloud data warehouse.
To upload to one of these three storage locations, you'll need:
- A corresponding AWS, Azure, or Google Cloud Platform account.
- Permissions to add objects (files) to the storage location—you'll need to speak to your company's cloud administrator to obtain the correct permissions.
You'll also need to set up cloud provider credentials in the Data Productivity Cloud so that you can access your cloud storage objects.
Cloud storage guides
These guides explain how to use the AWS, Azure, and Google Cloud consoles to set up and add objects to storage locations.
Note
If you're using an Excel spreadsheet, upload it to cloud storage before using the Data Productivity Cloud.
Access your uploaded file
- Log in to the Data Productivity Cloud.
- In the left navigation, click the Projects icon
.
- Choose a project.
- Choose a branch to enter Designer.
- Create a new orchestration pipeline.
- Click the Start component and then click +.
- In the Add component modal, add one of the following components depending on your use case:
- S3 Load - if you wish to load data from your Amazon S3 bucket.
- Azure Blob Storage - if you wish to load data from your Azure Blob Storage account.
- Cloud Storage Load - if you wish to load data from your Google Cloud Storage bucket.
- Excel Query - if you wish to load an Excel spreadsheet from your cloud storage location.
Excel
Let's use Excel as an example.
- After following the steps in Access your uploaded file, add the Excel Query component to the pipeline canvas. When the Excel Query component is highlighted, the properties panel will open on the left-hand side.
- In the Connect section, click into the Storage Type property and choose from one of the three cloud storage options.
- Click into the Storage URL property. As long as you have set up your cloud provider credentials, and you have access to the locations and objects you wish to see, you will be able to use this modal to enter the path to the file or use the folder picker to navigate to the file directly.
You have successfully loaded your cloud storage file into the Data Productivity Cloud.
Continue to set up the Excel Query component (or other component) to prepare your data pipeline to load your data.