Manage External File Sources

Note

From version 1.70, this feature is available for Matillion ETL for Snowflake, Amazon Redshift, and Delta Lake on Databricks.

Manage External File Sources lets you connect to (clone) and sync (pull) with a source code repository hosting service (Bitbucket, GitHub, GitLab, AWS CodeCommit). A connected file source can then be selected in the Sync File Source component.

Currently, the only supported version control system is Git.

---

Cloning a file source

1. Click Project → Manage External File Sources.
2. In the Manage External File Sources overlay, click +.

3. Complete the fields in the Connect External File Source from Git Repository overlay. The table below describes each field.

   Note

   The Password field requires users to create a password entry in Matillion ETL's Manage Passwords feature. To learn more, read Manage Passwords.

   Property	Description
   Source Name	A name for the external file source. This can be the name of your remote repository, if you wish.
   Remote URI	Provide the connection URL of your remote repository (HTTPS).
   Username	The connection username. Matillion ETL can autopopulate this field when reading the Remote URI.
   Password	Select a password entry that is obfuscating your connection password. Click Manage to add your connection password to Manage Passwords. Certain source code repository hosting services require the use of an in-service app to be created—with a password generated and assigned by the service—instead of using a login password to connect to the repository. See the below section Hosting Service Passwords for more information.
   Branch	Specify an existing branch, for example main or master.

4. Click OK to finish.

Manage External File Sources will now list the newly cloned file source. From here, you can click the Sync and Delete buttons if you wish to manage your file source.

You can use the Sync File Source component to sync a file source within an orchestration job.

---

Hosting Service Passwords

Bitbucket

Bitbucket users must create an app password as their connection password. To create an app password, follow these instructions, taken directly from Bitbucket.org/blog:

1. From your profile and settings avatar, select Personal settings.
2. Select App passwords under Access management.
3. Select Create app password.
4. Give the app password a name related to the application that will use the password.
5. Select the specific access and permissions you want to assign to this application password.
6. Copy the generated password and either record or paste it into the application you want to give access. The password is only displayed this one time.