Installing DBT on Matillion ETL

This guide is for installing dbt on your Matillion ETL instance. You must perform these steps before the Commands for dbt Core functionality is activated.

Warning

If your Matillion ETL instance is version 1.69 or above, your instance already comes with Python 3.8 and the dbt libraries installed as standard. Therefore, you can ignore this page.

For a how-to guide, see this video.

Note

• Prior to Matillion ETL version 1.70, dbt applies to Matillion ETL for Snowflake only.
• Your instance must be at least version 1.62.7.
• Perform these actions as the root user.

1. SSH into the Matillion ETL instance and install the following dependencies:

   yum install -y centos-release-scl openssl-devel bzip2-devel zlib-devel libffi-devel
   

   yum install -y devtoolset-8
   

   yum install -y git
   

2. Install Python 3.7.12

   cd /root
   wget https://www.python.org/ftp/python/3.7.12/Python-3.7.12.tgz
   tar xzf Python-3.7.12.tgz
   cd Python-3.7.12
   scl enable devtoolset-8 bash
   ./configure --enable-optimizations
   make altinstall
   

3. Set the alternatives for Python3 to use Python3.7:

   alternatives --install /usr/bin/python3 python3 /usr/local/bin/python3.7 1
   

4. Upgrade pip:

   python3 -m pip install --upgrade pip
   

5. Install dbt. This command will install the latest version of dbt:

   python3 -m pip install dbt-core dbt-postgres dbt-redshift dbt-snowflake dbt-bigquery
   

6. Create a symlink. A symbolic link may need to be set up for the Tomcat user to access the dbt command:

   ln -s /usr/local/bin/dbt /usr/bin/dbt