Installing DBT on Matillion ETL
Overview
This guide is for installing dbt on your Matillion ETL instance. You must perform these steps before the Run dbt Command functionality is activated.
:::warning{title='Warning'} If your Matillion ETL is version 1.69 or above, your instance already comes with Python 3.8 and the dbt libraries installed as standard. Therefore, you can ignore this page. :::
For a how-to guide, please see this video.
:::info{title='Note'}
- Prior to Matillion ETL version 1.70, dbt applies to Matillion ETL for Snowflake only.
- Your instance must be at least version 1.62.7.
-
Perform these actions as the root user. :::
-
SSH into the Matillion ETL instance and install the following dependencies:
yum install -y centos-release-scl openssl-devel bzip2-devel zlib-devel libffi-devel
yum install -y devtoolset-8
yum install -y git
- Install Python 3.7.12
cd /root
wget https://www.python.org/ftp/python/3.7.12/Python-3.7.12.tgz
tar xzf Python-3.7.12.tgz
cd Python-3.7.12
scl enable devtoolset-8 bash
./configure --enable-optimizations
make altinstall
- Set the alternatives for Python3 to use Python3.7:
alternatives --install /usr/bin/python3 python3 /usr/local/bin/python3.7 1
- upgrade pip:
python3 -m pip install --upgrade pip
- Install dbt. This command will install the latest version of dbt:
python3 -m pip install dbt-core dbt-postgres dbt-redshift dbt-snowflake dbt-bigquery
- Create a symlink. A symbolic link may need to be set up for the Tomcat user to access the dbt command:
ln -s /usr/local/bin/dbt /usr/bin/dbt