Skip to content

Installing DBT on Matillion ETL

Overview

This guide is for installing dbt on your Matillion ETL instance. You must perform these steps before the Run dbt Command functionality is activated.

:::warning{title='Warning'} If your Matillion ETL is version 1.69 or above, your instance already comes with Python 3.8 and the dbt libraries installed as standard. Therefore, you can ignore this page. :::

For a how-to guide, please see this video.

:::info{title='Note'}

  • Prior to Matillion ETL version 1.70, dbt applies to Matillion ETL for Snowflake only.
  • Your instance must be at least version 1.62.7.

  • Perform these actions as the root user. :::

  • SSH into the Matillion ETL instance and install the following dependencies:

yum install -y centos-release-scl openssl-devel bzip2-devel zlib-devel libffi-devel

yum install -y devtoolset-8

yum install -y git
  1. Install Python 3.7.12
cd /root
wget https://www.python.org/ftp/python/3.7.12/Python-3.7.12.tgz
tar xzf Python-3.7.12.tgz
cd Python-3.7.12
scl enable devtoolset-8 bash
./configure --enable-optimizations
make altinstall
  1. Set the alternatives for Python3 to use Python3.7:
alternatives --install /usr/bin/python3 python3 /usr/local/bin/python3.7 1
  1. upgrade pip:
python3 -m pip install --upgrade pip
  1. Install dbt. This command will install the latest version of dbt:
python3 -m pip install dbt-core dbt-postgres dbt-redshift dbt-snowflake dbt-bigquery
  1. Create a symlink. A symbolic link may need to be set up for the Tomcat user to access the dbt command:
ln -s /usr/local/bin/dbt /usr/bin/dbt