Matillion ETL observability dashboard
The observability dashboard is a feature of the Data Productivity Cloud that lists all Matillion ETL instances currently running jobs. This list shows a real-time State of all instances, and is checked every 5 seconds, but you can click the refresh icon at the top of the page to ensure you're seeing the latest results.
Note
Your Matillion ETL instances must be of version 1.65 or later to work with the observability dashboard.
Accessing the dashboard
There are two ways you can access the observability dashboard:
- Log in to the Data Productivity Cloud.
- In the left navigation, click the Activity icon
. Then, select Pipeline runs from the menu.
Or:
- Log in to the Data Productivity Cloud.
- The Home tab will be open. Click the View pipeline runs tile.
Either of these methods will open Your activity with the Data Productivity Cloud tab displayed.
Matillion ETL activity
The Matillion ETL tab provides instance information about currently running jobs. This list shows a real-time State of all instances. Your instance's status denotes if it's currently Running, Stopped, or there's been an Error.
This list is checked every 5 seconds, but users can click the refresh icon to ensure they're seeing the latest results. Click the pencil icon next to the instance name to add a description for the intended instance. Selecting an instance will expand its details.
Click on either the Matillion ETL instance name or the downward facing arrow to the right of the status to reveal the following properties:
- Platform: The cloud platform your instance resides in.
- Data Warehouse: The cloud data warehouse your instance is using.
- Region: The region your instance resides in. See your cloud platform provider's documentation for details on available regions.
- Size: The instance machine size.
- Matillion version: The version of Matillion ETL running on your instance.
- Last called in: The latest timestamp from your Matillion ETL instance contacting the Data Productivity Cloud. This is done every 5 seconds for running instances. Stopped or Errored instances will cease to "call in".
Note
If you run jobs in your Matillion ETL instance, the details of those jobs will appear here. If no jobs have been run, a message will appear stating "No jobs have been found on this instance. Please run some jobs in Matillion ETL to see them appear here." For more information, read Job activity.
Job activity
Selecting a Matillion ETL instance in the Matillion ETL tab will expand the listing to job activity within the last 24 hours. All job activity is updated in real-time. Entering a job name in the search bar will filter the list.
Jobs have the following properties:
- Started at: The timestamp for when this job began running.
- Job name: The name of the job as given within the Matillion ETL instance. Clicking the job name will open your Matillion ETL instance in a new browser window and navigate to that job run's entry in the Task History.
- Duration: The duration of the job run.
- Status: Either Success or Failed, depending on the job's state when ending.