Pipeline Observability dashboard

The Pipeline Observability dashboard is a feature of the Data Productivity Cloud that lists all Data Productivity Cloud pipelines.

---

Accessing the dashboard

There are two ways you can access the Pipeline Observability dashboard:

1. Log in to the Data Productivity Cloud.
2. In the left navigation, click the Activity icon . Then, select Pipeline runs from the menu.

Or:

1. Log in to the Data Productivity Cloud.
2. The Home tab will be open. Click the View pipeline runs tile.

Either of these methods will open Your activity with the Data Productivity Cloud tab displayed.

---

Pipeline run history

The Data Productivity Cloud tab gives you a comprehensive view of your historic pipeline run details. You can view your pipeline run history information for the past 12 months, you can search for a pipeline name, and you can change time frames based on your preference.

Note

• Pipeline run records are kept for one year; pipeline run details are retained for 90 days.
• Some runs may display anomaly warnings if execution time deviates from recent trends. Learn more about Maia's anomaly detection capabilities.

For the Data Productivity Cloud, you can read information about the following:

• Pipeline: The name of the pipeline that has been executed. Clicking this link will take you to a separate page, which will give you metadata about the pipeline, such as pipeline and individual component details, as well as any error logs.
• Source: Where the pipeline was executed.
• Project: The name of your project.
• Status: An indicator if your pipeline is Running, Successful, Failed, or Skipped.
• Environment: The environment your pipeline was executed in.
• Started at/by: The timestamp of when the pipeline was run, and the username or mechanism (such as schedule), it was run by.
• Ended at/duration: The timestamp of when the pipeline finished executing, and how long it took.

Click the link to the right of your pipeline to open your project.

---

Filter pipeline runs

Filter your pipeline runs by clicking the Filter icon next to the Project, Status, and Environment headings at the top of the Your activity page. For example, you can filter by project, by the environment within a specific project, or by the status of a pipeline run. By default, the page displays all pipeline runs across your account, regardless of the project.

Filtering options

• Status: Use the Status filter to view pipeline runs based on their outcome. The available statuses are Failed and Success. Use the checkboxes to select the status you want to view. You can filter by multiple statuses. The page will automatically update to display pipeline runs that match your selections. Click Clear to remove all filters and return to the full list of pipeline runs.
• Project: Use the Project filter to view pipeline runs for a specific project. You can filter by multiple projects. The page will update to show only the pipeline runs associated with the selected project.
• Environment: After selecting a project, you can further filter by Environment to view pipeline runs executed in a specific environment within that project. You can filter by multiple environments. The page will update to reflect your selection.

---

Cancel pipeline runs

To cancel a pipeline that is running:

1. In the left navigation, click the Activity icon . Then, select Pipeline runs from the menu.
2. Ensure that the Data Productivity Cloud tab is open.
3. Locate your running pipeline and click ... .

4. Click Cancel run or Force cancel.

5. Cancel run: This is a "soft" cancellation, and will allow the current task to complete. After that, no other pipeline tasks will run.

6. Force cancel: This is a "hard" cancellation, and will interrupt and terminate the current pipeline task, set the pipeline status to "Stopped", and prevent the pipeline from running any more tasks.

You can also cancel pipeline runs within Designer.