Introduction

The Test Failure Classification extension offers a set of DTP widgets and reports that deliver additional insights into failed tests to help development teams quickly assess overall project quality and make informed decisions about release readiness. It leverages a machine learning model to investigate failed tests and assess the underlying root cause of the failures, helping development triage failed tests more efficiently.  

Requirements

• DTP and DTP Enterprise Pack 2025.1 with Enterprise license

Process Overview

1. Download and install the Test Failure Classification extension into your DTP environment. Installing the package adds several files to DTP that enable test failure classification workflows.
2. Use DTP Extension Designer to deploy the artifact.
3. Execute tests with Parasoft tools.
4. Add labels to failing tests in Test Explorer.
5. Interact with the widgets and reports to gain insights about failing tests, which ones need to be investigated, which ones can be ignored, and so on.

Adding and Configuration the Widget

After deploying the artifact, you can add the Test Failure Predictions widget to your dashboard by clicking the Add Widgets icon. The Test Failure Predictions widget is found in the Tests category. See Adding Widgets for instructions on adding widgets to the dashboard.

Once you have added the widget, you can configure the filter or portfolio as well as the target build. See Managing Widgets for more information about editing widget settings.

Test Failure Predictions Report

In addition to identifying information for each failing test, the Test Failure Predictions Report provides you with two key pieces of information:

• Test Failure Label: Shows the label that has been applied to the failing test if it has been labeled in the past.
• Prediction Aggregate: Gives the predicted root cause for the test failure with a probability based on the machine learning model.