Page tree

Skip to end of metadata
Go to start of metadata

In this chapter: 

About Unit Test Data Storage

Test data can consume substantial storage. In order to preserve space, DTP keeps unit testing data for the last two builds by default. Data for older builds in the filter will be removed during regular database pruning. If you choose a pruned build when configuring widget settings, the following message is displayed:

''No data available. Target build does not have details data."

See Configuring Data Retention Settings for instructions on customizing test and coverage storage settings. 

Environments - Top 5 Table

This widget shows the five environments with the most number of tests for the specified project. This widget will only show data if the exec.env property was configured in the connected Parasoft test execution tool. This property specifies a list of tags that describe the environment where a test session was executed, such as operating system, architecture, compiler, browser, etc. Refer to the documentation for your tool for configuration details. 

Actions

Click on a link in the Name column to open the Test Explorer filtered by the test environment. 

Click the more... link to open the Environments drill-down report. The report shows the same information as the widget, but includes all environments in the build, not just the five with the most tests.

In the report, you can click on a link in the Name column to open the Test Explorer filtered by the test environment. 

Custom Dashboard Properties

Use the following properties when adding this widget to a custom dashboard (see Custom Dashboard Templates for details):

"name": "environments",
"type": "internal",
"id": "c73c0b68-4ba7-4dfe-b8e1-cf16f4e8d864"

Settings

TitleEnter a new title to replace the default title that appears on the dashboard.
FilterChoose Dashboard Settings to use the dashboard filter or choose a filter from the drop-down menu.
Target BuildChoose a build from the drop-down menu. Only the data in this build will display in the widget.
StatusChoose a filter to show all tests or only passed, failed, or incomplete tests.
Analysis TypeChoose to show information from functional tests, unit tests, or all.

Jenkins Test Result - Percent

This widget shows the test results for a Jenkins Job. 

This widget requires a DTP Enterprise license.

Contact your Parasoft representative for additional information.

Actions

Click the widget to view the test results in Jenkins in a new window.

Custom Dashboard Properties

Use the following properties when adding this widget to a custom dashboard (see Custom Dashboard Templates for details):

"name": "jenkins_test_result",
"type": "native",
"id": "63919e5a-f58b-4964-a3b8-534879be95e9"

Settings

TitleEnter a new title to replace the default title that appears on the dashboard.
Jenkins ServerURL of the Jenkins server.
Jenkins JobName of the job.
Jenkins User

Specify a user name to access the Jenkins server. The user must have access to the project.

If you do not provide a specific user login, the Jenkins server must allow anonymous read access for the Jenkins-based widgets to function properly.

Jenkins Auth

Specify a password for the user to access the Jenkins server. The user must have access to the project.

If you do not provide a specific user login, the Jenkins server must allow anonymous read access for the Jenkins-based widgets to function properly.


Modules - Top 5 Table


This widget shows the five modules with the most tests for a specified project. You can configure the widget to show all, passing, failing, or incomplete tests. The table headers for the the # and % columns change based on the data you want to show. Table cells in these columns are also color-coded per the widget configuration.

This widget requires a DTP Enterprise license.

Contact your Parasoft representative for additional information.

Widget Configuration 

TitleEnter a new title to replace the default title that appears on the dashboard.
FilterChoose Dashboard Settings to use the dashboard filter or choose a filter from the drop-down menu.
PeriodChoose Dashboard Settings to use the dashboard date range or choose a period from the drop-down menu.
Target BuildChoose a build from the drop-down menu. Only the data in this build will display in the widget.
Analysis TypeChoose to show information from functional tests, unit tests, or all.
StatusChoose a filter to show all tests or only passed, failed, or incomplete tests.
Upper BoundEnter a value to determine an unacceptable number of failed tests per module. Values higher than this number will be color coded red.
Lower BoundEnter a value to determine an acceptable number of failed tests per module. Values lower than this number will be color coded green.
Percentage Upper BoundEnter a value to determine an unacceptable percentage of passing tests. Values higher than this number will be color coded red.
Percentage Lower BoundEnter a value to determine an unacceptable percentage of passing tests. Values lower than this number will be color coded green.

Actions

Click on a module in the widget to open the Test Explorer filtered by the selected module. See Test Explorer.

Custom Dashboard Properties

You can add this widget to your custom dashboards by specifying the following properties in the dashboard definition JSON file (see Custom Dashboard Templates for details):

"name": "modules",
"type": "native",
"id": "52a62be4-b4b2-4c8b-80e8-2e24dfea4ca1"

Portfolio - Test Statistics

This widget shows the test statistics for the filters in the specified portfolio. You can show test results for all environments or constrain results to test runs in a specific environment. Refer to the Configuring Portfolios section for details about configuring portfolios in DTP.

The widget shows the percentage of passing tests, number of passed tests, number of failed tests, and total number of tests.

If you are a member of a project associated with a filter in the portfolio, you will see an entry in the widget for that filter. See Adding Teams to Projects for additional information about team membership or Permissions for information about built-in user permissions in DTP.

This widget requires a DTP Enterprise license.

Contact your Parasoft representative for additional information.

Widget Configuration

TitleEnter a new title to replace the default title that appears on the dashboard.
PortfolioChoose the name of the portfolio from the drop-down menu. See Configuring Portfolios for additional information.
Test Environment

Choose a test environment from the drop-down menu to constrain the test results to a specific environment. This value is specified during the test execution with the exec.env setting. Refer to the documentation for your test execution tool for additional information. 

You can also choose All (default) to view test statistics for all environments associated with the build.

Actions

Click on a link to open the Violations Explorer view filtered by severity and project filter. 

Click on a column header to sort the data.

Custom Dashboard Properties

You can add this widget to your custom dashboards by specifying the following properties in the dashboard definition JSON file (see Custom Dashboard Templates for details):

"name": "portfolio.tests_statistics",
"type": "native",
"id": "191ea6d0-69c4-4399-b68e-512e41714806"

Test - Statistics


This widget shows the percentage of passing tests, number of tests, number of failed tests, and number of incomplete tests. The widget also identifies changes as trending up or down.

Widget Configuration

TitleEnter a new title to replace the default title that appears on the dashboard.
FilterChoose Dashboard Settings to use the dashboard filter or choose a filter from the drop-down menu.
PeriodChoose Dashboard Settings to use the dashboard date range or choose a period from the drop-down menu.
Target BuildChoose a build from the drop-down menu to serve as the current data for comparison.
Baseline BuildChoose a build from the drop-down menu to set the initial data for comparison.
Analysis TypeChoose to show information from all tests, functional tests, manual tests, unit tests, or other. A test classified as other may include non-standard tests, such as functional/manual test hybrids.

Actions

Click on the widget to open the tests explorer view. See Test Explorer.

Custom Dashboard Properties

You can add this widget to your custom dashboards by specifying the following properties in the dashboard definition JSON file (see Custom Dashboard Templates for details):

"name": "test",
"type": "native",
"uuid": "30a9391e-15a4-4e51-bb98-0528eff83df1"

Test - Summary Trend


This widget shows the percentage of unit tests that are succeeding, as well as the change in the success rate.

This widget requires a DTP Enterprise license.

Contact your Parasoft representative for additional information.

Widget Configuration

TitleEnter a new title to replace the default title that appears on the dashboard.
FilterChoose Dashboard Settings to use the dashboard filter or choose a filter from the drop-down menu.
PeriodChoose Dashboard Settings to use the dashboard date range or choose a period from the drop-down menu.
Target BuildChoose a build from the drop-down menu to serve as the current data for comparison.
Baseline BuildChoose a build from the drop-down menu to set the initial data for comparison.
Analysis TypeChoose to show information from all tests, functional tests, manual tests, unit tests, or other. A test classified as other may include non-standard tests, such as functional/manual test hybrids.
StatusChoose a filter to show all tests or only passed, failed, or incomplete tests.

Actions

Click on the widget to open the tests explorer view. See Test Explorer.

Custom Dashboard Properties

You can add this widget to your custom dashboards by specifying the following properties in the dashboard definition JSON file (see Custom Dashboard Templates for details):

"name": "test.summary_trend",
"type": "native",
"uuid": "73beb50d-e5d4-4670-88f5-e3cde6ba3466"

Test - Trend

This widget shows the change in number of tests over the specified period of time. Tests are colored-coded according to their status:

  • Green areas represent passing tests
  • Red areas represent failed tests
  • Yellow areas represent incomplete tests

If a build does not have test data, the dark trend line will have a gap.

Widget Configuration

TitleEnter a new title to replace the default title that appears on the dashboard.
FilterChoose Dashboard Settings to use the dashboard filter or choose a filter from the drop-down menu.
PeriodChoose Dashboard Settings to use the dashboard date range or choose a period from the drop-down menu.
Analysis TypeChoose to show information from all tests, functional tests, manual tests, unit tests, or other. A test classified as other may include non-standard tests, such as functional/manual test hybrids.

Actions

Mouse over an area in the graph to see of the number of passed, failed, and incomplete tests in a tooltip.

Click on the widget to open the Test Trend overlay report.

This report provides build-to-build information about changes in tests statuses. Click on a link in the report to open the Tests Explorer view. See Test Explorer.

Custom Dashboard Properties

Use the following properties when adding this widget to a custom dashboard (see Custom Dashboard Templates for details):

"name": "test.trend",
"type": "native",
"uuid": "ee771586-51b6-404b-b87e-d54501c9435c"

Tests - Changed - Statistics


This widget shows how many test cases changed status from the Baseline build to the Target build. The following changes are reported:

  • Passed to failed
  • Failed to passed
  • New test cases
  • Missing test cases 

This widget requires a DTP Enterprise license.

Contact your Parasoft representative for additional information.

Widget Configuration

TitleEnter a new title to replace the default title that appears on the dashboard.
FilterChoose Dashboard Settings to use the dashboard filter or choose a filter from the drop-down menu.
PeriodChoose Dashboard Settings to use the dashboard date range or choose a period from the drop-down menu.
Baseline BuildChoose a build from the drop-down menu to set the initial data for comparison.
Target BuildChoose a build from the drop-down menu to serve as the current data for comparison.

Actions

Click on a row in the widget to open the Test Explorer filtered according to the type of status change for the selected builds. If you click on the # Pass→Fail or # Fail→Pass status change link, the ability to limit the results will be disabled in the Test Explorer. Also see Using the Search Panel.  

Custom Dashboard Properties

Use the following properties when adding this widget to a custom dashboard (see Custom Dashboard Templates for details):

"name": "Tests - Changed - Statistics"
"type": "native"
"id": "121c1935-0bd7-487f-a965-120daf945b16"
  • No labels