In this chapter:
Test data can consume substantial storage. In order to preserve space, DTP keeps unit testing data for the last two builds by default. Data for older builds in the filter will be removed during regular database pruning. If you choose a pruned build when configuring widget settings, the following message is displayed:
''No data available. Target build does not have details data."
See Configuring Data Retention Settings for instructions on customizing test and coverage storage settings.
This widget shows the five environments with the most number of tests for the specified project. This widget will only show data if the exec.env
property was configured in the connected Parasoft test execution tool. This property specifies a list of tags that describe the environment where a test session was executed, such as operating system, architecture, compiler, browser, etc. Refer to the documentation for your tool for configuration details.
In the report, you can click on a link in the Name column to open the Test Explorer filtered by the test environment.
Use the following properties when adding this widget to a custom dashboard (see Custom Dashboard Templates for details):
"name": "environments", "type": "internal", "id": "c73c0b68-4ba7-4dfe-b8e1-cf16f4e8d864" |
Title | Enter a new title to replace the default title that appears on the dashboard. |
---|---|
Filter | Choose Dashboard Settings to use the dashboard filter or choose a filter from the drop-down menu. |
Target Build | Choose a build from the drop-down menu. Only the data in this build will display in the widget. |
Status | Choose a filter to show all tests or only passed, failed, or incomplete tests. |
Analysis Type | Choose to show information from functional tests, unit tests, or all. |
This widget shows the test results for a Jenkins Job.
Click the widget to view the test results in Jenkins in a new window.
Use the following properties when adding this widget to a custom dashboard (see Custom Dashboard Templates for details):
"name": "jenkins_test_result", "type": "native", "id": "63919e5a-f58b-4964-a3b8-534879be95e9" |
Title | Enter a new title to replace the default title that appears on the dashboard. |
---|---|
Jenkins Server | URL of the Jenkins server. |
Jenkins Job | Name of the job. |
Jenkins User | Specify a user name to access the Jenkins server. The user must have access to the project. If you do not provide a specific user login, the Jenkins server must allow anonymous read access for the Jenkins-based widgets to function properly. |
Jenkins Auth | Specify a password for the user to access the Jenkins server. The user must have access to the project. If you do not provide a specific user login, the Jenkins server must allow anonymous read access for the Jenkins-based widgets to function properly. |
This widget shows the five modules with the most tests for a specified project. You can configure the widget to show all, passing, failing, or incomplete tests. The table headers for the the # and % columns change based on the data you want to show. Table cells in these columns are also color-coded per the widget configuration.
Title | Enter a new title to replace the default title that appears on the dashboard. |
---|---|
Filter | Choose Dashboard Settings to use the dashboard filter or choose a filter from the drop-down menu. |
Period | Choose Dashboard Settings to use the dashboard date range or choose a period from the drop-down menu. |
Target Build | Choose a build from the drop-down menu. Only the data in this build will display in the widget. |
Analysis Type | Choose to show information from functional tests, unit tests, or all. |
Status | Choose a filter to show all tests or only passed, failed, or incomplete tests. |
Upper Bound | Enter a value to determine an unacceptable number of failed tests per module. Values higher than this number will be color coded red. |
Lower Bound | Enter a value to determine an acceptable number of failed tests per module. Values lower than this number will be color coded green. |
Percentage Upper Bound | Enter a value to determine an unacceptable percentage of passing tests. Values higher than this number will be color coded red. |
Percentage Lower Bound | Enter a value to determine an unacceptable percentage of passing tests. Values lower than this number will be color coded green. |
Click on a module in the widget to open the Test Explorer filtered by the selected module. See Test Explorer.
You can add this widget to your custom dashboards by specifying the following properties in the dashboard definition JSON file (see Custom Dashboard Templates for details):
"name": "modules", "type": "native", "id": "52a62be4-b4b2-4c8b-80e8-2e24dfea4ca1" |
This widget shows the test statistics for the filters in the specified portfolio. You can show test results for all environments or constrain results to test runs in a specific environment. Refer to the Configuring Portfolios section for details about configuring portfolios in DTP.
The widget shows the percentage of passing tests, number of passed tests, number of failed tests, and total number of tests.
If you are a member of a project associated with a filter in the portfolio, you will see an entry in the widget for that filter. See Adding Teams to Projects for additional information about team membership or Permissions for information about built-in user permissions in DTP.
Title | Enter a new title to replace the default title that appears on the dashboard. |
---|---|
Portfolio | Choose the name of the portfolio from the drop-down menu. See Configuring Portfolios for additional information. |
Build | Enter a build ID to use across all filters. If no build ID is specified, the latest build is used by default. Refer to Build Administration for additional information about build IDs. |
Show Build Column | Choose Yes from the drop-down menu to include the Build column in the widget. The Build column shows the build ID specified in the Build field. Choose No to hide the Build column. If the Build column is not included, you can view the build ID by hovering your pointer over a filter in the Filter column. Refer to Build Administration for additional information about build IDs. |
Test Environment | Choose a test environment from the drop-down menu to constrain the test results to a specific environment. This value is specified during the test execution with the You can also choose All (default) to view test statistics for all environments associated with the build. |
Width | The DTP dashboard is a six-column wide grid that can have an unlimited number of rows. Specify how many columns the widget should span. Default is Also see About the Dashboard Grid. |
Height | The DTP dashboard is a six-column wide grid that can have an unlimited number of rows. Specify how many rows the widget should span. Default is Also see About the Dashboard Grid. |
Click on a link to open the Violations Explorer view filtered by severity and project filter.
Click on a column header to sort the data.
You can add this widget to your custom dashboards by specifying the following properties in the dashboard definition JSON file (see Custom Dashboard Templates for details):
"name": "portfolio.tests_statistics", "type": "native", "id": "191ea6d0-69c4-4399-b68e-512e41714806" |
This widget shows the breakdown of passing, failing, and incomplete tests in a donut chart.
Title | Enter a new title to replace the default title that appears on the dashboard. |
---|---|
Filter | Choose Dashboard Settings to use the dashboard filter or choose a filter from the drop-down menu. |
Target Build | Choose a build from the drop-down menu to serve as the current data for comparison. |
Analysis Type | Choose an option from the drop-down menu to show all tests, functional tests, unit tests, or manual tests. You can also choose Other to view non-standard tests, such as functional/manual test hybrids. |
You can perform the following actions:
You can add this widget to your custom dashboards by specifying the following properties in the dashboard definition JSON file (see Custom Dashboard Templates for details):
"name": "test_donut", "type": "internal", "uuid": "54fdc77c-e325-418f-8d5a-bfdf2a2b5144" |
This widget shows the percentage of passing tests, number of tests, number of failed tests, and number of incomplete tests. The widget also identifies changes as trending up or down.
Title | Enter a new title to replace the default title that appears on the dashboard. |
---|---|
Filter | Choose Dashboard Settings to use the dashboard filter or choose a filter from the drop-down menu. |
Period | Choose Dashboard Settings to use the dashboard date range or choose a period from the drop-down menu. |
Target Build | Choose a build from the drop-down menu to serve as the current data for comparison. |
Baseline Build | Choose a build from the drop-down menu to set the initial data for comparison. |
Analysis Type | Choose to show information from all tests, functional tests, manual tests, unit tests, or other. A test classified as other may include non-standard tests, such as functional/manual test hybrids. |
Click on the widget to open the tests explorer view. See Test Explorer.
You can add this widget to your custom dashboards by specifying the following properties in the dashboard definition JSON file (see Custom Dashboard Templates for details):
"name": "test", "type": "native", "uuid": "30a9391e-15a4-4e51-bb98-0528eff83df1" |
This widget shows the percentage of unit tests that are succeeding, as well as the change in the success rate.
Title | Enter a new title to replace the default title that appears on the dashboard. |
---|---|
Filter | Choose Dashboard Settings to use the dashboard filter or choose a filter from the drop-down menu. |
Period | Choose Dashboard Settings to use the dashboard date range or choose a period from the drop-down menu. |
Target Build | Choose a build from the drop-down menu to serve as the current data for comparison. |
Baseline Build | Choose a build from the drop-down menu to set the initial data for comparison. |
Analysis Type | Choose to show information from all tests, functional tests, manual tests, unit tests, or other. A test classified as other may include non-standard tests, such as functional/manual test hybrids. |
Status | Choose a filter to show all tests or only passed, failed, or incomplete tests. |
Click on the widget to open the tests explorer view. See Test Explorer.
You can add this widget to your custom dashboards by specifying the following properties in the dashboard definition JSON file (see Custom Dashboard Templates for details):
"name": "test.summary_trend", "type": "native", "uuid": "73beb50d-e5d4-4670-88f5-e3cde6ba3466" |
This widget shows the change in number of tests over the specified period of time. Tests are colored-coded according to their status:
If a build does not have test data, the dark trend line will have a gap.
Title | Enter a new title to replace the default title that appears on the dashboard. |
---|---|
Filter | Choose Dashboard Settings to use the dashboard filter or choose a filter from the drop-down menu. |
Period | Choose Dashboard Settings to use the dashboard date range or choose a period from the drop-down menu. |
Analysis Type | Choose to show information from all tests, functional tests, manual tests, unit tests, or other. A test classified as other may include non-standard tests, such as functional/manual test hybrids. |
Mouse over an area in the graph to see of the number of passed, failed, and incomplete tests in a tooltip.
Click on the widget to open the Test Trend overlay report.
This report provides build-to-build information about changes in tests statuses. Click on a link in the report to open the Tests Explorer view. See Test Explorer.
Use the following properties when adding this widget to a custom dashboard (see Custom Dashboard Templates for details):
"name": "test.trend", "type": "native", "uuid": "ee771586-51b6-404b-b87e-d54501c9435c" |
This widget shows five test files with the most test cases for the build and filter.
The widget can be configured to show test data for different types (see Widget Configuration):
The widget can be configured to sort testing files according to counts in its columns (see Widget Configuration):
Title | Enter a new title to replace the default title that appears on the dashboard. |
---|---|
Filter | Choose Dashboard Settings to use the dashboard filter or choose a filter from the drop-down menu. |
Target Build | Choose a build from the drop-down menu to serve as the current data for comparison. |
Analysis Type | Choose an option from the drop-down menu to show all tests, functional tests, unit tests, or manual tests. You can also choose Other to view non-standard tests, such as functional/manual test hybrids. |
Sort by | Choose an option from the drop-down menu to specify how the files should be sorted in the table. Default is Total. |
You can perform the following actions in the Test Files report:
Use the following properties when adding this widget to a custom dashboard (see Custom Dashboard Templates for details):
"name": "test_files" "type": "internal" "id": "4cb96c4c-e4ee-40ac-aee0-8809fba92722" |
This widget shows how many test cases changed status from the Baseline build to the Target build. The following changes are reported:
Title | Enter a new title to replace the default title that appears on the dashboard. |
---|---|
Filter | Choose Dashboard Settings to use the dashboard filter or choose a filter from the drop-down menu. |
Period | Choose Dashboard Settings to use the dashboard date range or choose a period from the drop-down menu. |
Baseline Build | Choose a build from the drop-down menu to set the initial data for comparison. |
Target Build | Choose a build from the drop-down menu to serve as the current data for comparison. |
Click on a row in the widget to open the Test Explorer filtered according to the type of status change for the selected builds. If you click on the # Pass→Fail or # Fail→Pass status change link, the ability to limit the results will be disabled in the Test Explorer. Also see Using the Search Panel.
Use the following properties when adding this widget to a custom dashboard (see Custom Dashboard Templates for details):
"name": "Tests - Changed - Statistics" "type": "native" "id": "121c1935-0bd7-487f-a965-120daf945b16" |