In this chapter:
About Unit Test Data Storage
Test data can consume substantial storage. In order to preserve space, DTP keeps unit testing data for the last two builds by default. Data for older builds in the filter will be removed during regular database pruning. If you choose a pruned build when configuring widget settings, the following message is displayed:
''No data available. Target build does not have details data."
See Configuring Data Retention Settings for instructions on customizing test and coverage storage settings.
Environments - Top 5 Table
This widget shows the five environments with the most number of tests for the specified project. This widget will only show data if the exec.env
property was configured in the connected Parasoft test execution tool. This property specifies a list of tags that describe the environment where a test session was executed, such as operating system, architecture, compiler, browser, etc. Refer to the documentation for your tool for configuration details.
Actions
Click on a link in the Name column to open the Test Explorer filtered by the test environment.
Click the more... link to open the Environments drill-down report. The report shows the same information as the widget, but includes all environments in the build, not just the five with the most tests.
In the report, you can click on a link in the Name column to open the Test Explorer filtered by the test environment.
Custom Dashboard Properties
Use the following properties when adding this widget to a custom dashboard (see Custom Dashboard Templates for details):
"name": "environments", "type": "internal", "id": "c73c0b68-4ba7-4dfe-b8e1-cf16f4e8d864"
Settings
Title | Enter a new title to replace the default title that appears on the dashboard. |
---|---|
Filter | Choose Dashboard Settings to use the dashboard filter or choose a filter from the drop-down menu. |
Target Build | Choose a build from the drop-down menu. Only the data in this build will display in the widget. |
Status | Choose a filter to show all tests or only passed, failed, or incomplete tests. |
Analysis Type | Choose to show information from functional tests, unit tests, or all. |
Jenkins Test Result - Percent
This widget shows the test results for a Jenkins Job.
This widget requires a DTP Enterprise license.
Contact your Parasoft representative for additional information.
Actions
Click the widget to view the test results in Jenkins in a new window.
Custom Dashboard Properties
Use the following properties when adding this widget to a custom dashboard (see Custom Dashboard Templates for details):
"name": "jenkins_test_result", "type": "native", "id": "63919e5a-f58b-4964-a3b8-534879be95e9"
Settings
Title | Enter a new title to replace the default title that appears on the dashboard. |
---|---|
Jenkins Server | URL of the Jenkins server. |
Jenkins Job | Name of the job. |
Jenkins User | Specify a user name to access the Jenkins server. The user must have access to the project. If you do not provide a specific user login, the Jenkins server must allow anonymous read access for the Jenkins-based widgets to function properly. |
Jenkins Auth | Specify a password for the user to access the Jenkins server. The user must have access to the project. If you do not provide a specific user login, the Jenkins server must allow anonymous read access for the Jenkins-based widgets to function properly. |
Modules - Top 5 Table
This widget shows the five modules with the most tests for a specified project. You can configure the widget to show all, passing, failing, or incomplete tests. The table headers for the the # and % columns change based on the data you want to show. Table cells in these columns are also color-coded per the widget configuration.
This widget requires a DTP Enterprise license.
Contact your Parasoft representative for additional information.
Widget Configuration
Title | Enter a new title to replace the default title that appears on the dashboard. |
---|---|
Filter | Choose Dashboard Settings to use the dashboard filter or choose a filter from the drop-down menu. |
Period | Choose Dashboard Settings to use the dashboard date range or choose a period from the drop-down menu. |
Target Build | Choose a build from the drop-down menu. Only the data in this build will display in the widget. |
Analysis Type | Choose to show information from functional tests, unit tests, or all. |
Status | Choose a filter to show all tests or only passed, failed, or incomplete tests. |
Upper Bound | Enter a value to determine an unacceptable number of failed tests per module. Values higher than this number will be color coded red. |
Lower Bound | Enter a value to determine an acceptable number of failed tests per module. Values lower than this number will be color coded green. |
Percentage Upper Bound | Enter a value to determine an unacceptable percentage of passing tests. Values higher than this number will be color coded red. |
Percentage Lower Bound | Enter a value to determine an unacceptable percentage of passing tests. Values lower than this number will be color coded green. |
Actions
Click on a module in the widget to open the Test Explorer filtered by the selected module. See Test Explorer.
Custom Dashboard Properties
You can add this widget to your custom dashboards by specifying the following properties in the dashboard definition JSON file (see Custom Dashboard Templates for details):
"name": "modules", "type": "native", "id": "52a62be4-b4b2-4c8b-80e8-2e24dfea4ca1"
Portfolio - Test Statistics
This widget shows the test statistics for the filters in the specified portfolio. You can show test results for all environments or constrain results to test runs in a specific environment. Refer to the Configuring Portfolios section for details about configuring portfolios in DTP.
The widget shows the percentage of passing tests, number of passed tests, number of failed tests, and total number of tests.
If you are a member of a project associated with a filter in the portfolio, you will see an entry in the widget for that filter. See Adding Teams to Projects for additional information about team membership or Permissions for information about built-in user permissions in DTP.
This widget requires a DTP Enterprise license. Contact your Parasoft representative for additional information.
Widget Configuration
Title | Enter a new title to replace the default title that appears on the dashboard. |
---|---|
Portfolio | Choose the name of the portfolio from the drop-down menu. See Configuring Portfolios for additional information. |
Test Environment | Choose a test environment from the drop-down menu to constrain the test results to a specific environment. This value is specified during the test execution with the You can also choose All (default) to view test statistics for all environments associated with the build. |
Actions
Click on a link to open the Violations Explorer view filtered by severity and project filter.
Click on a column header to sort the data.
Custom Dashboard Properties
You can add this widget to your custom dashboards by specifying the following properties in the dashboard definition JSON file (see Custom Dashboard Templates for details):
"name": "portfolio.tests_statistics", "type": "native", "id": "191ea6d0-69c4-4399-b68e-512e41714806"
Test - Statistics
This widget shows the percentage of passing tests, number of tests, number of failed tests, and number of incomplete tests. The widget also identifies changes as trending up or down.
Widget Configuration
Title | Enter a new title to replace the default title that appears on the dashboard. |
---|---|
Filter | Choose Dashboard Settings to use the dashboard filter or choose a filter from the drop-down menu. |
Period | Choose Dashboard Settings to use the dashboard date range or choose a period from the drop-down menu. |
Target Build | Choose a build from the drop-down menu to serve as the current data for comparison. |
Baseline Build | Choose a build from the drop-down menu to set the initial data for comparison. |
Analysis Type | Choose to show information from all tests, functional tests, manual tests, unit tests, or other. A test classified as other may include non-standard tests, such as functional/manual test hybrids. |
Actions
Click on the widget to open the tests explorer view. See Test Explorer.
Custom Dashboard Properties
You can add this widget to your custom dashboards by specifying the following properties in the dashboard definition JSON file (see Custom Dashboard Templates for details):
"name": "test", "type": "native", "uuid": "30a9391e-15a4-4e51-bb98-0528eff83df1"
Test - Summary Trend
This widget shows the percentage of unit tests that are succeeding, as well as the change in the success rate.
This widget requires a DTP Enterprise license.
Contact your Parasoft representative for additional information.
Widget Configuration
Title | Enter a new title to replace the default title that appears on the dashboard. |
---|---|
Filter | Choose Dashboard Settings to use the dashboard filter or choose a filter from the drop-down menu. |
Period | Choose Dashboard Settings to use the dashboard date range or choose a period from the drop-down menu. |
Target Build | Choose a build from the drop-down menu to serve as the current data for comparison. |
Baseline Build | Choose a build from the drop-down menu to set the initial data for comparison. |
Analysis Type | Choose to show information from all tests, functional tests, manual tests, unit tests, or other. A test classified as other may include non-standard tests, such as functional/manual test hybrids. |
Status | Choose a filter to show all tests or only passed, failed, or incomplete tests. |
Actions
Click on the widget to open the tests explorer view. See Test Explorer.
Custom Dashboard Properties
You can add this widget to your custom dashboards by specifying the following properties in the dashboard definition JSON file (see Custom Dashboard Templates for details):
"name": "test.summary_trend", "type": "native", "uuid": "73beb50d-e5d4-4670-88f5-e3cde6ba3466"
Test - Trend
This widget shows the change in number of tests over the specified period of time. Tests are colored-coded according to their status:
- Green areas represent passing tests
- Red areas represent failed tests
- Yellow areas represent incomplete tests
If a build does not have test data, the dark trend line will have a gap.
Widget Configuration
Title | Enter a new title to replace the default title that appears on the dashboard. |
---|---|
Filter | Choose Dashboard Settings to use the dashboard filter or choose a filter from the drop-down menu. |
Period | Choose Dashboard Settings to use the dashboard date range or choose a period from the drop-down menu. |
Analysis Type | Choose to show information from all tests, functional tests, manual tests, unit tests, or other. A test classified as other may include non-standard tests, such as functional/manual test hybrids. |
Actions
Mouse over an area in the graph to see of the number of passed, failed, and incomplete tests in a tooltip.
Click on the widget to open the Test Trend overlay report.
This report provides build-to-build information about changes in tests statuses. Click on a link in the report to open the Tests Explorer view. See Test Explorer.
Custom Dashboard Properties
Use the following properties when adding this widget to a custom dashboard (see Custom Dashboard Templates for details):
"name": "test.trend", "type": "native", "uuid": "ee771586-51b6-404b-b87e-d54501c9435c"
Tests - Changed - Statistics
This widget shows how many test cases changed status from the Baseline build to the Target build. The following changes are reported:
- Passed to failed
- Failed to passed
- New test cases
- Missing test cases
This widget requires a DTP Enterprise license.
Contact your Parasoft representative for additional information.
Widget Configuration
Title | Enter a new title to replace the default title that appears on the dashboard. |
---|---|
Filter | Choose Dashboard Settings to use the dashboard filter or choose a filter from the drop-down menu. |
Period | Choose Dashboard Settings to use the dashboard date range or choose a period from the drop-down menu. |
Baseline Build | Choose a build from the drop-down menu to set the initial data for comparison. |
Target Build | Choose a build from the drop-down menu to serve as the current data for comparison. |
Actions
Click on a row in the widget to open the Test Explorer filtered according to the type of status change for the selected builds. If you click on the # Pass→Fail or # Fail→Pass status change link, the ability to limit the results will be disabled in the Test Explorer. Also see Using the Search Panel.
Custom Dashboard Properties
Use the following properties when adding this widget to a custom dashboard (see Custom Dashboard Templates for details):
"name": "Tests - Changed - Statistics" "type": "native" "id": "121c1935-0bd7-487f-a965-120daf945b16"