In this chapter:
About Unit Test Data Storage
Test data can consume substantial storage. In order to preserve space, DTP keeps unit testing data for the last two builds by default. Data for older builds in the filter will be removed during regular database pruning. If you choose a pruned build when configuring widget settings, the following message is displayed:
''No data available. Target build does not have details data."
See Configuring Data Retention Settings for instructions on customizing test and coverage storage settings.
Environments - Top 5 Table
This widget shows the five environments with the most number of tests for the specified project. This widget will only show data if the exec.env property was configured in the connected Parasoft test execution tool. This property specifies a list of tags that describe the environment where a test session was executed, such as operating system, architecture, compiler, browser, etc. Refer to the documentation for your tool for configuration details.
Actions
- Click on a link in the Name column to open the Test Explorer filtered by the test environment.
- Click the more... link to open the Environments drill-down report. The report shows the same information as the widget, but includes all environments in the build, not just the five with the most tests.
In the report, you can click on a link in the Name column to open the Test Explorer filtered by the test environment.
Custom Dashboard Properties
Use the following properties when adding this widget to a custom dashboard (see Custom Dashboard Templates for details):
"name": "environments", "type": "internal", "id": "c73c0b68-4ba7-4dfe-b8e1-cf16f4e8d864"
Settings
| Title | Enter a new title to replace the default title that appears on the dashboard. |
|---|---|
| Filter | Choose Dashboard Settings to use the dashboard filter or choose a filter from the drop-down menu. |
| Target Build | Choose a build from the drop-down menu. Only the data in this build will display in the widget. |
| Status | Choose a filter to show all tests or only passed, failed, or incomplete tests. |
| Analysis Type | Choose to show information from functional tests, unit tests, or all. |
Jenkins Test Result - Percent
This widget shows the test results for a Jenkins Job.
This widget requires a DTP Enterprise license.
Contact your Parasoft representative for additional information.
Actions
Click the widget to view the test results in Jenkins in a new window.
Custom Dashboard Properties
Use the following properties when adding this widget to a custom dashboard (see Custom Dashboard Templates for details):
"name": "jenkins_test_result", "type": "native", "id": "63919e5a-f58b-4964-a3b8-534879be95e9"
Settings
| Title | Enter a new title to replace the default title that appears on the dashboard. |
|---|---|
| Jenkins Server | URL of the Jenkins server. |
| Jenkins Job | Name of the job. |
| Jenkins User | (Optional) Specify a username to access the Jenkins server. The user must have access to the project. If you do not provide a specific user login, the Jenkins server must allow anonymous read access for the Jenkins-based widgets to function properly. |
| Jenkins Auth | (Optional) Specify a password for the user to access the Jenkins server. The user must have access to the project. If you do not provide a specific user login, the Jenkins server must allow anonymous read access for the Jenkins-based widgets to function properly. |
Modules - Top 5 Table
This widget shows the five modules with the most tests for a specified project. You can configure the widget to show all, passing, failing, or incomplete tests. The table headers for the the # and % columns change based on the data you want to show. Table cells in these columns are also color-coded per the widget configuration.
This widget requires a DTP Enterprise license.
Contact your Parasoft representative for additional information.
Widget Configuration
| Title | Enter a new title to replace the default title that appears on the dashboard. |
|---|---|
| Filter | Choose Dashboard Settings to use the dashboard filter or choose a filter from the drop-down menu. |
| Period | Choose Dashboard Settings to use the dashboard date range or choose a period from the drop-down menu. |
| Target Build | Choose a build from the drop-down menu. Only the data in this build will display in the widget. |
| Analysis Type | Choose to show information from functional tests, unit tests, or all. |
| Status | Choose a filter to show all tests or only passed, failed, or incomplete tests. |
| Upper Bound | Enter a value to determine an unacceptable number of failed tests per module. Values higher than this number will be color coded red. |
| Lower Bound | Enter a value to determine an acceptable number of failed tests per module. Values lower than this number will be color coded green. |
| Percentage Upper Bound | Enter a value to determine an unacceptable percentage of passing tests. Values higher than this number will be color coded red. |
| Percentage Lower Bound | Enter a value to determine an unacceptable percentage of passing tests. Values lower than this number will be color coded green. |
Actions
Click on a module in the widget to open the Test Explorer filtered by the selected module. See Test Explorer.
Custom Dashboard Properties
You can add this widget to your custom dashboards by specifying the following properties in the dashboard definition JSON file (see Custom Dashboard Templates for details):
"name": "modules", "type": "native", "id": "52a62be4-b4b2-4c8b-80e8-2e24dfea4ca1"
Portfolio - Coverage Statistics
This widget shows the coverage statistics for the filters in the specified portfolio. Refer to the Configuring Portfolios section for details about configuring portfolios in DTP.
The widget shows the coverage percentage, lines covered, and total lines.
If you are a member of a project associated with a filter in the portfolio, you will see an entry in the widget for that filter. See Adding Teams to Projects for additional information about team membership or Permissions for information about built-in user permissions in DTP.
This widget requires a DTP Enterprise license. Contact your Parasoft representative for additional information.
Widget Configuration
| Title | Enter a new title to replace the default title that appears on the dashboard. |
|---|---|
| Portfolio | Choose the name of the portfolio from the drop-down menu. See Configuring Portfolios for additional information. |
| Build | Enter a build ID to use across all filters. If no build ID is specified, the latest build is used by default. Refer to Build Administration for additional information about build IDs. |
| Show Build Column | Choose Yes from the drop-down menu to include the Build column in the widget. The Build column shows the build ID specified in the Build field. Choose No to hide the Build column. If the Build column is not included, you can view the build ID by hovering your pointer over a filter in the Filter column. Refer to Build Administration for additional information about build IDs. |
| Width | The DTP dashboard is a six-column wide grid that can have an unlimited number of rows. Specify how many columns the widget should span. Default is Also see About the Dashboard Grid. |
| Height | The DTP dashboard is a six-column wide grid that can have an unlimited number of rows. Specify how many rows the widget should span. Default is Also see About the Dashboard Grid. |
Actions
Click on a link to open the Coverage Explorer view for that result.
Click on a column header to sort the data.
Custom Dashboard Properties
You can add this widget to your custom dashboards by specifying the following properties in the dashboard definition JSON file (see Custom Dashboard Templates for details):
"name": "portfolio.coverage_statistics", "type": "native", "id": "4cf20b98-c246-4f5e-8813-72cbaa3f1f50"
Portfolio - Test Statistics
This widget shows the test statistics for the filters in the specified portfolio. You can show test results for all environments or constrain results to test runs in a specific environment. Refer to the Configuring Portfolios section for details about configuring portfolios in DTP.
The widget shows the percentage of passing tests, number of passed tests, number of failed tests, and total number of tests.
If you are a member of a project associated with a filter in the portfolio, you will see an entry in the widget for that filter. See Adding Teams to Projects for additional information about team membership or Permissions for information about built-in user permissions in DTP.
This widget requires a DTP Enterprise license. Contact your Parasoft representative for additional information.
Widget Configuration
| Title | Enter a new title to replace the default title that appears on the dashboard. |
|---|---|
| Portfolio | Choose the name of the portfolio from the drop-down menu. See Configuring Portfolios for additional information. |
| Build | Enter a build ID to use across all filters. If no build ID is specified, the latest build is used by default. Refer to Build Administration for additional information about build IDs. |
| Show Build Column | Choose Yes from the drop-down menu to include the Build column in the widget. The Build column shows the build ID specified in the Build field. Choose No to hide the Build column. If the Build column is not included, you can view the build ID by hovering your pointer over a filter in the Filter column. Refer to Build Administration for additional information about build IDs. |
| Test Environment | Choose a test environment from the drop-down menu to constrain the test results to a specific environment. This value is specified during the test execution with the You can also choose All (default) to view test statistics for all environments associated with the build. |
| Width | The DTP dashboard is a six-column wide grid that can have an unlimited number of rows. Specify how many columns the widget should span. Default is Also see About the Dashboard Grid. |
| Height | The DTP dashboard is a six-column wide grid that can have an unlimited number of rows. Specify how many rows the widget should span. Default is Also see About the Dashboard Grid. |
Actions
Click on a link to open the Violations Explorer view filtered by severity and project filter.
Click on a column header to sort the data.
Custom Dashboard Properties
You can add this widget to your custom dashboards by specifying the following properties in the dashboard definition JSON file (see Custom Dashboard Templates for details):
"name": "portfolio.tests_statistics", "type": "native", "id": "191ea6d0-69c4-4399-b68e-512e41714806"
Test - Donut
This widget shows the breakdown of passing, failing, and incomplete tests in a donut chart.
Widget Configuration
| Title | Enter a new title to replace the default title that appears on the dashboard. |
|---|---|
| Filter | Choose Dashboard Settings to use the dashboard filter or choose a filter from the drop-down menu. |
| Target Build | Choose a build from the drop-down menu to serve as the current data for comparison. |
| Analysis Type | Choose an option from the drop-down menu to show all tests, functional tests, unit tests, or manual tests. You can also choose Other to view non-standard tests, such as functional/manual test hybrids. |
Actions
You can perform the following actions:
- Hover your pointer over a segment to view additional details about the tests grouped into the segment.
- Click on a segment to view the tests grouped in the segment in the Test Explorer.
- Click on the center of the widget to view all tests reported in the widget in the Test Explorer.
Custom Dashboard Properties
You can add this widget to your custom dashboards by specifying the following properties in the dashboard definition JSON file (see Custom Dashboard Templates for details):
"name": "test_donut", "type": "internal", "uuid": "54fdc77c-e325-418f-8d5a-bfdf2a2b5144"
Test - Statistics
This widget shows the percentage of passing tests, number of tests, number of failed tests, and number of incomplete tests. The widget also identifies changes as trending up or down.
Widget Configuration
| Title | Enter a new title to replace the default title that appears on the dashboard. |
|---|---|
| Filter | Choose Dashboard Settings to use the dashboard filter or choose a filter from the drop-down menu. |
| Period | Choose Dashboard Settings to use the dashboard date range or choose a period from the drop-down menu. |
| Target Build | Choose a build from the drop-down menu to serve as the current data for comparison. |
| Baseline Build | Choose a build from the drop-down menu to set the initial data for comparison. |
| Analysis Type | Choose to show information from all tests, functional tests, manual tests, unit tests, or other. A test classified as other may include non-standard tests, such as functional/manual test hybrids. |
Actions
Click on the widget to open the tests explorer view. See Test Explorer.
Custom Dashboard Properties
You can add this widget to your custom dashboards by specifying the following properties in the dashboard definition JSON file (see Custom Dashboard Templates for details):
"name": "test", "type": "native", "uuid": "30a9391e-15a4-4e51-bb98-0528eff83df1"
Test - Summary Trend
This widget shows the percentage of unit tests that are succeeding, as well as the change in the success rate.
This widget requires a DTP Enterprise license.
Contact your Parasoft representative for additional information.
Widget Configuration
| Title | Enter a new title to replace the default title that appears on the dashboard. |
|---|---|
| Filter | Choose Dashboard Settings to use the dashboard filter or choose a filter from the drop-down menu. |
| Period | Choose Dashboard Settings to use the dashboard date range or choose a period from the drop-down menu. |
| Target Build | Choose a build from the drop-down menu to serve as the current data for comparison. |
| Baseline Build | Choose a build from the drop-down menu to set the initial data for comparison. |
| Analysis Type | Choose to show information from all tests, functional tests, manual tests, unit tests, or other. A test classified as other may include non-standard tests, such as functional/manual test hybrids. |
| Status | Choose a filter to show all tests or only passed, failed, or incomplete tests. |
Actions
Click on the widget to open the tests explorer view. See Test Explorer.
Custom Dashboard Properties
You can add this widget to your custom dashboards by specifying the following properties in the dashboard definition JSON file (see Custom Dashboard Templates for details):
"name": "test.summary_trend", "type": "native", "uuid": "73beb50d-e5d4-4670-88f5-e3cde6ba3466"
Test - Trend
This widget shows the change in number of tests over the specified period of time. Tests are colored-coded according to their status:
- Green areas represent passing tests
- Red areas represent failed tests
- Yellow areas represent incomplete tests
If a build does not have test data, the dark trend line will have a gap.
Widget Configuration
| Title | Enter a new title to replace the default title that appears on the dashboard. |
|---|---|
| Filter | Choose Dashboard Settings to use the dashboard filter or choose a filter from the drop-down menu. |
| Period | Choose Dashboard Settings to use the dashboard date range or choose a period from the drop-down menu. |
| Analysis Type | Choose to show information from all tests, functional tests, manual tests, unit tests, or other. A test classified as other may include non-standard tests, such as functional/manual test hybrids. |
Actions
Mouse over an area in the graph to see of the number of passed, failed, and incomplete tests in a tooltip.
Click on the widget to open the Test Trend overlay report.
This report provides build-to-build information about changes in tests statuses. Click on a link in the report to open the Tests Explorer view. See Test Explorer.
Custom Dashboard Properties
Use the following properties when adding this widget to a custom dashboard (see Custom Dashboard Templates for details):
"name": "test.trend", "type": "native", "uuid": "ee771586-51b6-404b-b87e-d54501c9435c"
Test Files - Top 5 Table
This widget shows five test files with the most test cases for the build and filter.
The widget can be configured to show test data for different types (see Widget Configuration):
- If configured to show function tests, the widget will show .tst files.
- If configured to show unit tests, the widget will show files that contain JUnit, NUnit, or XUnit tests.
The widget can be configured to sort testing files according to counts in its columns (see Widget Configuration):
- The Total column shows the number of test cases. Choose Total from the Sort by drop-down menu to sort testing files according to the total number of test cases. This is the default setting.
- The Passed column shows the number of times the test cases in the files have passed. Choose Passed from the Sort by drop-down menu to sort testing files according to the number of passed test cases.
- The Failed column shows the number of times the test cases in the files have failed. Choose Failed from the Sort by drop-down menu to sort testing files according to the number of test failed test cases.
- The Incomplete column shows the number of times the test cases in the files reported as incomplete. Choose Incomplete from the Sort by drop-down menu to sort testing files according to the number of test failed test cases.
Widget Configuration
| Title | Enter a new title to replace the default title that appears on the dashboard. |
|---|---|
| Filter | Choose Dashboard Settings to use the dashboard filter or choose a filter from the drop-down menu. |
| Target Build | Choose a build from the drop-down menu to serve as the current data for comparison. |
| Analysis Type | Choose an option from the drop-down menu to show all tests, functional tests, unit tests, or manual tests. You can also choose Other to view non-standard tests, such as functional/manual test hybrids. |
| Sort by | Choose an option from the drop-down menu to specify how the files should be sorted in the table. Default is Total. |
Actions
- Click on a link in the File Name column to open the file in the Test Explorer.
- Click on the more... link to open the Test Files report, which shows all test files for the build/filter.
You can perform the following actions in the Test Files report:
- Click on a column header to sort the data by that column.
- Click on a link in the File column to open the file in the Test Explorer.
- Click on a link in the Total, Passed, Failed, or Incomplete column to view the tests in the Test Explorer.
Custom Dashboard Properties
Use the following properties when adding this widget to a custom dashboard (see Custom Dashboard Templates for details):
"name": "test_files" "type": "internal" "id": "4cb96c4c-e4ee-40ac-aee0-8809fba92722"
Tests - Changed - Statistics
This widget shows how many test cases changed status from the Baseline build to the Target build. The following changes are reported:
- Passed to failed
- Failed to passed
- New test cases
- Missing test cases
This widget requires a DTP Enterprise license.
Contact your Parasoft representative for additional information.
Widget Configuration
| Title | Enter a new title to replace the default title that appears on the dashboard. |
|---|---|
| Filter | Choose Dashboard Settings to use the dashboard filter or choose a filter from the drop-down menu. |
| Period | Choose Dashboard Settings to use the dashboard date range or choose a period from the drop-down menu. |
| Baseline Build | Choose a build from the drop-down menu to set the initial data for comparison. |
| Target Build | Choose a build from the drop-down menu to serve as the current data for comparison. |
Actions
Click on a row in the widget to open the Test Explorer filtered according to the type of status change for the selected builds. If you click on the # Pass→Fail or # Fail→Pass status change link, the ability to limit the results will be disabled in the Test Explorer. Also see Using the Search Panel.
Custom Dashboard Properties
Use the following properties when adding this widget to a custom dashboard (see Custom Dashboard Templates for details):
"name": "Tests - Changed - Statistics" "type": "native" "id": "121c1935-0bd7-487f-a965-120daf945b16"
