...
See Configuring Data Retention Settings for instructions on customizing test and coverage storage settings.
Environments - Top 5 Table
Changed Tests - Statistics
This widget shows the five environments with the most tests for the specified project. This widget will only show data if the exec.env property was configured in the connected Parasoft test execution tool. This property specifies a list of tags that describe the environment where a test session was executed, such as operating system, architecture, compiler, browser, and so on. Refer to the documentation for your tool for configuration details.how many test cases changed status from the Baseline build to the Target build. The following changes are reported:
- Passed to failed
- Failed to passed
- New test cases
- Missing test cases
| Excerpt Include+ | ||||
|---|---|---|---|---|
|
Actions
- Click on a link in the Name column to open the Test Explorer filtered by the test environment.
- Click the more... link to open the Environments drill-down report. The report shows the same information as the widget, but includes all environments in the build, not just the five with the most tests.
In the report, you can click on a link in the Name column to open the Test Explorer filtered by the test environment.
Custom Dashboard Properties
Use the following properties when adding this widget to a custom dashboard (see Custom Dashboard Templates for details):
| Code Block |
|---|
"name": "environments",
"type": "internal",
"id": "c73c0b68-4ba7-4dfe-b8e1-cf16f4e8d864" |
Settings
| Scroll Table Layout | ||
|---|---|---|
|
...
Jenkins Test Result - Percent
This widget shows the test results for a Jenkins Job.
| Excerpt Include+ | ||||||||
|---|---|---|---|---|---|---|---|---|
|
Actions
Click the widget to view the test results in Jenkins in a new window.
Custom Dashboard Properties
Use the following properties when adding this widget to a custom dashboard (see Custom Dashboard Templates for details):
| Code Block |
|---|
"name": "jenkins_test_result",
"type": "native",
"id": "63919e5a-f58b-4964-a3b8-534879be95e9" |
Settings
| Scroll Table Layout | ||
|---|---|---|
|
...
(Optional) Specify a username to access the Jenkins server. The user must have access to the project.
If you do not provide a specific user login, the Jenkins server must allow anonymous read access for the Jenkins-based widgets to function properly.
...
(Optional) Specify a password for the user to access the Jenkins server. The user must have access to the project.
If you do not provide a specific user login, the Jenkins server must allow anonymous read access for the Jenkins-based widgets to function properly.
Modules - Top 5 Table
This widget shows the five modules with the most tests for a specified project. You can configure the widget to show all, passing, failing, or incomplete tests. The table headers for the the # and % columns change based on the data you want to show. Table cells in these columns are also color-coded per the widget configuration.
| Excerpt Include+ | ||||||||
|---|---|---|---|---|---|---|---|---|
|
...
| Scroll Table Layout | ||
|---|---|---|
|
...
|
Widget Configuration
| Scroll Table Layout | ||
|---|---|---|
|
| Title | Enter a new title to replace the default title that appears on the dashboard. |
|---|---|
| Filter | Choose Dashboard Settings to use the dashboard filter or choose a filter from the menu. |
| Period | Choose Dashboard Settings to use the dashboard date range or choose a period from the menu. |
| Baseline Build | Choose a build from the menu to set the initial data for comparison. |
| Target Build | Choose a build from the menu to serve as the current data for comparison. |
Actions
Click on a row in the widget to open the Test Explorer filtered according to the type of status change for the selected builds. If you click on the # Pass→Fail or # Fail→Pass status change link, the ability to limit the results will be disabled in the Test Explorer. Also see Using the Search Panel.
Custom Dashboard Properties
Use the following properties when adding this widget to a custom dashboard (see Custom Dashboard Templates for details):
| Code Block |
|---|
"name": "Tests - Changed - Statistics"
"type": "native"
"id": "121c1935-0bd7-487f-a965-120daf945b16" |
Environments - Table
This widget shows the five environments with the most tests for the specified project. This widget will only show data if the exec.env property was configured in the connected Parasoft test execution tool. This property specifies a list of tags that describe the environment where a test session was executed, such as operating system, architecture, compiler, browser, and so on. Refer to the documentation for your tool for configuration details.
| Excerpt Include+ | ||||
|---|---|---|---|---|
|
Actions
- Click on a link in the Name column to open the Test Explorer filtered by the test environment.
- Click the more... link to open the Environments drill-down report. The report shows the same information as the widget, but includes all environments in the build, not just the five with the most tests.
In the report, you can click on a link in the Name column to open the Test Explorer filtered by the test environment.
Custom Dashboard Properties
Use the following properties when adding this widget to a custom dashboard (see Custom Dashboard Templates for details):
| Code Block |
|---|
"name": "environments",
"type": "internal",
"id": "c73c0b68-4ba7-4dfe-b8e1-cf16f4e8d864" |
Settings
| Scroll Table Layout | ||
|---|---|---|
|
| Title | Enter a new title to replace the default title that appears on the dashboard. |
|---|---|
| Filter | Choose Dashboard Settings to use the dashboard filter or choose a filter from the menu. |
| Target Build | Choose a build from the menu. Only the data in this build will display in the widget. |
| Status | Choose a filter to show all tests or only passed, failed, or incomplete tests. |
| Analysis Type | Choose to show information from functional tests, unit tests, or all. |
Jenkins Test Result - Percent
This widget shows the test results for a Jenkins Job.
| Excerpt Include+ | ||||||||
|---|---|---|---|---|---|---|---|---|
|
Actions
Click the widget to view the test results in Jenkins in a new window.
Custom Dashboard Properties
Use the following properties when adding this widget to a custom dashboard (see Custom Dashboard Templates for details):
| Code Block |
|---|
"name": "jenkins_test_result",
"type": "native",
"id": "63919e5a-f58b-4964-a3b8-534879be95e9" |
Settings
| Scroll Table Layout | ||
|---|---|---|
|
| Title | Enter a new title to replace the default title that appears on the dashboard. |
|---|---|
| Jenkins Server | Enter the URL of the Jenkins server. |
| Jenkins Job | Enter the name of the job. |
| Jenkins User | (Optional) Specify a username to access the Jenkins server. The user must have access to the project. If you do not provide a specific user login, the Jenkins server must allow anonymous read access for the Jenkins-based widgets to function properly. |
| Jenkins Auth | (Optional) Specify a password for the user to access the Jenkins server. The user must have access to the project. If you do not provide a specific user login, the Jenkins server must allow anonymous read access for the Jenkins-based widgets to function properly. |
Modules - Table
| Anchor | ||||
|---|---|---|---|---|
|
This widget shows the five modules with the most tests for a specified project. You can configure the widget to show all, passing, failing, or incomplete tests. The table headers for the the # and % columns change based on the data you want to show. Table cells in these columns are also color-coded per the widget configuration.
| Excerpt Include+ | ||||||||
|---|---|---|---|---|---|---|---|---|
|
Widget Configuration
| Anchor | ||||
|---|---|---|---|---|
|
| Scroll Table Layout | ||
|---|---|---|
|
| Title | Enter a new title to replace the default title that appears on the dashboard. |
|---|---|
| Filter | Choose Dashboard Settings to use the dashboard filter or choose a filter from the menu. |
| Period | Choose Dashboard Settings to use the dashboard date range or choose a period from the menu. |
| Target Build | Choose a build from the menu. Only the data in this build will display in the widget. |
| Analysis Type | Choose to show information from functional tests, unit tests, or all. |
| Status | Choose a filter to show all tests or only passed, failed, or incomplete tests. |
| Upper Bound | Enter a value to determine an unacceptable number of failed tests per module. Values higher than this number will be color coded red. |
| Lower Bound | Enter a value to determine an acceptable number of failed tests per module. Values lower than this number will be color coded green. |
| Percentage Upper Bound | Enter a value to determine an unacceptable percentage of passing tests. Values higher than this number will be color coded red. |
| Percentage Lower Bound | Enter a value to determine an unacceptable percentage of passing tests. Values lower than this number will be color coded green. |
Actions
Click on a module in the widget to open the Test Explorer filtered by the selected module. See Test Explorer.
Custom Dashboard Properties
You can add this widget to your custom dashboards by specifying the following properties in the dashboard definition JSON file (see Custom Dashboard Templates for details):
| Code Block |
|---|
"name": "modules",
"type": "native",
"id": "52a62be4-b4b2-4c8b-80e8-2e24dfea4ca1" |
Test - Donut
This widget shows the breakdown of passing, failing, and incomplete tests in a donut chart.
| Excerpt Include+ | ||||
|---|---|---|---|---|
|
Widget Configuration
| Scroll Table Layout | ||
|---|---|---|
|
| Title | Enter a new title to replace the default title that appears on the dashboard. |
|---|---|
| Filter | Choose Dashboard Settings to use the dashboard filter or choose a filter from the menu. |
| Target Build | Choose a build from the menu to serve as the current data for comparison. |
| Analysis Type | Choose an option from the menu to show all tests, functional tests, unit tests, or manual tests. You can also choose Other to view non-standard tests, such as functional/manual test hybrids. |
Actions
You can perform the following actions:
- Hover your pointer over a segment to view additional details about the tests grouped into the segment.
- Click on a segment to view the tests grouped in the segment in the Test Explorer.
- Click on the center of the widget to view all tests reported in the widget in the Test Explorer.
Actions
Click on a module in the widget to open the Test Explorer filtered by the selected module. See Test Explorer.
Custom Dashboard Properties
You can add this widget to your custom dashboards by specifying the following properties in the dashboard definition JSON file (see Custom Dashboard Templates for details):
| Code Block |
|---|
"name": "modules",
"type": "native",
"id": "52a62be4-b4b2-4c8b-80e8-2e24dfea4ca1" |
Portfolio - Test Statistics
This widget shows the test statistics for the filters in the specified portfolio. You can show test results for all environments or constrain results to test runs in a specific environment. Refer to the Configuring Portfolios section for details about configuring portfolios in DTP.
The widget shows the percentage of passing tests, number of passed tests, number of failed tests, and total number of tests.
If you are a member of a project associated with a filter in the portfolio, you will see an entry in the widget for that filter. See Adding Teams to Projects for additional information about team membership or Permissions for information about built-in user permissions in DTP.
Excerpt Include+ scrollEditorUrl /display/DTPDEVEL/.Build+Results+Widgets+v2020.1 scrollEditorDisplayTitle Build Results Widgets nopanel true scrollPageId 0A010204015824B6290C5A6D153D154E
Widget Configuration
| Scroll Table Layout | ||
|---|---|---|
|
...
Enter a build ID to use across all filters. If no build ID is specified, the latest build is used by default.
Refer to Build Administration for additional information about build IDs.
...
Choose Yes from the menu to include the Build column in the widget. The Build column shows the build ID specified in the Build field.
Choose No to hide the Build column. If the Build column is not included, you can view the build ID by hovering your pointer over a filter in the Filter column.
Refer to Build Administration for additional information about build IDs.
...
Choose a test environment from the menu to constrain the test results to a specific environment. This value is specified during the test execution with the exec.env setting. Refer to the documentation for your test execution tool for additional information.
You can also choose All (default) to view test statistics for all environments associated with the build.
...
The DTP dashboard is a six-column wide grid that can have an unlimited number of rows. Specify how many columns the widget should span. Default is 3.
...
The DTP dashboard is a six-column wide grid that can have an unlimited number of rows. Specify how many rows the widget should span. Default is 2.
...
Actions
Click on a link to open the Violations Explorer view filtered by severity and project filter.
...
Custom Dashboard Properties
You can add this widget to your custom dashboards by specifying the following properties in the dashboard definition JSON file (see Custom Dashboard Templates for details):
| Code Block |
|---|
"name": "portfolio.teststest_statisticsdonut", "type": "nativeinternal", "iduuid": "191ea6d054fdc77c-69c4e325-4399418f-b68e8d5a-512e41714806bfdf2a2b5144" |
Test -
...
Statistics
This widget shows the breakdown percentage of passing , failing, and incomplete tests in a donut chart.Excerpt Include+
Widget Configuration
| Scroll Table Layout | ||
|---|---|---|
|
| Title | Enter a new title to replace the default title that appears on the dashboard. |
|---|---|
| Filter | Choose Dashboard Settings to use the dashboard filter or choose a filter from the menu. |
| Period | Choose Dashboard Settings to use the dashboard date range or choose a period from the menu. |
| Target Build | Choose a build from the menu to serve |
| as the current data for comparison. | |
| Baseline Build | Choose a build from the menu to set the initial data for comparison. |
|---|---|
| Analysis Type | Choose |
| to show information from all tests, functional tests, manual tests, unit tests, or |
Actions
You can perform the following actions:
...
| other. A test classified as other may include non-standard tests, such as functional/manual test hybrids. |
Actions
Click on the widget to open the tests explorer view. See Test Explorer.
...
Custom Dashboard Properties
You can add this widget to your custom dashboards by specifying the following properties in the dashboard definition JSON file (see Custom Dashboard Templates for details):
| Code Block |
|---|
"name": "test_donut", "type": "internalnative", "uuid": "54fdc77c-e325-418f-8d5a-bfdf2a2b5144" |
Test - Statistics
30a9391e-15a4-4e51-bb98-0528eff83df1" |
Test - Summary Trend
This widget shows the percentage of unit tests that are succeeding, as well as the change in the success rate.
| Excerpt Include+ | ||||||||
|---|---|---|---|---|---|---|---|---|
|
Widget Configuration
| Scroll Table Layout | ||
|---|---|---|
|
| Title | Enter a new title to replace the default title that appears on the dashboard. |
|---|---|
| Filter | Choose Dashboard Settings to use the dashboard filter or choose a filter from the menu. |
| Period | Choose Dashboard Settings to use the dashboard date range or choose a period from the menu. |
| Target Build | Choose a build from the menu to serve as the current data for comparison. |
| Baseline Build | Choose a build from the menu to set the initial data for comparison. |
| Analysis Type | Choose to show information from all tests, functional tests, manual tests, unit tests, or other. A test classified as other may include non-standard tests, such as functional/manual test hybrids. |
| Status | Choose a filter to show all tests , such as functional/manual test hybridsor only passed, failed, or incomplete tests. |
Actions
Click on the widget to open the tests explorer view. See Test Explorer.
Custom Dashboard Properties
You can add this widget to your custom dashboards by specifying the following properties in the dashboard definition JSON file (see Custom Dashboard Templates for details):
| Code Block |
|---|
"name": "test.summary_trend", "type": "native", "uuid": "30a9391e73beb50d-15a4e5d4-4e514670-bb9888f5-0528eff83df1e3cde6ba3466" |
Test -
...
Trend
This widget shows the percentage of unit tests that are succeeding, as well as the change in the success rate.change in number of tests over the specified period of time. Tests are color coded according to their status:
- Green areas represent passing tests
- Red areas represent failed tests
- Yellow areas represent incomplete tests
If a build does not have test data, the dark trend line will have a gap.Excerpt Include+
Widget Configuration
| Scroll Table Layout | ||
|---|---|---|
|
| Title | Enter a new title to replace the default title that appears on the dashboard. |
|---|---|
| Filter | Choose Dashboard Settings to use the dashboard filter or choose a filter from the menu. |
| Period | Choose Dashboard Settings to use the dashboard date range or choose a period |
| from the menu |
| . |
| Analysis Type | Choose to show information from all tests, functional tests, manual tests, unit tests, or other. A test classified as other may include non-standard tests, such as functional/manual test hybrids. |
|---|
Actions
Mouse over an area in the graph to see of the number of passed, failed,
...
and incomplete tests in a tooltip.
...
Click on the widget to open the tests explorer Test Trend overlay report.
This report provides build-to-build information about changes in tests statuses. Click on a link in the report to open the Tests Explorer view. See Test Explorer.
Custom Dashboard Properties
You can add Use the following properties when adding this widget to your custom dashboards by specifying the following properties in the dashboard definition JSON file a custom dashboard (see Custom Dashboard Templates for details):
| Code Block |
|---|
"name": "test.summary_trend", "type": "native", "uuid": "73beb50dee771586-e5d451b6-4670404b-88f5b87e-e3cde6ba3466d54501c9435c" |
Test Files -
...
Table
This widget shows the change in number of tests over the specified period of time. Tests are color coded according to their status:
- Green areas represent passing tests
- Red areas represent failed tests
- Yellow areas represent incomplete tests
If a build does not have test data, the dark trend line will have a gap.
Widget Configuration
| Scroll Table Layout | ||
|---|---|---|
|
...
five test files with the most test cases for the build and filter.
The widget can be configured to show test data for different types (see Widget Configuration):
- If configured to show function tests, the widget will show .tst files.
- If configured to show unit tests, the widget will show files that contain JUnit, NUnit, or XUnit tests.
The widget can be configured to sort testing files according to counts in its columns (see Widget Configuration):
- The Total column shows the number of test cases. Choose Total from the Sort by menu to sort testing files according to the total number of test cases. This is the default setting.
- The Passed column shows the number of times the test cases in the files have passed. Choose Passed from the Sort by menu to sort testing files according to the number of passed test cases.
- The Failed column shows the number of times the test cases in the files have failed. Choose Failed from the Sort by menu to sort testing files according to the number of tests failed test cases.
- The Incomplete column shows the number of times the test cases in the files reported as incomplete. Choose Incomplete from the Sort by menu to sort testing files according to the number of tests failed test cases.
| Excerpt Include+ | ||||
|---|---|---|---|---|
|
| Anchor | ||||
|---|---|---|---|---|
|
| Scroll Table Layout | ||
|---|---|---|
|
| Title | Enter a new title to replace the default title that appears on the dashboard. |
|---|---|
| Filter | Choose Dashboard Settings to use the dashboard filter or choose a filter from the menu. |
| Target Build | Choose a build from the menu to serve as the current data for comparison. |
| Analysis Type | Choose an option from the menu to show all tests, functional tests, unit tests, or manual tests. You can also choose Other to view non-standard tests, such as functional/manual test hybrids. |
| Sort by | Choose an option from the menu to specify how the files should be sorted in the table. Default is Total. |
Actions
- Click on a link in the File Name column to open the file in the Test Explorer.
- Click on the more... link to open the Test Files report, which shows all test files for the build/filter.
You can perform the following actions in the Test Files report:
- Click on a column header to sort the data by that column.
- Click on a link in the File column to open the file in the Test Explorer.
- Click on a link in the Total, Passed, Failed, or Incomplete column to view the tests in the Test Explorer.
Custom Dashboard Properties
Use the following properties when adding this widget to a custom dashboard (see Custom Dashboard Templates for details):
| Code Block |
|---|
"name": "test_files"
"type": "internal"
"id": "4cb96c4c-e4ee-40ac-aee0-8809fba92722" |
Test Statistics - Portfolio
This widget shows the test statistics for the filters in the specified portfolio. You can show test results for all environments or constrain results to test runs in a specific environment. Refer to the Configuring Portfolios section for details about configuring portfolios in DTP.
The widget shows the percentage of passing tests, number of passed tests, number of failed tests, and total number of tests.
If you are a member of a project associated with a filter in the portfolio, you will see an entry in the widget for that filter. See Adding Teams to Projects for additional information about team membership or Permissions for information about built-in user permissions in DTP.
Excerpt Include+ scrollEditorUrl /display/DTPDEVEL/.Build+Results+Widgets+v2020.1 scrollEditorDisplayTitle Build Results Widgets nopanel true scrollPageId 0A010204015824B6290C5A6D153D154E
Widget Configuration
| Scroll Table Layout | ||
|---|---|---|
|
| Title | Enter a new title to replace the default title that appears on the dashboard. |
|---|---|
| Portfolio | Choose the name of the portfolio from the menu. See Configuring Portfolios for additional information. |
| Build | Enter a build ID to use across all filters. If no build ID is specified, the latest build is used by default. Refer to Build Administration for additional information about build IDs. |
| Show Build Column | Choose Yes from the menu to include the Build column in the widget. The Build column shows the build ID specified in the Build field. Choose No to hide the Build column. If the Build column is not included, you can view the build ID by hovering your pointer over a filter in the Filter column. Refer to Build Administration for additional information about build IDs. |
| Test Environment | Choose a test environment from the menu to constrain the test results to a specific environment. This value is specified during the test execution with the You can also choose All (default) to view test statistics for all environments associated with the build. |
| Width | The DTP dashboard is a six-column wide grid that can have an unlimited number of rows. Specify how many columns the widget should span. Default is Also seeAbout the Dashboard Grid. |
| Height | The DTP dashboard is a six-column wide grid that can have an unlimited number of rows. Specify how many rows the widget should span. Default is Also seeAbout the Dashboard Grid. |
Actions
Click on a link to open the Violations Explorer view filtered by severity and project filter.
Click on a column header to sort the data.
Custom Dashboard Properties
You can add this widget to your custom dashboards by specifying the following properties in the dashboard definition JSON file
Actions
Mouse over an area in the graph to see of the number of passed, failed, and incomplete tests in a tooltip.
Click on the widget to open the Test Trend overlay report.
This report provides build-to-build information about changes in tests statuses. Click on a link in the report to open the Tests Explorer view. See Test Explorer.
Custom Dashboard Properties
Use the following properties when adding this widget to a custom dashboard (see Custom Dashboard Templates for details):
| Code Block |
|---|
"name": "test.trend",
"type": "native",
"uuid": "ee771586-51b6-404b-b87e-d54501c9435c" |
Test Files - Top 5 Table
This widget shows five test files with the most test cases for the build and filter.
The widget can be configured to show test data for different types (see Widget Configuration):
- If configured to show function tests, the widget will show .tst files.
- If configured to show unit tests, the widget will show files that contain JUnit, NUnit, or XUnit tests.
The widget can be configured to sort testing files according to counts in its columns (see Widget Configuration):
- The Total column shows the number of test cases. Choose Total from the Sort by menu to sort testing files according to the total number of test cases. This is the default setting.
- The Passed column shows the number of times the test cases in the files have passed. Choose Passed from the Sort by menu to sort testing files according to the number of passed test cases.
- The Failed column shows the number of times the test cases in the files have failed. Choose Failed from the Sort by menu to sort testing files according to the number of tests failed test cases.
- The Incomplete column shows the number of times the test cases in the files reported as incomplete. Choose Incomplete from the Sort by menu to sort testing files according to the number of tests failed test cases.
| Excerpt Include+ | ||||
|---|---|---|---|---|
|
...
| Scroll Table Layout | ||
|---|---|---|
|
...
Choose an option from the menu to show all tests, functional tests, unit tests, or manual tests. You can also choose Other to view non-standard tests, such as functional/manual test hybrids.
...
Actions
- Click on a link in the File Name column to open the file in the Test Explorer.
- Click on the more... link to open the Test Files report, which shows all test files for the build/filter.
You can perform the following actions in the Test Files report:
- Click on a column header to sort the data by that column.
- Click on a link in the File column to open the file in the Test Explorer.
- Click on a link in the Total, Passed, Failed, or Incomplete column to view the tests in the Test Explorer.
Custom Dashboard Properties
Use the following properties when adding this widget to a custom dashboard (see Custom Dashboard Templates for details):
| Code Block |
|---|
"name": "test_files"
"type": "internal"
"id": "4cb96c4c-e4ee-40ac-aee0-8809fba92722" |
Tests - Changed - Statistics
This widget shows how many test cases changed status from the Baseline build to the Target build. The following changes are reported:
- Passed to failed
- Failed to passed
- New test cases
- Missing test cases
| Excerpt Include+ | ||||||||
|---|---|---|---|---|---|---|---|---|
|
Widget Configuration
| Scroll Table Layout | ||
|---|---|---|
|
...
Actions
Click on a row in the widget to open the Test Explorer filtered according to the type of status change for the selected builds. If you click on the # Pass→Fail or # Fail→Pass status change link, the ability to limit the results will be disabled in the Test Explorer. Also see Using the Search Panel.
Custom Dashboard Properties
Use the following properties when adding this widget to a custom dashboard (see Custom Dashboard Templates for details):
| Code Block |
|---|
"name": "Tests - Changed - Statistics"portfolio.tests_statistics", "type": "native", "id": "121c1935191ea6d0-0bd769c4-487f4399-a965b68e-120daf945b16512e41714806" |