You are viewing an old version of this page. View the current version.

Compare with Current View Page History

« Previous Version 2 Current »

In this section:

About Coverage Data Storage

Coverage data can consume substantial storage. In order to preserve space, DTP keeps coverage data for the last two builds by default. Data for older builds in the filter will be removed during regular database pruning. If you choose a pruned build when configuring widget settings, the following message is displayed:

''No data available. Target build does not have details data."

See Configuring Data Retention Settings for instructions on customizing test and coverage storage settings.

The coverage data retention settings only apply to the following widgets:

Coverage data for the following widgets is stored differently and are not affected by data retention settings in DTP:

Coverage - Percent

This widget shows the percentage of line coverage for a build. The widget can show coverage for either the most recent build or a baselined (locked) build. See Locking and Unlocking a Build (Baseline) for additional information.

Widget Configuration

TitleEnter a new title to replace the default title that appears on the dashboard.
FilterChoose Dashboard Settings to use the dashboard filter or choose a filter from the menu.
Coverage ImageChoose a coverage image from the menu to show coverage data in the widget. See Associating Coverage Images with Filters.
Target BuildChoose a build from the menu to serve as the current data for comparison.

Actions

Click on the widget to open the Coverage Explorer filtered by build and filter. See Coverage Explorer for additional information.

Custom Dashboard Properties

You can add this widget to your custom dashboards by specifying the following properties in the dashboard definition JSON file (see Custom Dashboard Templates for details): 

"name": "coverage",
"type": "native",
"uuid": "a12eefab-25b6-4127-9ad6-a472208142b4"

Coverage - Summary Trend

This widget shows the following information for the selected filter:

  • Current level of line coverage percentage of coverage.
  • Change in line coverage from the previous day (taken from the Period setting).
  • Change in line coverage as a line chart from the baseline build to the target build.

Widget Configuration

TitleEnter a new title to replace the default title that appears on the dashboard.
FilterChoose Dashboard Settings to use the dashboard filter or choose a filter from the menu.
PeriodChoose Dashboard Settings to use the dashboard date range or choose a period from the menu.
Coverage ImageChoose a coverage image from the menu to show coverage data in the widget. See Associating Coverage Images with Filters.
Baseline BuildChoose a build from the menu to set the initial data for comparison.
Target BuildChoose a build from the menu to serve as the current data for comparison.

Actions

  • Click on the widget to open the Coverage Explorer (see Coverage Explorer).
  • Hover over points in the trend line to show coverage for the reported build.

Custom Dashboard Properties

You can add this widget to your custom dashboards by specifying the following properties in the dashboard definition JSON file (see Custom Dashboard Templates for details): 

"name": "coverage",
"type": "native",
"uuid": "bfd6867c-81b8-40f1-ba01-6b3af8914ac1"

Coverage - Trend

This widget shows the change in line coverage over the specified period of time. Gaps in the trend line represent builds that do not have coverage information. 

Widget Configuration

TitleEnter a new title to replace the default title that appears on the dashboard.
FilterChoose Dashboard Settings to use the dashboard filter or choose a filter from the menu.
PeriodChoose Dashboard Settings to use the dashboard date range or choose a period from the menu.
Coverage ImageChoose a coverage image from the drop-down menu to show coverage data in the widget. See  Associating Coverage Images with Filters.

Actions

You can perform the following actions:

  1. Click on the widget to open the Coverage Explorer. See Coverage Explorer.
  2. Hover over an area in the graph to view the coverage for that build.

Custom Dashboard Properties

You can add this widget to your custom dashboards by specifying the following properties in the dashboard definition JSON file (see Custom Dashboard Templates for details): 

"name": "coverage",
"type": "native",
"uuid": "31e7cb3c-1319-4d33-8157-8118771ee3f1"

Jenkins Cobertura Coverage - Percent

This widget requires a DTP Enterprise license.

Contact your Parasoft representative for additional information.

This widget shows the percentage of code covered, number of lines of code covered, and total number of lines for the specified job as reported by the Cobertura plug-in for Jenkins. The Jenkins API must return English for the widget to function properly.

Widget Configuration

TitleEnter a new title to replace the default title that appears on the dashboard.
Jenkins ServerEnter the URL of the Jenkins server, including the protocol (HTTP, HTTPS) and port. This field is required.
Jenkins JobEnter the name of the job. This field is required.
Jenkins User

(Optional) Specify a username to access the Jenkins server. The user must have access to the project.

If you do not provide a specific user login, the Jenkins server must allow anonymous read access for the Jenkins-based widgets to function properly.

Jenkins Auth

(Optional) Specify a password for the user to access the Jenkins server. The user must have access to the project.

If you do not provide a specific user login, the Jenkins server must allow anonymous read access for the Jenkins-based widgets to function properly.

Actions

Click the widget to view the code coverage information in Jenkins in a new window.

Custom Dashboard Properties

You can add this widget to your custom dashboards by specifying the following properties in the dashboard definition JSON file (see Custom Dashboard Templates for details): 

"name": "test.jenkins_cobertura_coverage"
"type": "native",
"uuid": "b9a1c83e-652b-458c-8eb3-e0159f6083be"

Jenkins Cobertura - Summary

This widget shows the code coverage information for the specified job reported by the Cobertura plug-in for Jenkins. It includes the number of lines of code, total lines of code, and build ID of the last run. The Jenkins API must return English for the widget to function properly.

Widget Configuration

TitleEnter a new title to replace the default title that appears on the dashboard.
Jenkins ServerEnter the URL of the Jenkins server, including the protocol (HTTP, HTTPS) and port. This field is required.
Jenkins JobEnter the name of the job. This field is required.
Jenkins User

(Optional) Specify a username to access the Jenkins server. The user must have access to the project.

If you do not provide a specific user login, the Jenkins server must allow anonymous read access for the Jenkins-based widgets to function properly.

Jenkins Auth

(Optional) Specify a password for the user to access the Jenkins server. The user must have access to the project.

If you do not provide a specific user login, the Jenkins server must allow anonymous read access for the Jenkins-based widgets to function properly.

Actions

Click the widget to view the code coverage information in Jenkins in a new window.

Custom Dashboard Properties

You can add this widget to your custom dashboards by specifying the following properties in the dashboard definition JSON file (see Custom Dashboard Templates for details): 

"name": "Jenkins Cobertura - Summary",
"type": "native",
"uuid": "86ee93c1-58d3-4ca7-89d7-cda9b095478c"

Modified Coverage - Percent

This widget helps reduce the testing scope associated with code changes (such as implementing a feature) so testers can focus on the uncovered code and increase their testing efficiency. It also helps teams maintain an audit trail of the risk associated with untested changes. Modified Code Coverage performs the following actions:

  1. Analyzes the coverage data associated with file modifications.
  2. Determines the lines of code in those files that were changed. 
  3. Reports which of the not-yet covered new/modified lines of code can be covered.

The artifact is implemented as a widget that reports the coverage percentage for the lines of code that have been changed since a baseline build. It also graphically indicates the coverage achieved on each new or modified line of code.

Upgrading users

If you are upgrading from a version of DTP prior to 2022.1 and were using the Modified Coverage widget from the Process Intelligence Pack, you will need to manually delete the old widget from your installation. To do so, delete the following file: <DTP_DATA_DIR>/grs/plugins/widgets/coverage.modifiedCodeCoverage.def.json.

Requirements

  • At least one filter in DTP must be configured to receive Run Configurations from coverage analysis runs.
  • Test and coverage data from the following Parasoft tools are supported:
    • C/C++test Standard, dotTEST, and Jtest 10.4.3 or later.
    • C/C++test Professional 10.4.3 or later.
    • SOAtest 9.10.7 or later.
  • Reports published to DTP must have consistent information. Instead of presenting code coverage data, the drill-down report may show N/A if one or more of the reports for the builds lacks proper resource information. Verify that the source-related settings for code analysis tool sending reports to DTP have been properly configured. Refer to the tool’s documentation for additional information.
  • DTP must have access to the source code. You can integrate DTP with your source control system or configure the code analysis tool to publish sources to DTP as part of their analysis. For details, see Configuring Source Code Views

    Information about sources must be consistent

    If DTP reads sources from Parasoft code analysis and testing tool reports, make sure that source information is always included by setting the report.dtp.publish.src property to min or full in either the tool's .properties configuration file (see the tool's documentation) or in the shared project settings in DTP (see Configuring Parasoft Tool Settings for Projects). If DTP reads sources from source control, ensure that the scontrol and report.scontrol properties are properly configured. Gaps, incomplete, or inconsistent source information will prevent the Modified Coverage extension from properly displaying the data.

Locking Builds

DTP continually receives and cleans large amounts data from its database. By default, the unit test and coverage information associated with a build will be automatically deleted after two more builds containing unit test and coverage information are reported to the same DTP project. You can lock builds that contain your baseline data to prevent it from being removed. We recommend keeping the baseline build ID locked while using the build for Modified Coverage and/or for DTP audit reports. You should make sure to lock baseline builds that contain coverage and test data. See Locking and Archiving Builds for details.  

This widget requires a DTP Enterprise license.

Contact your Parasoft representative for additional information.

Widget Configuration

TitleEnter a new title to replace the default title that appears on the dashboard.
FilterChoose Dashboard Settings to use the dashboard filter or choose a filter from the menu.
PeriodChoose Dashboard Settings to use the dashboard period or choose a time range from the menu.
Baseline BuildChoose a build for comparison. By default, Previous Build is selected.
Target BuildChoose the build you want to compare the baseline build to. By default, Latest Build with Data is selected.

By default, Baseline Build is set to Previous Build and Target Build is set to Latest Build with Data. The widget will automatically select the two most recent builds, but these builds may not contain test and coverage details. You should check the Build Administration page in DTP (see Build Administration) and use an appropriate baseline and target build when configuring the widget.

The widget shows the percentage of modified lines of code that have been covered with tests from the baseline build to the target build.

Actions

Click on the widget to open a detailed drill-down report that shows the coverage for each file:

Red and green are used to highlight testable code that was changed between the baseline build and the target build. Green indicates that at least one test case covered the code. Red indicates that no test cases covered the code.

Custom Dashboard Properties

You can add this widget to your custom dashboards by specifying the following properties in the dashboard definition JSON file (see Custom Dashboard Templates for details): 

"name": "modified_code_coverage",
"type": "native",
"uuid": "eeba8492-f110-4046-af7e-063cbcdf033f"

Resource Groups - Top 10 Tree Map


This widget shows the ten resource groups in the filter with the highest percentage of coverage. Each resource group in represented in the widget as a tile. Larger tiles with a deeper color represent resource groups with higher percentages of coverage. 

 A resource group is a collection of resources (files and/or folders) defined by a set of one or more Ant file patterns. See Adding Resource Groups to Projects for additional information about resource groups.

Widget Configuration

TitleEnter a new title to replace the default title that appears on the dashboard.
FilterChoose Dashboard Settings to use the dashboard filter or choose a filter from the menu.
PeriodChoose Dashboard Settings to use the dashboard date range or choose a period from the menu.
Coverage ImageChoose a coverage image from the menu to show coverage data in the widget. See Associating Coverage Images with Filters.
Target BuildChoose a build from the menu that contains the data you want to see.

Actions

Mouse over a tile to view the name of the resource group and coverage. Click on a tile view coverage information about the resource group in the Coverage Explorer.

Custom Dashboard Properties

You can add this widget to your custom dashboards by specifying the following properties in the dashboard definition JSON file (see Custom Dashboard Templates for details): 

"name": "Resource_Groups"
"type": "native",
"id": "2e096c46-3f23-4997-a1a2-664d582522e8"

Resource Groups - Top 5 Table

This widget shows the five resource groups with the highest percentage of coverage. The widget renders a table that you can sort in ascending or descending order in the settings. 

Widget Configuration

TitleEnter a new title to replace the default title that appears on the dashboard.
FilterChoose Dashboard Settings to use the dashboard filter or choose a filter from the menu.
PeriodChoose Dashboard Settings to use the dashboard date range or choose a period from the menu.
Target BuildChoose a build from the menu that contains the data you want to see.
Sort ByChoose an order in which to present the data from the menu.
Coverage ImageChoose a coverage image from the menu to show coverage data in the widget. See Associating Coverage Images with Filters.

Actions

Click on a resource group name to view coverage information about the resource group in the Coverage Explorer

Click on the more... link to view the Resource Groups Report.

Custom Dashboard Properties

You can add this widget to your custom dashboards by specifying the following properties in the dashboard definition JSON file (see Custom Dashboard Templates for details): 

"name": "Resource_Groups"
"type": "native",
"id": "48b9f13c-a968-484d-a69a-48a2cdf39c3f"

C/C++test Coverage Overview - Percent


        C/C++ Professional                     C/C++ NextGen

This widget shows the percentage of test coverage for a run configuration within the filter and target build. Filters may contain several run configurations, which are designated by a session tag and the test configuration name. See Run Configuration for additional information.

This widget only shows coverage information for C/C++test Professional and C/C++test NextGen. C/C++test Standard, dotTEST, and Jtest report line coverage only, whereas C/C++test Professional is capable of reporting several coverage types in addition to line coverage and C/C++test NextGen can report that plus coverage suppressions. If you are using C/C++ NextGen, the widget you see in DTP will show suppressions in parentheses in the numerator, as shown in the example images above.

When configuring the widget, you can choose the following coverage types:

  • Block Coverage
  • Call Coverage
  • Decision Coverage
  • Function Coverage
  • Line Coverage
  • Modified Condition/Decision Coverage (MC/DC)
  • Path Coverage
  • Simple Condition Coverage
  • Statement Coverage

Refer to the C/C++test Professional and C/C++test NextGen documentation for additional information about coverage types and how to collect coverage.

Widget Configuration

TitleEnter a new title to replace the default title that appears on the dashboard.
FilterChoose Dashboard Settings to use the dashboard filter or choose a filter from the menu.
Coverage TypeChoose a coverage type from the menu to show coverage data in the widget. Refer to the C/C++test Professional documentation for additional information about coverage types.
Run ConfigurationChoose a run configuration from the selected filter for which the coverage data will be presented. Run configurations are designated by session tag and test configuration name. See Run Configuration for additional information.
Target BuildChoose a build containing coverage data from the menu.

Actions

Click on the widget to open the C/C++test coverage report. Refer to the C/C++test Professional and C/C++test NextGen documentation for additional information about reports.

Custom Dashboard Properties

You can add this widget to your custom dashboards by specifying the following properties in the dashboard definition JSON file (see Custom Dashboard Templates for details): 

"name": "coverage_overview"
"type": "native",
"id": "7e6bda96-1776-4b8f-b966-50971c1b7160"

C/C++test Coverage Overview - Trend

This widget shows the change in test coverage over time for a run configuration within the filter and target build. Gaps in the trend line represent builds that do not have coverage information for the specified coverage type. Filters may contain several run configurations, which are designated by a session tag and the test configuration name. See Run Configuration for additional information.

This widget only shows coverage information for C/C++test Professional and C/C++test NextGen. C/C++test Standard, dotTEST, and Jtest report line coverage only, whereas C/C++test Professional is capable of reporting several coverage types, in addition to line coverage and C/C++test NextGen can report that plus coverage suppressions. 

When configuring the widget, you can choose the following coverage types:

  • Block Coverage
  • Call Coverage
  • Decision Coverage
  • Function Coverage
  • Line Coverage
  • Modified Condition/Decision Coverage (MC/DC)
  • Path Coverage
  • Simple Condition Coverage
  • Statement Coverage

Refer to the C/C++test Professional and C/C++test NextGen documentation for additional information about coverage types and how to collect coverage.

Widget Configuration

TitleEnter a new title to replace the default title that appears on the dashboard.
Coverage TypeChoose a coverage type from the menu. to show coverage data in the widget. Refer to the C/C++test Professional documentation for additional information about coverage types.
FilterChoose Dashboard Settings to use the dashboard filter or choose a filter from the menu.
PeriodChoose Dashboard Settings to use the dashboard date range or choose a period from the menu.
Run ConfigurationChoose a run configuration from the selected filter for which the coverage data will be presented. Run configurations are designated by session tag and test configuration name. See Run Configuration for additional information.

Actions

They x-axis represents the builds in the specified period. You can hover your pointer over an area of the widget aligned to a build to view the build ID name and precise coverage for the build.

 

Click on the widget to open a dialog containing more detailed coverage information about the builds represented in the widget.

Click on a link in the Build column of the Coverage Trend dialog to open the C/C++test coverage report. If you are using C/C++test NextGen, the "Covered" column as shown in the example above will be "Covererd (+Suppressed)." Refer to the C/C++test Professional and C/C++test NextGen documentation for additional information about reports.

Custom Dashboard Properties

You can add this widget to your custom dashboards by specifying the following properties in the dashboard definition JSON file (see Custom Dashboard Templates for details): 

"name": "coverage_overview"
"type": "native",
"id": "93248a16-f3e0-4719-8cec-0706a13a1d20"
  • No labels