Introduction

The Parasoft Findings extension is designed to be used in a post test-execution build step that integrates functional and unit test reports generated by Parasoft tools into your Visual Studio Team Services project. The task will collect test results from the Parasoft report XML files and display the number of passed/failed tests and result details. The results can also be displayed as trending data in a graph for a simple visualization.

The extension can consume the following report types:

• Parasoft SOAtest 9.x XML reports.
• Parasoft Analyzers 10.x XML reports generated by Parasoft C/C++test, Jtest and dotTEST tools.

Requirements

• Agent version 2.0.0 or higher.
• Java 6 or higher available on the host path.

Installing the Parasoft Findings Extension

1. Sign into the Visual Studio Marketplace and click the Visual Studio Team Services tab.
2. Find and select the Parasoft Findings Extension.
3. Click Install.

See Get extensions for Visual Studio Team Services in the Visual Studio Team Services documentation for additional information.

Configuring the Extension

1. Edit an existing build or create a new build and click Add Task.
2. Search for Publish Parasoft Test Results using the search field
3. Select the extension and click Add.
4. In the configuration, section choose the Test result format:
   
   
   
   
5. Review the Test result files field. You can define one or more minimatch patterns in this field to specify which Parasoft XML report files are included in the Visual Studio Team Services build report (see Microsoft's documentation on file matching patterns).

6. Click Save under the Save & Queue menu when finished.

Running the Build

A typical build configuration would consist of the following steps:

1. Clean the build checkout directory. In this step you will clean the Parasoft XML report files left over from the previous build runs. You can configure the following options:
   1. Set the Clean option to true under the Get sources step.
   2. Configure a Command Line runner to clean the Parasoft XML report files left over from the previous runs. For instance, you could run the following command to remove all XML files from the build Checkout Directory:
      
      rm $(System.DefaultWorkingDirectory)/*.xml

2. Run SOAtest, C/C++test, Jtest or dotTEST. This step will generate report files in XML format. The XML report files must be saved in the Visual Studio Team Services build project Checkout Directory.
3. Run the Parasoft Findings extension. You can have multiple Parasoft tool runs that would generate multiple XML report files prior to invoking this build step. If the build steps prior to the Parasoft Findings extension build step generate multiple XML report files, then all test results from all these files will be added to the Visual Studio Team Services build results.

Viewing Results of the Last Build

Open the Visual Studio Team Services build configuration page and click on the last build results link next to the build name. The build results pages contain the appropriate Parasoft tool report details.

The build results overview page tab provides the success and error count:

The build results shown in the Tests tab contains the list of all Parasoft tests that ran in the build.

Clicking the Build step in the build tree displays logging information in case debugging is needed.

Viewing Statistics and Trends

The build results overview page provides a histogram of the number of failing tests for each run. The dashboard also provides widgets for overall test result trends.

To view historical details of a particular Parasoft test, click on a test and click View History. A page with the detailed test history will open.