This topic explains how to share Test Configurations (and any rule files or rule mapping files that they depend on) across the team.

Sections include:

About Test Configurations

Every test run—whether it is performed in the GUI or from the command line interface—is based on a Test Configuration that defines the test scenario and sets all related test parameters. You can change how a test is performed by modifying the settings for the Test Configuration you plan to execute. 

Each Parasoft product provides built-in Test Configurations that are based on a variety of popular test scenarios. Most teams, however, will eventually need to create custom Test Configurations to meet their specific objectives. 

The built-in Test Configurations cannot be modified, but you can copy them into the User-defined Test Configurations category and modify configurations to suit your preferences and environment. You can also create a completely new Test Configuration and modify it as needed.

The Favorite Configuration should be set to the custom Test Configuration that you plan to use most frequently. By setting your preferred Test Configuration as the Favorite Configuration, you can easily run it from the Parasoft menu, the Test Using tool bar button, or from the command line interface. 

Creating a Custom Test Configuration

1. Open the Test Configurations panel by choosing Parasoft> Test Configurations.
2. Review the available Test Configurations to determine which (if any) you want to use as the base for your custom Test Configuration. Refer to Built-in Test Configurations to learn about the configurations shipped with SOAtest.
3. Do one of the following:
   • Right-click on a Test Configuration and choose Duplicate to base a custom Test Configuration on a built-in or Team Test Configuration. 
   • Click New to start with an empty Test Configuration. 
4. Select the new Test Configuration. New and duplicate Test Configurations are added to the User-defined category.
5. Modify the settings as needed. Refer to SOAtest Test Configuration Settings for details about Test Configuration options.
6. (Optional) Set the Test Configuration as a Favorite Test Configuration by right-clicking it, choosing Set as Favorite from the shortcut menu, then specifying what "favorite" position you want it to take (default, 1, 2, or 3). The configuration will then be set as a Favorite Configuration; the "favorite" icon will be added to that configuration in the Test Configurations tree.
7. Click Apply, then Close.
   
   

Changing the Favorite Test Configuration

The Favorite Configuration defines the test scenario used by default when a test is run with the designated Parasoft Test product. For example, if a test is started by clicking the Test button, Parasoft Test will run that test based on the parameters defined in the Favorite Configuration. In addition to settings the Test Configuration that is used as the default, you can also mark other commonly-used Test Configuration as your favorites; this configures easy access to them.

To indicate which Test Configuration you want set as the Favorite Configuration:

1. Open the Test Configurations panel by choosing Parasoft> Test Configurations or by choosing Test Configurations in the drop-down menu on the Test Using toolbar button.
2. Right-click the Test Configuration you want set as a Favorite Configuration, choose Set As Favorite from the shortcut menu, then specify what "favorite" position you want it to take (default, 1, 2, or 3).

The configuration will then be set as a Favorite Configuration; the "favorite" icon will be added to that configuration in the Test Configurations tree.

Organizing User and Team Test Configurations into Subdirectories

If desired, you can organize your user and team Test Configurations into user-defined subdirectories.

To move a user or team Test Configuration into a user-defined subdirectory:

1. Open the Test Configurations dialog by choosing Parasoft> Test Configurations or by choosing Test Configurations in the drop-down menu on the Test toolbar button.
2. Right-click the Test Configuration you want to move into a subdirectory, choose Set Folder from the shortcut menu, then specify the desired subdirectory or subdirectories.
   • For instance, if you want a Test Configuration to be presented under Static Analysis> Security, you would enter the following:
      
     
3. Click OK. The specified subdirectory will be created if needed, and the Test Configuration will be moved into it.
    

The created subdirectory will be available in the Test Using directories. 

The command line mode invocation is NOT affected by subdirectories. Here, you would continue to refer to the Test Configuration by only its name (without paths). For example: -config "team://Policy Compliance"


Sharing Test Configurations with Teams

Team Test Configurations are the Test Configurations that apply the team’s designated test settings. When all team members use the designated Test Configurations, code will be checked consistently, and the team’s quality and style guidelines will be applied consistently across the complete code base.

Deploying Team Test Configurations

Once a team Test Configuration is added to Team Server, it will be accessible on all connected team Parasoft Test installations. If a Test Configuration uses custom rules and/or rulemappings, they can be added to Team Server, then automatically accessed by all connected team Parasoft Test installations.

To share a Team Test Configuration team-wide, the architect or manager performs the following procedure on a Parasoft Test installation (Architect or Server Edition) that is already connected to Team Server:

1. If you have not already done so, create a user-defined Test Configuration that applies the designated team settings.
   • See Creating a Custom Test Configuration for instructions.
2. Upload that configuration to Team Server as follows:
   1. Open the Test Configurations dialog by choosing Parasoft> Test Configurations.
   2. Right-click the Test Configurations category that represents the Test Configuration you want to upload.
   3. Choose Upload to Team Server from the shortcut menu.

You can configure multiple team Test Configurations (for instance, one for static analysis, one for unit test generation, one for regression testing, etc.).

Modifying  Team Test Configurations

Team Test Configurations can be directly edited from Parasoft Test Architect Edition or Server Edition.

To directly modify a Team Test Configuration from an Architect or Server Edition:

1. Open the Test Configurations dialog by choosing Parasoft> Test Configurations or by choosing Test Configurations in the drop-down menu on the Test toolbar button.
2. In the left pane, select Team> [your_team_Test_Configuration].
3. Modify the settings as needed.
4. Click either Apply or Close to commit the modified settings.

The settings will then be updated on Team Server, and the updated settings will be shared across the team.

Setting the Team Favorite Test Configuration

The Team Favorite Configuration defines the test scenario used by default when a Team Server-connected team member runs a test with the designated Parasoft Test product. For example, if a test is started by clicking the Test  button, Parasoft Test will run that test based on the parameters defined in the Team Favorite Configuration. 

To set the Team Favorite Test Configuration, perform the following steps from a Parasoft Test Architect or Server edition:

1. Choose Parasoft> Explore> Team Server. The Browsing dialog will open.
2. Open the Configurations tab of the Browsing dialog.
3. Select the Test Configuration that you want to serve as the Team Favorite Test Configuration.
4. Click the Set as Team Favorite button.

Deploying Custom Rule Mappings Across the Team

Rule mapping is a key part of configuring Parasoft Test to enforce your team’s or organization’s coding policy (e.g. by customizing the built-in rule names, severities, and categories to match the ones defined in your policy).

You can use Team Server to ensure that all team members can access the rulemap.xml file you have created to customize Parasoft’s rule categories and severity levels. For details on how to create this file, see Modifying Rule Categories, IDs, Names, and Severity Levels. 

To upload a rulemap.xml file to the Team Server, perform the following steps from a Parasoft Test product licensed for Architect Edition or Server Edition:

1. Launch your Parasoft Test product from a machine from which you can access the rulemap.xml file that you want to share.
2. Choose Parasoft> Explore> Team Server. The Browsing dialog will open.
3. Open the Rules tab of the Browsing dialog.
4. Click the Upload button. A file chooser will open.
5. Select the rulemap.xml file that you created, then click Open. The rulemap.xml file that you just uploaded should now be listed in the Browsing dialog’s Rules tab. The rule configurations specified in this file will be available on all related Parasoft Test product installations connected to Team Server.
6. Click Done, click Apply, and then close the Parasoft Preferences dialog.
7. Restart the program. You do not have to stop the server first.
8. Open the Test Configurations dialog by choosing Parasoft> Test Configurations or by choosing Test Configurations in the drop-down menu on the Test Using toolbar button.
9. Select any Test Configuration and open the Static tab. The new rule settings should be applied.
   
   

Deploying Custom Rules Across the Team

You can use Team Server to ensure that all team members can access and check custom static analysis rules you have designed with the RuleWizard module. When Team Server manages a rule, all Parasoft Test installations connected to Team Server will automatically have access to the most recent version of the rule. If a rule changes and the modified rule is uploaded to Team Server, the version on all team Parasoft Test installations will be updated automatically. 

The architect (or other designated team member) performs the following procedure on one Parasoft Test Architect or Server Edition that is already connected to Team Server:

1. Create one or more custom rules in RuleWizard.
2. Save each rule and assign it a .rule extension. You can save the rule in any location.
3. If any new rules should belong to a new category, create a new category as follows:
   1. Open the Test Configurations dialog by choosing Parasoft> Test Configurations or by choosing Parasoft> Test Configurations in the drop-down menu on the Test Using toolbar button.
   2. Select any Test Configurations category.
   3. Open the Static> Rules Tree tab.
   4. Click the Edit Rulemap button.
   5. Open the Categories tab.
   6. Click New. A new entry will be added to the category table.
   7. Enter a category ID and category description in the new entry. For instance, an organization might choose to use ACME as the category ID and ACME INTERNAL RULES as the description.
   8. Note the location of the rulemap file, which is listed at the top of this dialog. You will need this information in step 9.
   9. Click OK to save the new category.
4. Choose Parasoft> Explore> Team Server. The Browsing dialog will open.
5. Open the Rules tab of the Browsing dialog.
6. Click the Upload button. A file chooser will open.
7. Select one or more of the new .rule files that you created, then click Open. The .rule  files that you just uploaded should now be listed in the Browsing dialog’s Rules tab. All rules represented in this tab will be available on all Parasoft Test installations connected to Team Server.
8. Add additional team rules by repeating the previous two steps.
9. If you added any new rule categories or made any other changes to the rule mappings, click Upload, select the edited rulemap file, then click Open. The file that you just uploaded should now be listed in the Browsing dialog’s Rules tab. This file will be available on the Parasoft Test installations that are connected to Team Server and licensed for the applicable Parasoft product. This file controls how the team rules are categorized.
10. Open the Test Configurations dialog by choosing Parasoft> Test Configurations.
11. Select any Test Configuration and open the Static> Rules Tree tab.
12. Click Reload. The new rule should be available in all available Test Configurations and classified under the Team category. The rule will be disabled by default.
13. If you want a Team Test Configuration to check these rules:
    1. Configure a new or existing Test Configuration to check these rules. The added rules will be disabled by default, so you will need to enable any rules that you want checked.

    2. Ensure that the modified Test Configuration available to the team as described in Deploying Test Configurations Across the Team. You must follow this procedure even if you are modifying a Test Configuration that is already shared.

14. Click either Apply or Close to commit the modified settings.
    
    

Removing Rules From Team Server

To remove a rule from Team Server, the architect (or other designated team member) performs the following procedure from a Parasoft Test Architect Edition or Server Edition:

1. Choose Parasoft> Explore> Team Server. The Browsing dialog will open.
2. Open the Rules tab of the Browsing dialog.
3. Select the rule you want to remove.
4. Click Delete.
5. Click Done.

Specifying Test Configuration Inheritance

If you want multiple Test Configurations to share some of the same parameter settings (for example, if you want multiple Test Configurations to have the same rules enabled), you can create new child Test Configurations referring to one parent Test Configuration. A child Test Configuration will inherit the parent’s settings; the value of each preference in the parent Test Configuration is used whenever the corresponding preference in the child Test Configuration is not present.  

Inheritance is recursive; in other words, you could have the MyConfig2 Test Configuration inherit the settings from MyConfig1, and have MyConfig3 inherit the settings from MyConfig 2. MyConfig3 will thus inherit some MyConfig1 settings as it inherits MyConfig2 settings.

You can create a child Test Configuration from a Test Configuration shown in the Test Configuration panel, or by specifying a Test Configuration URL (for Test Configurations available via HTTP).

To create a child from a  Test Configuration shown in the Test Configuration panel:

1. Open the Test Configurations panel.
2. Right-click the desired parent Test Configuration, then choose New Child from the shortcut menu.

To create a child from a Test Configuration available via HTTP:

1. Open the Test Configurations panel.
2. Right-click the User-Defined node, then choose New Child from the shortcut menu.

3. In the dialog that opens, enter the URL for the desired parent Test Configuration (http://config_address/). For example:
   http://SOAtest.acme.com/configs/static.properties

To disconnect a child from its parent:

1. Open the Test Configurations panel.
2. Click the Disconnect button to the right of the Parent field.
   
   

Comparing Test Configurations

If you want to see the differences between two Test Configurations, you can compare them so that the differences are highlighted. 

1. Open the Test Configurations panel by choosing Parasoft> Test Configurations.
2. Right-click one of the Test Configurations you want to compare, choose Export from the shortcut menu, then use the file chooser to indicate where you want to save the .properties file (choose a folder that is in your workspace and available in the Package Explorer).
3. Repeat the above step for the other Test Configurations you want to compare.
4. Select the two different .properties files in the Navigator, right-click the selection, then choose Compare with> Each other. Changes will be highlighted.

You may want to compare Test Configurations in the following circumstances:

• You customized a built-in static Test Configuration from a previous product version and want to see what new rules have been added and enabled in the most current version of that built-in Test Configuration.
• You want to know what settings will be impacted if you run a given Test Configuration in "Quick Mode."
• You want to zero in on the differences between a child Test Configuration and its parent.

Importing/Exporting Test Configurations

If you have created a Test Configuration that you want to share with team members or use in an upgraded version of a Parasoft Test product, you can export the Test Configuration into a properties file. That Test Configuration can then be added by importing the related properties file.

Exporting

To export a Test Configuration:

1. Open the Test Configurations panel by choosing Parasoft> Test Configurations.
2. Right-click the Test Configuration you want to export, choose Export from the shortcut menu, then use the file chooser to indicate where you want to save the properties file that will be created for this Test Configuration.

A properties file will then be saved in the designated location. A dialog box will open to confirm the location of the newly-created properties file. 

Importing

To import a Test Configuration that was previously exported into a properties file:

1. Open the Test Configurations panel by choosing Parasoft> Test Configurations.
2. Right-click the User-defined category, choose Import  from the shortcut menu, then use the file chooser to select the appropriate properties file.