This topic describes how to use test configurations with the SOAtest and Virtualize server. In this section:
| Table of Contents | ||
|---|---|---|
|
Introduction
Test configurations are collections of settings that determine how tests are executed and reported. The SOAtest and Virtualize server ships with the following default configurations:
- Run Automated Server Tests.properties is located in the <INSTALL>/soavirt/WEB-INF/configs/builtin folder. In this configuration, the option to report traffic for all tests is enabled. It is intended to be used for executing tests from Continuous Testing Platform.
- Example Configuration.properties is located in the <WORKSPACE>/TestAssets/configs/user folder. The option to report traffic for all tests is disabled.
You can customize as necessary by enabling and disabling properties in the test configuration file. You can also create custom test configurations and add them to the workspace where they can be used to execute tests in your project.
Built-in Test Configurations
You can run built-in test configurations by specifying builtin:// and the test configuration name when making your call. In the following example, the tests will execute according to the default Run Automated Server Tests configuration:
| Code Block | ||
|---|---|---|
| ||
{
"general": {
"config": "builtin://Run Automated Server Tests", |
See Test Configuration Properties for information about properties you can customize in the test configuration.If the folder does not contain a test configuration with the specified name, the test will not run.
User-defined Test Configurations
You can run user-defined test configurations by specifying user:// and the test configuration name when making your call. In the following example, the tests will execute according to the default Example Configuration configuration:
| Code Block | ||
|---|---|---|
| ||
{
"general": {
"config": "user://Example Configuration", |
You can add other test configurations to the <WORKSPACE>/TestAssets/configs/user folder and execute them using the user://<TEST_CONFIG_NAME> syntax. You can add test configurations by creating duplicates of the default configuration and modifying them to exercise the tests in different ways. See Test Configuration Properties for information about properties you can customize in the test configuration.
If the folder does not contain a test configuration with the specified name, the test will not run.
Test Configuration Properties
You can modify the following settings for Run Automated Server Tests.properties file, as well as any custom user configurations you may want to create (see User Configurations ).
| Table of Content Zone | |||||||||||||||||||||||||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| |||||||||||||||||||||||||||||||||||
Functional Tests Propertiescom.parasoft.xtest.execution.api.web.execute_functional_testsThis setting enables/disables functional test execution. Set this property to Example
com.parasoft.xtest.execution.api.web.report_successful_trafficThis setting enables/disables the "Test Traffic [All Tests]" section in the API coverage report. The section contains traffic for all test executions, whether or not the tests were successful. Set this property to Example
com.parasoft.xtest.execution.api.web.report_traffic_limitThis setting specifies the total amount of traffic data (in KBs) stored during a test execution session, not the amount of data stored per test. The com.parasoft.xtest.execution.api.web.report_successful_traffic setting must be enabled for this property to take effect. Only data from successful tests will count toward the limit if the com.parasoft.xtest.execution.api.web.report_successful_traffic property is enabled. The default is Example
API Coverage Propertiescom.parasoft.xtest.execution.api.web.coverage_ref_by_testsThis setting determines if coverable resources from the service definition are included in the API coverage report. If a constrained SOAP Client, REST Client, or Messaging Client tool touches a coverable resource, coverage information will be associated with the appropriate resource/operation. The following service definitions are supported:
Default is Example
com.parasoft.xtest.execution.api.web.perform_service_coverage_calculationThis setting enables/disables API coverage calculation for a user-defined list of coverable resources. You can specify the resources in the com.parasoft.xtest.execution.api.web.service_coverage_table setting. Coverage can be calculated in addition to, or instead of, the automatically-calculated coverable resources. Default is com.parasoft.xtest.execution.api.web.service_coverage_tableThis setting specifies a list of resources that should be included as part the API coverage calculation. Specify a semicolon-separated list of definitions using the following format:
The following definition types are supported:
Example
In this example, the property would include coverage information for the following resources:
Application Coverage Properties
This setting enables/disables collecting application coverage data with the coverage agent. The default is Example
This setting specifies the host name or IP address of the machine where the coverage agent resides. Example
This setting specifies the coverage agent’s port. The default is Example
com.parasoft.xtest.execution.api.web.application_coverage_user_idThis setting specifies a user ID so that coverage results can be associated with a specific user. A user ID should only be specified when the coverage agent is configured to run in the multi-user mode. For details, see the user guide for your Parasoft code analysis tool (Parasoft Jtest or Parasoft dotTEST) at https://docs.parasoft.com. Example
com.parasoft.xtest.execution.api.web.application_coverage_report_as_test_failureThis setting enables/disables reporting test failures when the coverage agent connection fails, or when the location of the static coverage file is misconfigured. Otherwise connection problems will be reported to the console, but will not cause the test to fail. The default is Example
com.parasoft.xtest.execution.api.web.application_coverage_upload_to_dtpThis setting enables/disables sending application coverage results to DTP. It requires the com.parasoft.xtest.execution.api.web.collect_application_coverage option to be enabled. The default is In addition, sending results to DTP requires the following settings to be configured:
Example
This setting specifies the path to the static coverage file generated by your Parasoft code analysis tool (Parasoft Jtest or Parasoft dotTEST) in the .xml or .data format. For details, see the Parasoft Jtest or Parasoft dotTEST user guide at https://docs.parasoft.com. Example
This setting specifies a set of tags that are used to create coverage images in DTP. A coverage image is a unique identifier for aggregating coverage data from runs with the same build ID. For details, see the Parasoft DTP user guide at https://docs.parasoft.com. Example
|