Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.
Comment: Published by Scroll Versions from space FUNCTDEV and version SVC2023.1

...

  1. Open or create the scenario you want to customize by performing one of the following steps from the Load Tests tab:
    • To open an existing scenario: Click the appropriate node in the Scenarios branch. If profiles are not visible, double-click Scenarios to expand this branch.
    • To create a new scenario: Right-click the Scenarios node , then and choose New Scenario from the shortcut menu.
  2. Customize the scenario using the controls in the right GUI panel. The following sections describe the available customization controls.

Scenario Name

Type Enter a new name in the Name field to change the scenario name.

...

Choose one of the following from the Scenario Type drop-down menu: 

  • Weighted Profiles. This type enable : Enables you to specify the test suite profile distribution as a weight ratio. The virtual users are distributed among profiles in a randomized weighted manner that allows an arbitrary total load graph and "statistical" following of the profile distribution.
  • Direct Profiles. This type enables : Enables you to directly specify the exact load (in virtual users or hits per second) for each test suite profile. You can specify the load for all of the machines , or for each individual machine. The total number of VU/HPS cannot be specified directly , but comes as a sum of all profiles for a machine.

Test Duration

Type Enter new values in the Duration fields. The following duration limits apply:

...

Choose one of the following options from the Controlled Parameter drop-down menu:

  • Number of Users. Load : Load Test will attempt to achieve the specified virtual user quantities and attempt to vary the number of hits per second in the process.
  • Hits per SecondHits per MinuteHits per Hour, or Hits per Day: Load Test will attempt to achieve the specified hit rates by varying the number of virtual users as needed. 

...

If the Controlled Parameter is set to Number of Users, Load Test can randomize the virtual user think time according to the following distributions:

  • Uniform: If the virtual user think time defined in the profile configuration is Tprof., then the actual virtual user think time will be a random value uniformly distributed in the interval from 0 to 2*Tprof. with the mean value of Tprof.
  • Poisson: If the virtual user think time defined in the profile configuration is Tprof., then the actual virtual user think time will be a random value with the bell-shaped distribution and the mean value of Tprof.
  • None: No randomization is applied.

If the Controlled Parameter is set to Hits per Second, Load Test can randomize the inter-invocation time according to the following distributions:

  • Uniform: If the hit-per-second rate defined in the load test scenario is Nhps., then Load Test will generate a request sequence with a random inter-invocation time (the time between subsequent requests) uniformly distributed in the interval between 0 and 2* 1/Nhps. seconds and the mean value of 1/Nhps seconds.
  • Poisson: If the hit-per-second rate defined in the load test scenario is Nhps, then Load Test will generate a request sequence with a random inter-invocation time (the time between subsequent requests) with the bell-shaped distribution and the mean value of 1/Nhps seconds.

...

Choose a value from the Vertical scale drop-down menu to sets the  menu to set the maximum number of users or hits to be simulated during the test run.  The The maximum value you can set in a scenario is determined by your license. To see license details, choose Help> go to Help > About.

If the Controlled Parameter is set to Number of Users, the load applied is the sum of users and hits on all machines in the selected scenario. 

...

  1. Right-click on a line in the top-right side of the panel and choose a scaling option. You can set the scale for each profile when the Scenario Type is set to Direct Profiles. If you are setting the scale in Weighted Profiles mode, the scale is set per machine. 
     
  2. Specify a scaling factor when prompted. 

...

If you are configuring profiles directly (Scenario Type is set to Direct Profiles) and more than one test suite profiles are available, you can display enable the the All option to show all profiles or enable individual profiles.

...

  1. Right-click on a line in the top-right side of the panel and choose Edit graph.
  2. Specify a value in the Y field when prompted. 
  3. Click Next to edit the next point on the graph or Previous to edit the previous point.  You can also press Alt-Left Arrow and Alt-Right Arrow to use keyboard shortcutsYou use the keyboard shortcuts ALT-LEFT ARROW and ALT-RIGHT ARROW.
     
  4. Specify values for the X field and click Apply.
  5. Repeat steps 2 and 3 to configure additional points as necessary and click OK when finished. 

...

Using a Preset Shape

You can also set the graph to a preset shape.

  1. Right-click a line’s representation in the top-right side of the panel and choose Set Graph Shape.
     
  2. Choose a graph shape and set the peak value.
     
  3. Click OK to apply the shape to the selected graph.

...

  1. Choose a value from the Vertical scale to change the maximum ratio of profiles. The higher the value, the more different ratio intervals you will be able to use when determining how Load Test distributes user profiles over time. The ratio of user profiles determines how likely Load Test is to select a particular profile at any point in the test duration. 
  2. Right-click a line’s representation in the top-right side of the panel and choose Scale Graph from the shortcut menu to to scale a line’s shape for a different range of profile ratios. 
  3. Enter a scaling factor when prompted.
  4. If you want to to maintain a steady ratio of user profiles, ensure that the line is flat and drag the horizontal bar for each profile up or down until it corresponds to the profile weight you want for all time intervals. 
  5. To vary the ratio of user profiles, create a "point" for each time interval for which you want to specify the profile weight (see Changing the Shape) then drag that point to the desired location. Load Test will automatically determine the profile weights for each time interval that does not have a specific point; it does this by plotting the slope between each of the points.
  6. You can automatically double the number of points you have created by clicking More points. The new points will be added at regular intervals between your existing points. You can remove a point by right-clicking it and choosing Remove point. To To remove points that are not points of inflection, click the Less points button.
Tip
titleTip
You can save any scenario graph (configuration graphs as well as test progress graphs) as a GIF by right-clicking the graph that you want to save , then and choosing Save Image from the shortcut menu.

Anchor
Qos
Qos
Customizing QoS Metrics for Scenarios

...

QoS functionality can be accessed from the load test tree. Under each of the Scenario nodes (Bell, Buffer Test, Linear Increase, Steady Load) is a corresponding QoS node. After selecting a QoS node, the Summary and Details tabs display are shown in the right GUI panel.
 
The Summary tab displays shows a global view of QoS metrics that have been configured within the Details tab. The Summary tab contains a list of metrics and their descriptions. There are five default metrics in the Summary tab Metric list: 

...

Each of the above metrics are grouped according to its type (e.g. for example, Statistic, Count, Throughput, Loss). Any additional metrics you configure will also display appear in the Summary tab.

The Description list contains automatically generated descriptions of what each metric is verifying based on the parameters that have been specified for that metric.
 
The Details tab displays the available metrics that have been configured for the selected scenario. The Details tab also displays shows the name, parameters, and notes for the metric selected from the Metric List.

...

To create a new QoS metric, complete the following:

  1. Click the New button beneath the Metric List. The Add Metric wizard displaysopens.
  2. Select the desired QoS metric from the Add Metric wizard and click Finish.
    The QoS metric is added to the left panel while its parameters display in the right panel of the Details tab.

...

The selections you make in the Test Tree Selection panel (described in Test Tree Selection Panel Navigation and Options) within QoS Metric Machines, Profiles and Tests filter panels affect the data sets that are used for calculation of the metric value. This will subsequently affect the success or failure outcome of the metric. You can preview the data used in calculation of the metric types listed below in the relevant sections of the load test report. 

  • Statistic Metric : See the Statistics section of the report. Note that the Avg. (average) parameters of the Statistic Metric are calculated based on the number of runs of each test selected for that metric. You can see these numbers in the Run Count column of the load test report’s Statistics section.
  • Count Metric, Loss Metric : See the Statistics section of the report.
  • Throughput : See the Graph tab of the Detailed Report section.
  • Percentile Metric, Latency Metric : Select Show Individual Hits in the Graph tab of the Detailed Report view.
  • Error Ratio Metric : Select Show Recorded Details in the Graph tab of the Detailed Report view. See the Details column of the Table view that comes forward after selection.

...

You can also select one or multiple (CTRL-click) metrics from the list, then right-click your selection(s) and Cut, Copy, Paste, or Delete as needed from the shortcut menu. When right-clicking one or multiple (CTRL-click) metrics from the list, you can select choose Save Metrics As to save the selected metrics as a QoS metric set (.ms file), and you can also select choose Load Metrics to load previously saved metric sets. You can also change the order of the list by dragging and dropping the desired metrics into the desired order.

...

An environment is a collection of variables that can be referenced in your Load Test configuration.  When running a test, Load Test will substitute the names of variables in your project configurations with the values of those variables in the active environment.  By By changing which Environment is active, you can quickly and easily change which values Load Test uses.  

...

  • Add: Click to add a new environment to your project. The Add button can also be dropped down by clicking Click the down arrow on the right of the button . The for the following options are available.:

    • Import...: Click to load existing environments from a *.env file into your project. Subsequent changes to the *.env file will not be reflected in your project.
    • Reference...: Click to reference existing environments from a *.env in your project. Subsequent changes to the *.env file will be reflected in your project.
  • Remove: Click to remove the selected environment(s) from your project.
  • Set: Click to make the selected environment the active environment.

...

After creating and/or selecting an environment, the Environment Details panel will display a table and buttons for managing environment variables.

  • Add: Click to add a new environment variable.
  • Remove: Click to remove the selected environment variable.

...

If the SOAtest project that you are using for load testing contains tests with Call Back tools and Asynchronous testing features—or features, or it contains Message Stub tools—you tools, you will need to start the SOAtest server inside Load Test in order to process the SOAtest project related asynchronous messaging. 

You can start the SOAtest Server in two ways:

  • Manually: Select View> Go to View > Show Server in the toolbar. . The Server tab will appear in the left panel of the Load Test GUI. Then, right-click the Server node and choose Start Server.
     
  • Automatically: In the Load Test preferences, select the Start-Up section and enable the Start server on Parasoft Load Test start-up option.  After you save your preferences, you will need to restart Load Test before this setting takes effect.

 If If you are running a load test with SOAtest asynchronous tools in command line mode or in Load Test server mode, you will need to enable the automatic SOAtest Server startup on each of these machines (because in command line mode, the SOAtest Server can only be started automatically).

Anchor
dataSource
dataSource
Configuring Data Source Usage

If your SOAtest .tst file references data sources, you can configure how those data sources are used during load testing.

...

  1. Select the Profiles node in the Load Test Configuration tree.
  2. Open the Data Source Options tab. The available data sources will be listed in the left panel.
  3. To configure data source options that apply across the test suite, select the test suite you want to configure, then customize the following options as needed in the right panel:
    • Stop load test after all rows have been used:  If If data source rows become invalid after they are used, enable this option, then specify when you want the load test to stop—either stop, either when the first machine runs out of rows or when all machines run out of rows. This helps you to manage the duration of your load test.
    • Report recommended partition sizes: Determines if Parasoft Load Test generates a report (based on the results of the load test) that includes recommended partition sizes for each data source on each machine.
  4. To configure options for a specific data source, select the data source whose options you want to configure, then customize the following options as needed in the right panel:
    • Use each row only once (i.e., data becomes invalid after use): Determines whether the values in a data source row can be used more than once during a test. If this option is enabled, SOAtest will sequentially iterate through the data source values; random iteration through the data source values is not allowed. This option is particularly useful for Web applications where certain kinds of data can only be entered into the application once (for example, social security numbers, unique id numbers, and so on).
    • Different users can use the same row concurrently: Determines if the values in this data source can be used by only one virtual user at a time. Disabling this option is particularly useful if you want SOAtest to assign login username/password pairs from this data source, but your site prohibits multiple simultaneous logins from each user. If this option is disabled, SOAtest will report a message if the number of virtual users attempting to use the data source during a test exceeds the number of available rows. If this occurs, you should ensure that the number of rows in the data source exceeds the number of virtual users that will be using the data source, then rerun the test. This option is only available if the "Use each row only once (i.e., data becomes invalid after use)" option is not selected.
    • Virtual users iterate through data: Determines whether SOAtest iterates through the data randomly or sequentially. This option is only available if the "Use each row only once (i.e., data becomes invalid after use)" option is not selected.
      • In sequential mode, SOAtest repeatedly iterates through the data throughout the test. It uses all data source values, starting with the values in the first data source row, and moving sequentially through the data source rows up until the last data source row. Once SOAtest uses the values in the last data source row, it starts over again with the values from the first row.
      • In random mode, SOAtest randomly selects a data source row each time it needs a data source.
    • Virtual users iterate through all rows for each test: Determines if virtual users can iterate through all rows of this data source before running the next test. If this option is not selected, virtual users execute a single row at a time, then runs the next test and so on. This option is only available if the "Use each row only once (i.e., data becomes invalid after use)" option is not selected.
    • Partitions: Allows you to customize how the data source is partitioned for distribution to load test server machines.
      • Data sources will be partitioned when either the Use each row only once option is enabled or the Different virtual users can use the same row concurrently option is disabled.
      • To customize how the data source is partitioned for distribution to load test server machines, enable Use custom data source partitions, then enter specify the desired distribution in the table.
      • To specify that a given machine (with the exception of the localhost) should receive no data source rows, enter 0 for both the First row and Last row cells. In this mode, the localhost machine cannot be excluded from the load test. The localhost machine data rows interval will always start with row 1 (this field is read-only in the partition configuration table). All data source rows must be distributed to one across available load test server machinemachines.

 

Anchor
setupTeardown
setupTeardown
Configuring Setup/Teardown Test Execution

If your SOAtest .tst file uses setup or teardown tests, you can configure how those tests are used during load testing.

...

  1. Select the Profiles node in the Load Test Configuration tree.
  2. Open the Setup/Teardown Options tab.
  3. Choose the desired option. Available options are:
    • Run once per virtual user: Setup and teardown tests will be run once for each virtual user.
    • Run once per machine: Each machine will run setup and teardown tests once per load test.
    • Run once per load test: Setup and teardown tests will be run once per load test.

...

You can configure any number of profiles or machines, but the number of  virtual virtual users or number of hits per second you use is limited by your license. For example, if you are only licensed to run 100 virtual users, you can configure any number of profiles, but only 100 virtual users based on those profiles can be active at any given time. If you have 20 profiles, but are only licensed to run one virtual user, all 20 profiles will eventually be used during the test (provided that the test has a sufficient duration), but only one profile will be active at any given time.

...

  1. Open, disable, enable, or create the profile you want to customize by performing one of the fol-lowing following steps:
    • To open an existing profile: Click the appropriate node in the Profiles branch. If profiles are not visible, double-click Profiles to expand this branch.
    • To disable/enable an existing profile: Right-click the appropriate node in the Profiles branch and select Disable/Enable from the shortcut menu. If disabling a profile, the profile will not run with the load test until it is enabled again.
    • To create a new profile: Right-click the Test Suite Profiles node , then and choose New Profile from the shortcut menu.
  2. Customize profile options using the controls in the right GUI panel. Available options include:
    • Name: Determines the profile name.
    • Profile Runnables: Determines what tests or custom operations are executed. Check Enable the check boxes options that represent the tests you want to use. You must select at least one test. If you want child tests to assume the parent test’s setting (enabled or disabled), check the enable Propagate Selection option. If you add multiple test suites, they will be executed in the order in which they are listed in this panel.
    • Delay: Indicates the length and type of delay you would like to simulate between this profile’s test iterations. If this profile is used in a scenario that controls the test for number hits per second (rather than for number of virtual users), all delay options will be ignored. Delay options include:
      • End-to-Begin: Prompts Load Test to measure the delay from the end of the previous virtual user invocation to the beginning of the subsequent virtual user invocation.
      • Begin-to-Begin: Prompts Load Test to measure the delay from the beginning of the previous virtual user invocation to the beginning of the subsequent virtual user invocation.
      • Minutes: Determines the delay in minutes. Enter the number of minutes in the text field or move the slider accordingly.
      • Seconds: Determines the delay in seconds. Enter the number of minutes in the text field or move the slider accordingly.
      • Milliseconds: Determines the delay in milliseconds. Enter the number of minutes in the text field or move the slider accordingly.
      Tip
      titleTip
      If you want different tests to use different delays, you can configure the delays at the test level in SOAtest (in the Execution Options> Options > Test Flow Logic tab within the test suite’s configuration panel). Any delays configured at the test level will override delays specified in the Load Test profile. The Load Test Begin-to-Begin/End-to-Begin selection will not be applied for tests with individual delays.

...

  • Set the appropriate delays in the Virtual User profile configuration: This is the preferred method. The hit-per-second rate is inversely proportionate to the time between Virtual User test invocations. This time consists of the test execution time and the Virtual User Delay time. For instance, setting a Virtual User profile Begin-to-Begin delay to 1 second will cause the hit per second rate of a 4 virtual user load test scenario to stay at or under 4 hits per second. For more information on the Virtual User profile delays see the Customizing Profiles section of the documentation.
  • Configure Hit per Second throttling in the Scenario Summary Table view: In the Weighted Profiles mode of a Load Test scenario that has Virtual Users selected as a controlled parameter, you can directly set the Hit per Second limit for each machine in the load test configuration. The Summary Table of the load test Scenario view (see the screenshot below) includes a table that allows you to enable Hit-per-Second throttling for any machine in the load test configuration and set the Hit-per-Second limit for that machine. When using this mode, be aware that the HPS throttling controller of the load test has a priority over the part of the application that enforces the Virtual User delays. As a result, the Virtual User profile delay times may likely will be ignored in order to throttle the Hit per Second rate.

The following image shows an example of configuring Hit-per-Second throttling in the Scenario Summary Table view:
 

...

 The Report Settings tab of the Scenarios control panel lets you configure what data is recorded during the load test. 
 
 Available options are:

  • Record Graphs: Record the load test graph data that are available in the Detailed Report section of the load test report.
  • Record Individual Hits: Record all individual hits that are available as a "scatter" view in the Detailed Report section of the load test report.
  • Record Individual Hit Details: Record Error and/or Success details of individual hit execution. Error and Success details depend on the Load Test component type. For SOAtest components, the following is recorded as Error/Success details:
    • Error Details: Contains an error description string for all tests and test traffic for the following SOAtest tool tests: SOAP Client, Browser Test, REST Client, Messaging Client.
    • Success Details: Contains traffic for the following SOAtest tool tools: SOAP Client, Browser Test, REST Client, Messaging Client.
    • Recording limit: Limits the amount of Error and/or Success data recorded in the load test report. The limit can be set to either the maximum number of the collected test execution details or to the size of details data.
      To limit the report size by setting the maximum number of recorded details, select the choose Details option in  in the Recording Limit panel:

      To limit the report size by the maximum allowed recorded data size, select the choose KBytes(kilobytes) option in the Recording Limit panel. 

Note that the Record Individual Hit Details option can be used when the Record Individual Hits option is uncheckeddisabled. In this case, the individual hit data (the scatter view section of the report) will not be recorded, but the test execution details will still be available via the Show Recorded Details right-click menu option of the load test report graph view. 

...

Customizing Load Test Stop Sequence

The Stop Settings> Settings > Stop Sequence area of the Scenarios control panel lets you configure how Load Test behaves after a load test Stop event has been generated and the actual stop of the load testing activities. (We will use the term "Load Test Stop time" to refer to the time between the moment a load test Stop event is generated and the actual stop of all load testing activities.) 
 
A load test Stop event is generated if:

  • A Load Test user manually stops the load test by clicking the Stop toolbar button Stop on the tool bar.
  • The load test duration reaches its scheduled time length.
  • The load test Stop Action "fires" (see the Customizing Load Test Stop Actions section below).

...

  • Quick Stop (default option) - : If selected, each Virtual User exits after the completion of its current test. Selecting this option will cause load test to stop quickly; however, the Virtual Users that were active when the Stop command was issued might not complete all the tests or data source iterations scheduled for the Profile to which they belong.
  • Formal Stop - : If selected, Virtual Users execute all their tests and data source iterations as scheduled in the Virtual User profile configuration. Choosing this option might cause the Load Test Stop time to increase (compared to the Quick Stop sequence). If the Virtual User test list or data source iteration list is long, the increase might be significant.
Tip
titleTip

If the stop procedure is taking too long, use the Force Stop button in the Load Test stop progress dialog   (See Tip: Stopping a Test for more details).

...

The script you define communicates with the Load Tester via the com.parasoft.api.loadtester API and receives LoadTestScriptArgs and Context as arguments, and can also return a LoadTestScriptAction. A returned LoadTestScriptAction.Action_Stop has the same effect as pressing the clicking Stop button in the Load Test GUI during a load test.

...

  1. Select the Scenarios node in the Load Tests tab and choose the StopSettings tab in the configuration panel on the right.
  2. Select Java, JavaScript, or Jython from the Language drop-down list menu to indicate the language that your script is or will be written in.
  3. Define the script to be implemented in the Implementation box.
    • For Java methods, specify the appropriate class in the Class field. Note that the class you choose must be on your classpath.
    • For JavaScript and Jython scripts, you can use an existing file as the source of code for your method or you can create the method within Load Test.
      • To use an existing file, select the enable File radio button and click Browse. Select Navigate to the file from the file chooser that opensand select it, then click OK to complete the selection.
      • To create the method from scratch from within Load Test, select the Text radio button and enable Text and type or cut and paste your code in the associated text window.
      • To check that the specified script is legal and runnable, right-click the File or Text field (click whichever one you used to specify your script) , then and choose Evaluate from the shortcut menu. Load Test will report any problems found.
  4. Select the appropriate argument from the Method drop-down list menu. This list will be composed of any definitions contained in your script. Since a script can contain multiple arguments you can select the one that you want to use in this method.
  5. Run the load test.
    The script you define is called every three seconds (the frequency of load test output collection) during load testing.The load test will stop if any of the criteria you specify in your script is met. The user-defined description of the load test stop action will be reflected in the Load Test report if the script causes the load test to stop. Any script errors are reported in the Log tab of the Load Test Progress view.

...

High Throughput Mode can be used to apply higher levels of load to the system under test—while test while minimizing the hardware required to generate such load.

Each Load Test machine participating in a load test can be configured to run in a High Throughput Mode. In this mode, the test response verification and non-critical attached tools are disabled. As a result, fewer system resources, such as CPU cycles, are required to run the load test. This allows machines in High Throughput Mode to run at a higher test per second execution rate.

To enable this mode,  select select the appropriate machine from the Machines node in the Load Test Configuration tree, then enable the High Throughput Mode option.

Typically, users select some of the machines to run in a regular Verified and some in an Unverified – High Throughput mode. The machines that run in the Verified mode act as both load generators and Test result collectors, while the machines in the Unverified mode act only as load generators. Upon the completion of a load test, the results which were collected in the Verified mode are used to estimate the error count intervals for the machines in the Unverified mode and Total error count estimate intervals for the entire load test.

...

Parasoft Load Test can be configured to use multiple IP addresses for its Virtual Users. Configuring this ip IP spoofing involve two steps:

...

  1. Use the ipconfig command to see the list of available network interfaces, their IP addresses, and masks.
  2. Use the netsh command in a DOS prompt window (DOS shell) or in a batch script to add or remove IP addresses.
    • To add an IP address, run a netsh command similar to the one  in the following exam-ple example (substituting your own network interface name, IP address, and mask).

      Code Block
      netsh -c Interface ip add address name="Local Area Connection" addr=10.10.29.9 mask=255.0.0.0
    • To remove an IP address, run a netsh command similar to the one in the following example (substituting your own network interface name, IP address, and mask).

      Code Block
      netsh -c Interface ip delete address name="Local Area Connection" addr=10.10.29.9

...