Performance Tuning Checklist
- Turn off event monitoring and hit statistics at the server level. (See Disable Event Monitoring and Hits Statistics.)
- Configure the Tomcat connector settings. (See Tomcat Configurations.)
- Set log level to INFO and disable JVM level debug logging, e.g. SSL debugging.
- Enable caching on data sources. Otherwise, data sources will be subject to file system read limitations.
- Increase JVM heap memory and apply garbage collection options. (See Configuring System Properties)
- Use Literal view instead of Form view whenever possible. Hierarchical parameterization is supported in literal views.
Configurations for Best Performance
For best performance when using a Virtualize server, we recommend the following configurations:
Always Run your Server in "Headless Mode"
You can do this utilizing the soavirt.war deployable in a web server like Tomcat or launching your Virtualize application with the virtualizecli executable.
Disable Event Monitoring and Hit Statistics
Always stop monitoring Virtual Assets—both on the server and on all workstations—before starting a load test.
You can also completely disable monitoring as follows:
- In the Virtualize Server view, double-click the desired server node.
- In the Server Configuration tab, clear the "Enable the event monitoring service" and the "Enable the statistics collection service" checkbox and save.
- Stop and re-start the server.
This can also be done from the Continuous Testing Platforms Servers Page for headless deployments.
For best performance with Virtualize, set the following system properties and make a few modifications to the Tomcat’s server.xml.
Configuring System Properties
Set JVM properties on start-up to increase the heap memory (at least 4gb) and change the garbage collector.
For WAR deployment (configured in the <TOMCAT_HOME>/bin/setenv file):
- Locate the HTTP Connector element in the server.xml file located under the <TOMCAT_HOME>/conf folder. The default connector port is 9080 for virtualizecli and 8080 for a WAR deployed in Tomcat.
- Add/update the
acceptorThreadCount, enableLookups,and maxThreadsattributes as shown in the following:
This tells Tomcat to keep a processing thread pool of 750 threads. It also sets the acceptor thread count to 2 and disables DNS lookups.
Locate the Valve element toward the bottom of the file.
Comment out the Valve element as shown in the following:
This will stop Tomcat from filling up the log location with logging information every time the server is hit.
Operating System Configurations
If using Windows, there are some parameters you can tune in the Registry:
- Click Start > run > regedit.
Navigate to the following registry key:
- Right-click “Parameters” and choose New > DWORD.
- Name the value "MaxUserPort" and update its value data to "7FA6" (hexadecimal) or "32678" (decimal).
- Right-click "Parameters" and choose New > DWORD.
- Name the value "TcpTimedWaitDelay" and update its value data to "1E" (hexadecimal) or "30" (decimal).
- Restart the machine for the changes to take effect.
This will increase the number of allowed concurrent TCP connections in Windows (MaxUserPort), and reduce the amount of time that an unused TCP port is reserved before it can be reused (TcpTimedWaitDelay).
It may be necessary to tune your Linux server for high throughput. The following are some system settings that could be helpful. These should be applied to Virtualize and the load generation tool.
Sets the maximum number of processes available for a single user. This is important because java threads are processes and having this number too low could result in the inability to spawn new threads.
These allow the operating system to quickly reuse and recycle network sockets. This is important while under heavy load as sockets can be used and discarded frequently.
You may need to tune tcp buffers. Several sysctl parameters can be modified based on your network configuration. Refer to Linux Tuning documentation for more information.
Virtualize and Data Repository Deployments
It is recommended to minimize the network latency between a Virtualize server and a Data Repository server as much as possible. Network latency between the processes can negatively impact the performance of the Virtualize server under load, and the most common way users accomplish this is by installing them on the same machine, or two machines that are co-located as much as possible (e.g. same data center region). The Data Repository server can consume a large amount of memory, so when installing it on the same machine as a Virtualize server, it is advised that the machine have at least 32GB RAM (see Deployment Recommendations).
- Turn off performance profiles and additional delays in your Virtual assets.
- Is the issue related to a specific asset? Are other assets performing like before?
- If you have any responders or data source rows that are unused, can they be disabled or removed completely?
- Check for any scripts that might be in the asset. If they are disabled, does the issue go away?
- Are there any Network share drives hosting artifacts?
- Does the issue reproduce with the same conditions on another server?