This topic explains how to run a test from the C/C++test command line interface (
cpptestcli), which is described in Command Line Interface (cli).
The command line mode requires a command line interface license (available with C/C++test Automation Edition).
There are two command line interface licenses available for C/C++test:
For command line execution, you will need to ensure that the installation directory is on the path, or launch cpptest with the full path to the executable (for example,
c:\parasoft\c++test\cpptestcli.exe).Before you can test code with C/C++test, it must be added to a Visual Studio project. See Creating a Project.
cpptestcli to email each developer a report that contains only the errors/results related to his or her work, one of the following conditions must be true:
You have configured C++test to compute code authorship based on source control data AND your project is under a supported source control system AND each developer’s source control username + the mail domain (specified using an options file and the
-localsettings option described in
-localsettings %LOCALSETTINGS_FILE%) matches the developer’s email address.
You have configured C++test to compute code authorship based on local user AND each user name + the mail domain (specified using an options file and the
-localsettings option described in
-localsettings %LOCALSETTINGS_FILE%) matches the developer’s email address.
Parasoft C/C++test Professional has two user modes: interactive desktop usage in the GUI and command line mode via the command line interface (CLI). The CLI interface is a standard feature of the Automation Edition.
CLI mode is typically used to perform regular or continuous code analysis and test in conjunction with regular/continuous builds or as a part of an automatic regression test infrastructure. C/C++test CLI can be invoked on a full Visual Studio solution, or one or more projects or source files that are part of a solution. As part of the CLI execution, C/C++test can perform one or more of the following:
Execution of unit testsin a given solution.
As part of the execution, C++test can use your SCM client (if supported) to automatically retrieve file modification information from the SCM system and generate tasks for specific individuals based on results of code analysis and executed tests.
Specific execution options for C/C++test are controlled via Test Configurations and Preferences.
Test Configurations can be sourced from the built in set, or created using C/C++test interactive mode in the GUI. We suggest using the built-in configurations as starting templates for customer-specific configurations.
Preferences can be configured from the C/C++test GUI. Most of the preference settings can also be supplied with a configuration file that is provided as a parameter to a CLI call. A table of the configuration file preference settings is available in Local Settings (Options) Files. C/C++test preferences set from the GUI are applied by default. These can be overridden — on an individual basis—by preference values contained in the configuration file used with a given run. This enables you to have a basic set of preferences configured for all CLI runs, and then vary individual settings as necessary by providing an additional configuration file for a specific run with a given Test Configuration. This can be useful, for example, to include different information in reports for different runs, or to change options for email distribution of reports, including report names, email headings, etc.
C/C++test preferences are accessed through the Parasoft> Preferences menu. Start by configuring the following preferences:
localhost. Unless you changed the Team Server default port (18888) when it was installed, do not change the port here. Click Test Connection to verify the correct settings.
Reports: The following options are enabled by default and are a good starting point:
Detailed report for developers (includes task breakdown with details).
Overview of tasks by authors (summary table).
Generate formatted reports in command line mode.
Suppressions Details (applies to static analysis only).
E-mails: Enter settings that will be used to send emails with reports. This needs to be an existing email account on an email server accessible from the C++test test machine.
Reports> Email Notifications:
If desired, enable Send Reports by Email. Regardless of this setting, reports will always be uploaded to Parasoft Team Server for later viewing (controlled by the CLI option). Email distribution will use the settings for E-mails above.
Manager reports contain a rollup of all test results generated by C++test Developer reports contain only results for individual developers. Enable options and specify email addresses accordingly.
Create a custom Test Configuration as described in Configuring Test Configurations.
Create a localsettings file as described in Local Settings (Options) Files.
For example, your command line may resemble the following:
cpptestcli -solution "c:\MySolution" -resource "ProjectToTest" -config builtin://ShouldHaveRules -publishteamserver -localsettings acme_policy.settings
The general procedure for testing from the command line is as follows:
cpptestcliutility, with appropriate options, to launch analysis in the command-line mode. A complete list of options is provided in cli Options. Key options are:
C/C++test does not directly test headers unless they are included by a source file under test. See How do I analyze header files/what files are analyzed? for details.
C/C++test does perform static analysis and unit testing of instantiated function templates and instantiated members of class templates. See Support for Template Functions for details.
The general form of invocation for
Typically, invocations follow this pattern:
If you want to exclude some files from analysis/testing (for instance, to prevent static analysis of automatically-generated files), you can indicate which project resources should not be tested as described in Excluding Project Resources from Testing. Perform this configuration in the GUI, then the settings will be applied for all tests on this project—from the GUI or from the command line.
cpptestcli options are listed in the following tables.
Specifies that you want to run the Test Configuration available at
This parameter is required except when importing projects.
%CONFIG_URL%is interpreted as a URL, the name of a Test Configuration, or the path to a local file. Examples:
-config "builtin://Demo Configuration"
-config "Demo Configuration"
-config "user://My First Configuration"
-config "team://Team Configuration"
-help- Displays help information. Does not run testing.
%LOCALSETTINGS_FILE% -Reads the options file
%LOCALSETTINGS_FILE%for global preferences. These settings specify details such as Parasoft DTP settings, email settings, and Team Server settings.
-nobuild- Prevents C++test from rebuilding the project before testing it. Use this option if the project is already built before the test run.
-fail- Fails the build by returning a non-zero exit code if violations or setup problems are reported (see Command Line Exit Codes for details about exit codes returned if the process fails).
-publish- Publishes the report to DTP. You can enable sending reports to DTP in the GUI or in the command line mode; see
-publishteamserver- Publishes the report to the Team Server. The Team Server location can be specified in the GUI or in the options file (described in the
%REPORT_FILE% -Generates an XML report to the given file
%REPORT_FILE%and adds an HTML (or PDF or custom format—if specified using the report.format option) report with the same name (and a different extension) in the same directory.
filename.htmland an XML report
If the specified path ends with an ".html"/".htm"/".xml" extension, it will be treated as a path to the report file to generate. Otherwise, it will be treated as a path to a directory where reports should be generated.
If the file name is explicitly specified in the command and a file with this name already exists in the specified location, the previous report will be overwritten. If your command doesn’t explicitly specify a file name, the existing report file will not be overwritten—the new file will be named repXXXX.html, where XXXX is a random number.
-report option is not specified, reports will be generated with the default names "report.xml/html" in the current directory.
_NAME:port% - Pulls settings stored on the DTP server (recommended for ease of maintenance — especially if you do not already have a locallocally stored settings file).
-encodepass <plainpassword> - Generates an encoded version of a given password. Prints the message 'Encrypted password: <encpass>' and terminates the cli application.
If your nightly process will 1) login to Team Server and b) send emails, you can use this option to encrypt the required passwords.
-showdetails - Prints detailed test progress information.
-disablescm- Disconnects source control information from the solution and project.
AME% -Specifies the solution configuration to use for building the solution and for analysis.
Releaseare common names. If the switch is omitted, then the active configuration is used. Specifying the solution configuration is strongly recommended because the active configuration may change unexpectedly.
AME% -Specifies the solution target platform to use for building the solution and for analysis. Any CPU and x86 are common names. If omitted, the active configuration is used. Specifying the target platform is strongly recommended because the active configuration may change unexpectedly.
-appconsole stdout|% OUTPUT_FILE%- Redirects C++test's console output to standard output or an
-appconsole stdout(console redirected to the standard output)
-appconsole console.out(console redirected to console.out file)
-list-compilers - Prints a list of valid compiler family values. Must be used along with
-list-configs - Prints a list of valid Test Configuration values. Must be used along with
-include %PATTERN%, -exclude %PATTERN% - Specifies files to be included/excluded during testing.
You must specify a file name or path after this option.
Patterns specify file names, with the wildcards *and ? accepted, and the special wildcard ** used to specify one or more path name segments. Syntax for the patterns is similar to that of Ant filesets.
-include **/Bank.cpp (test Bank.cpp files)
-include **/ATM/Bank/*.cpp (test all .cpp files in folder ATM/Bank)
-include c:/ATM/Bank/Bank.cpp (test only the c:/ATM/Bank/Bank.cpp file)
-exclude **/internal/** (test everything except classes that have path with folder "internal")
-exclude **/*Test.cpp (test everything, but files that end with Test.cpp)
Additionally if a pattern is a file with a .lst extension, it is treated as a file with a list of patterns.
For example, if you use -include c:/include.lst and include.lst contains the following (each line is treated as single pattern):
then it has same effect as specifying:
-include **/Bank.cpp -include **/ATM/Bank/*.cpp
-useenv- Causes the IDE to use PATH, INCLUDE, and LIB environment variables for Visual C++ compilation rather than the settings specified in the VC++ Directories section of the Projects options (in the Options dialog box).
-clearcmc- Cleans Visual Studio's Component Model Cache
Specifies the location of the solution file to use.Specifies the location of the solution file to use.
N/AN/ASpecifies the location of the solution file to use.
Specifies the path to the workspace resource
Use multiple times to specify multiple resources.
Use quotes when the resource path contains spaces or other non-alphanumeric characters.
For example, to test the
Localsettings files can be passed at the command line to control options for reporting, task assignment, licensing, and more. This allows you to:
You can create different options files for different projects, then use the
-localsettings option to indicate which file should be used for the current command line test.
See Configuring Localsettings for information about localsettings files and the list of available settings.