Work with execution results
Once you have run your ExecutionLists, you can analyze and process the results of your tests.
ExecutionList Demo Application after execution
In addition to your folder structure, ExecutionLists typically contain the following objects:
Object |
Description |
---|---|
Each ExecutionList has one ActualLog. The ActualLog contains the overall results of the last test run. When you run your ExecutionList again, Tosca overwrites the ActualLog with the latest results. You can manually clear ActualLogs of ExecutionLists, TestMandates, and Business ExecutionLists. To do so, right-click the ActualLog and select Clear Log from the context menu, or select Ctrl+ L. If you use Tricentis File Service, this removes all execution log data from the file system, including screenshots. |
|
|
An ArchivedLog archives the latest test results from the ActualLog at the time you create it (see chapter "Archive results"). |
The execution of this TestCase was successful. |
|
The execution of this TestCase failed. ExecutionEntries fail when the system under test does not behave as expected. Typically, a failure indicates that Tricentis Tosca found an error in the system under test. |
|
The execution of this TestCase returned an error. ExecutionEntries return an error when an issue with the environment keeps Tricentis Tosca from completing the test. For instance, if you have misspelled a command or an exception occurs. Typically, an error indicates a flaw in the TestCase or the environment. |
|
|
This ExecutionEntry has not been executed. It was created from a TestCase with the TestCaseWorkState COMPLETED. |
Each ExecutionEntry has one or more TestCaseLogs. Each TestCaseLog contains the results of this ExecutionEntry for a particular test run. When you run your ExecutionList again, Tosca adds a new TestCaseLog to each ExecutionEntry your run. A TestCaseLog can have the following results:
Each TestCaseLog belongs to a particular test run. Each test run has its own ExecutionSessionID, which you can find in the properties of a TestCaseLog. All TestCaseLogs that belong to a test run have the same ExecutionSessionID. |
|
TestCaseLogEntry |
Right-click on a TestCaseLogEntry to select one of the following options from the context menu:
|
|
Available in multi-user workspaces only. TestMandates allow several testers to execute the same tests simultaneously and independently. For more information, see chapter "Work with TestMandates". |
Analyze and process results
Once you have run your ExecutionLists, you can process the results:
-
Configure how Tosca Commander should display the results.
-
Create trend charts out of your execution results.
-
Transfer execution results to Microsoft® Excel if you want to process the data with third-party software.
Need a hand with