Test Planning Report
The Test Planning Report summarizes the test scope and test selection decisions all LiveCompare users have made for the selected analysis in the Impact Analysis Results app. To display the report, select an analysis in the app and then select Report in the screen’s header.
In the Test Planning Report’s header, you can do the following:
-
Select Download CSV to download the report as a CSV file.
-
Select Print / Save PDF to print the report or save it as a PDF file.
The report's heading lists the Pipeline used for the analysis, the analysis date, the analysis ID, and the report’s creation date and time.
The report has the following sections:
Executive Summary
This section displays a count of the most-at-risk (MAR), impacted, and not impacted objects in the analysis, and the total number of executables. We calculate the Test Reduction percentage values as (Non-MAR / Total Executables) * 100.
The section includes the following panels:
-
Phase 1 – Test Scope Review: Summarizes the test scope decisions.
-
Phase 2 - Test Selection: Summarizes the test selection decisions.
-
Gaps: Summarizes the test gap decisions.
Phase 1 – Test Scope Review
This section lists the number of In Scope, Out of Scope and Undecided test scope decisions for all Application Areas that have used executables. It has the following sections:
Summary by Application Area
This section lists the number of most-at-risk and impacted executables in each Application Area, and the total number of executables. It also summarizes the In Scope, Out of Scope and Undecided decisions in each Application Area. It has the following expandable sections:
<Application Area>
These sections summarize the scope decisions in each Application Area. They have the following columns:
| Column | Description |
|---|---|
| Status | The executable’s status, either MAR, Impacted or Not Impacted. |
| Executable | The executable’s name. |
| Risk | The risk level for most-at-risk executables, either H (High), M (Medium) or L (Low). |
| Usage | The executable’s usage count. |
| Biz Crit | This column is set to Y for business critical executables. LiveCompare considers these as most-at-risk. |
| Optimal | The number of optimal tests for this executable. |
| Covering | The number of covering tests for this executable. |
| Scope Decision | The scope decision for this executable, either In Scope, Out of Scope or Undecided. |
| Notes | Notes to support the scope decision. |
Phase 2 - Test Selection
This section lists the number of Run, Skip and Undecided test selection decisions for all Application Areas that have used executables. It has the following sections:
Summary by Application Area
This section lists the number of In Scope, Optimal and Covering tests in each Application Area, the number of Run, Skip and Undecided decisions, and the number of Test Gaps in each Application Area. It has the following expandable sections:
<Application Area> (<N> Tests)
These sections list the test selection decisions in each Application Area. They have the following columns:
| Column | Description |
|---|---|
| Test ID | The test’s ID. |
| Test Name | The test’s name. |
| Tested Object | The name of the tested executable. |
| Status | The test’s status, either Optimal or Covering. |
| Rank | The test’s rank either H (High), M (Medium) or L (Low). |
| Repository | The type of the Test Repository that stores the test. |
| Decision | The run decision for the test, either Run, Skip or Undecided. |
| Notes | Notes to support the run decision. |
Gaps
This section summarizes the Test, No Test and De-scope decisions for Test Gaps in the selected analysis. These are executables that don’t have any covering tests in any of the analysis’s Most-at-risk Search Test Repositories. The section has the following expandable sections:
<Application Area> (<N> Gaps)
These sections list the used executables in each Application Area, and their Test, No Test and De-scope decisions. The sections have the following columns:
| Column | Description |
|---|---|
| Executable | The executable’s name. |
| Type | The executable’s type. |
| Action | The test selection decision for the executable, either Run, No Test or De-scope. |
| Notes | Notes to support the test selection decision. |