After testing is complete, we will provide a clear and comprehensive test summary report detailing the quality assessment results for the target system and the findings of the project review.
This report will clearly outline the test design approach, test case management, and defect management methods, as well as the aggregated data and summary compiled following test execution, and will identify opportunities for improvement gained through this project.
Specifically, we will review the test results based on information such as the test summary (including test objectives and the test schedule), the number of defects, the number of test items completed and remaining, and a list of detected bugs. Additionally, we will analyze incidents discovered during the test period and summarize the characteristics of the defects, along with recommendations and proposals for future actions.
2. Acceptance Status of the Test
3. Review of the Test Plan
5. Review of Test Results
6. Recommendations and Other Matters
Examples of Quality Metrics in the Design Phase
1. Basic Design
| No |
Quality Metric |
Unit |
| 1 |
Number of Document Defects |
Items |
| 2 |
Number of defective documents per page |
/page |
| 3 |
Number of DR findings per page |
Items/page |
| 4 |
Man-hours per page |
Man-hours/page |
| 5 |
Days of inspection delay |
Days |
| 6 |
Number of document inspections performed |
times |
2. Functional Design
| No |
Quality Metrics |
Unit |
| 1 |
Number of Document Defects |
Items |
| 2 |
Number of defective documents per page |
/page |
| 3 |
Number of DR findings per page |
Items/page |
| 4 |
Man-hours per page |
Man-hours/page |
| 5 |
Days of Delay in Completion |
Days |
| 6 |
Number of document inspections performed |
times |
3. Structural Design / Detailed Design
| No |
Quality Indicator |
Unit |
| 1 |
Number of Document Defects |
Items |
| 2 |
Number of defective documents per page |
/page |
| 3 |
Number of DR findings per page |
Items/page |
| 4 |
Man-hours per page |
Man-hours/page |
| 5 |
Days of inspection delay |
Days |
| 6 |
Number of test cases / KS |
Items/KS |
| 7 |
Number of Change Requests |
Items |
| 8 |
Document inspections conducted |
times |
4. Coding
| No |
Quality Indicator |
Unit |
| 1 |
Man-hours per step |
Person-hours/step |
| 2 |
Number of flags |
Items |
Example of Quality Metrics for the Testing Phase
5. Unit Test
| No |
Quality Metrics |
Unit |
| 1 |
Number of defects detected (cumulative) |
Cases |
| 2 |
Number of defects detected per KS |
Cases/KS |
| 3 |
Test Item Progress |
％ |
| 4 |
Number of defects detected / Man-hours |
Items/Person-Hour |
| 5 |
Number of Defects Detected / Machine Hours |
％ |
| 6 |
Test program completion rate |
％ |
| 7 |
Defect Rate (Number of Defects Detected / Test Items) |
％ |
6. Unit, Integration, and System Testing
| No |
Quality Metrics |
Unit |
| 1 |
Number of Defects Detected (Cumulative) |
Cases |
| 2 |
Number of defects detected per KS |
Cases/KS |
| 3 |
Test Item Progress |
％ |
| 4 |
Number of defects detected / Man-hours |
Items/Person-Hour |
| 5 |
Number of Defects Detected / Machine Hours |
％ |
| 6 |
Test program completion rate |
％ |
| 7 |
Failure rate in comprehensive design endurance testing |
Cases/H |
| 8 |
Defect Rate with Probe |
％ |
| 9 |
Probe failure rate |
Cases/H |
| 10 |
Estimated number of remaining defects detected by the probe |
units |
| 11 |
Defect rate (Number of defects detected / Number of test items) |
％ |
7. Product Inspection
| No |
Quality Indicator |
Unit |
| 1 |
Number of Failures |
cases |
| 2 |
Number of failures per KS |
cases/KS |
| 3 |
Number of product inspections conducted |
times |
| 4 |
Failure rate (1/MTBF) |
Incidents/H |
| 5 |
MTBF |
H/Incident |
| 6 |
Defect rate |
％ |
| 7 |
Number of Defects Identified (Cumulative) |
Items |
Related Pages
System Testing
Test Design
Test Execution
Test Planning
Please feel free to contact us with any inquiries or requests regarding system testing.
