Effectiveness, Efficiency and Satisfaction Metrics for the Test Process CTEL-TM-SM Practice Questions (Page 3)

Questions 11–15

1. 11foundation · easy

   When interpreting a defect detection percentage of 85%, what does this indicate?

   • A85% of known defects were found by the test process before release
   • BThe test process is 85% efficient
   • C85% of test cases passed
   • D15% of defects were found after release
   Reveal Solution Discussion Select an answer first
2. 12foundation · easy

   Which metric quantifies the number of defects that were not detected by the test process and were later found by customers in production?

   • ATest coverage
   • BEscaped defects
   • CDefect density
   • DDefect detection percentage
   Reveal Solution Discussion Select an answer first
4. 13expert · hard

   A test manager observes that the cost per defect has increased by 40% over the last two releases, while the total number of defects found has remained stable. The test team's size and tools have not changed. What is the most likely explanation and the most appropriate improvement action?

   • AThe team is spending more time per defect; the manager should automate more test cases.
   • BThe cost per defect metric is unreliable; the manager should switch to a different efficiency metric.
   • CThe cost of fixing defects has increased; the manager should invest in better defect prevention techniques.
   • DThe team is finding fewer defects per hour; the manager should increase the number of test cases.
   Reveal Solution Discussion Select an answer first
5. 14foundation · easy

   Which type of metric captures how satisfied stakeholders are with the test process and its outcomes?

   • ACoverage metrics
   • BEffectiveness metrics
   • CSatisfaction metrics
   • DEfficiency metrics
   Reveal Solution Discussion Select an answer first
6. 15application · medium

   A test manager is introducing a new test process and wants to measure team satisfaction with the change. The team is resistant to the new process. Which approach is most appropriate?

   • AConduct a survey immediately after the process is introduced.
   • BAsk only the test lead for their opinion.
   • CUse the number of defects found as a proxy for team satisfaction.
   • DConduct a survey after the team has used the new process for a few cycles.
   Reveal Solution Discussion Select an answer first