Effectiveness, Efficiency and Satisfaction Metrics for the Test Policy Objectives CTEL-TM-SM Practice Questions (Page 5)

Questions 21–25

1. 21foundation · easy

   A test policy objective is 'to reduce the cost of testing by 20%'. Which metric is most aligned with this objective?

   • ATotal cost of testing per release
   • BNumber of test cases written
   • CDefect detection percentage
   • DStakeholder satisfaction score
   Reveal Solution Discussion Select an answer first
2. 22expert · hard

   A test manager has collected data showing that the cost per defect has decreased by 15%, but the developer satisfaction survey score has dropped by 20%. The test manager must decide how to proceed. What is the most appropriate action?

   • ACelebrate the cost reduction and ignore the satisfaction drop, as cost is a more important metric
   • BInvestigate the cause of the satisfaction drop, as it may be related to the cost reduction efforts
   • CConduct a new survey to confirm the satisfaction drop
   • DReverse the cost reduction measures to improve satisfaction
   Reveal Solution Discussion Select an answer first
4. 23application · medium

   A test manager has collected data showing that the defect detection percentage (DDP) is 80%, but the policy objective is 95%. The manager also notices that the test cases are heavily focused on new features, while regression testing is minimal. What is the most likely interpretation of these metric results?

   • AThe testing process is efficient but not effective
   • BThe low DDP may be caused by insufficient regression testing, allowing defects to escape to production
   • CThe DDP is low because the test cases are too focused on new features
   • DThe testing process is effective but not efficient
   Reveal Solution Discussion Select an answer first
5. 24application · medium

   A test manager is defining metrics for a policy objective that states 'testing should identify 95% of all defects before release.' The team has a mature defect-tracking system. Which metric is the most practical and measurable choice?

   • ADefect detection percentage (DDP)
   • BMean time to detect a defect
   • CCode coverage percentage
   • DTest case pass rate
   Reveal Solution Discussion Select an answer first
6. 25application · medium

   A test manager wants to analyze the effectiveness of the testing process by examining defect data. The team has a defect-tracking system with data on when defects were found (test phase vs. production) and their severity. Which analysis would provide the most useful insight into testing effectiveness?

   • ACalculate the defect detection percentage (DDP) for each severity level
   • BCount the total number of defects found in the last release
   • CList all defects found in production without analysis
   • DCalculate the average time to fix all defects
   Reveal Solution Discussion Select an answer first