Effectiveness, Efficiency and Satisfaction Metrics for the Test Policy Objectives CTEL-TM-SM Practice Questions (Page 3)

Questions 11–15

1. 11foundation · easy

   Which of the following best describes an effectiveness metric for testing?

   • AThe number of testers who completed their assigned training
   • BThe percentage of defects found in the module with the highest risk
   • CThe number of test cases executed per hour
   • DThe total cost of test environment maintenance
   Reveal Solution Discussion Select an answer first
2. 12application · medium

   A financial services company's test policy states that the primary objective is to 'minimize the risk of critical defects reaching production.' The test manager is selecting metrics to evaluate this objective. Which metric is most directly aligned with this policy objective?

   • ANumber of critical defects found in production per release
   • BPercentage of test cases automated
   • CAverage time to execute the full regression suite
   • DTotal number of test cases written per sprint
   Reveal Solution Discussion Select an answer first
4. 13foundation · easy

   A test manager observes that the defect detection percentage has decreased over the last three releases. What is the most appropriate interpretation?

   • ATesting may be becoming less effective at finding defects before release
   • BThe number of test cases should be reduced
   • CTesting is becoming more effective
   • DThe test team is overworked
   Reveal Solution Discussion Select an answer first
5. 14foundation · easy

   Which metric is the most practical for measuring the objective 'to reduce the number of defects escaping to production'?

   • ANumber of test cases written per developer
   • BTeam satisfaction with the test process
   • CTime spent on test environment setup
   • DNumber of defects found in production per release
   Reveal Solution Discussion Select an answer first
6. 15foundation · easy

   When selecting a metric for a test policy objective, which characteristic is most important?

   • AThe metric is relevant to the objective and can be measured reliably
   • BThe metric is popular in the industry, regardless of context
   • CThe metric is easy to calculate, even if it does not measure the objective
   • DThe metric is complex and detailed, even if data is hard to obtain
   Reveal Solution Discussion Select an answer first