How can metric results be used to make informed decisions about test process improvements?

By eliminating all testing activities

By increasing the test budget without analysis

By identifying areas where testing is underperforming and focusing improvement efforts there

By automatically fixing all defects found

A test manager is evaluating stakeholder satisfaction with the testing process. A survey shows that developers are satisfied with the speed of testing but dissatisfied with the quality of defect reports. The test manager must decide how to use this data. What is the most appropriate action?

Focus on improving the speed of testing, as this is the area where developers are satisfied

Prioritize improving the quality of defect reports, as this is a specific area of dissatisfaction

Ignore the dissatisfaction with defect reports because developers are generally satisfied with the speed

Conduct another survey to confirm the results before taking any action

A test policy has three objectives: (1) find critical defects early, (2) minimize testing cost, and (3) keep developers satisfied with the testing process. The test manager needs to select one metric for each objective. Which set of metrics is most appropriate?

Test case pass rate, test execution time, number of defects found

DDP, cost per defect, developer satisfaction survey score

Code coverage, cost per test case, developer turnover rate

Number of test cases, total testing cost, number of test environment issues

A test policy states that 'testing should be a collaborative and valued partner in the development process.' The test manager wants to measure whether this objective is being met. Which metric is most appropriate?

Stakeholder satisfaction survey score on the value of testing

Percentage of test cases that pass on the first run

Number of defects reported per test cycle

Average time to fix a critical defect

Which metric is most appropriate for evaluating the effectiveness of testing in achieving the objective of 'minimizing production defects'?

Number of test environments available

Average time to execute a test suite

Defect detection percentage (DDP) in testing

Certified Tester Expert Level Test Management Strategic Test Management

Domain 3Objective 2

Effectiveness, Efficiency and Satisfaction Metrics for the Test Policy Objectives CTEL-TM-SM Practice Questions (Page 1)

Part of the Evaluating Effectiveness and Efficiency domain, which makes up ~13% of our current practice bank.

29questions here

6free pages

8concepts

Questions 1–5

1foundation · easy
How can metric results be used to make informed decisions about test process improvements?
Select an answer first
2expert · hard
A test manager is evaluating stakeholder satisfaction with the testing process. A survey shows that developers are satisfied with the speed of testing but dissatisfied with the quality of defect reports. The test manager must decide how to use this data. What is the most appropriate action?
Select an answer first
3application · medium
A test policy has three objectives: (1) find critical defects early, (2) minimize testing cost, and (3) keep developers satisfied with the testing process. The test manager needs to select one metric for each objective. Which set of metrics is most appropriate?
Select an answer first
4application · medium
A test policy states that 'testing should be a collaborative and valued partner in the development process.' The test manager wants to measure whether this objective is being met. Which metric is most appropriate?
Select an answer first
5foundation · easy
Which metric is most appropriate for evaluating the effectiveness of testing in achieving the objective of 'minimizing production defects'?
Select an answer first

Finished these 5 questions?

Review the revealed explanations, or continue through the curriculum.

Next 5 questions →Back to CTEL-TM-SM

Free Basic Practice is a study aid with revealable answers — not a scored exam. Examers.io is independent and not affiliated with or endorsed by ISTQB. “CTEL-TM-SM” is a trademark of its owner, used for identification only.