A test policy objective is to 'reduce the cost of testing by 20% without reducing effectiveness.' The test manager is considering two metrics: cost per test case and DDP. The team has limited resources for data collection. Which metric set is most appropriate?

Use only DDP, as it measures effectiveness and is already collected

Use only cost per test case, as it directly measures the cost reduction objective

Use a single composite metric that combines cost and effectiveness

Use both cost per test case and DDP, as they together measure both cost and effectiveness

What is the purpose of interpreting metric results?

To determine whether test policy objectives are being met

To assign blame for test failures

To increase the number of test cases

To replace the need for test management

A test manager finds that the cost per defect found has increased significantly. Which decision is most appropriate based on this metric?

Ignore the metric because it is not important

Increase the test budget to cover the higher costs

Immediately reduce the number of testers

Investigate the testing process to identify inefficiencies and potential improvements

A test policy objective is to 'optimize the use of testing resources.' The test manager is considering several efficiency metrics. Which metric is most appropriate for this objective?

Defect detection percentage (DDP)

Test environment utilization rate

Number of defects found per test cycle

A test manager is collecting data to evaluate the efficiency of the testing process. The team has a test management tool that tracks test execution time and a financial system that tracks testing costs. Which data collection approach is most appropriate?

Collect data only from the last test cycle

Use the test management tool to automatically capture execution time and integrate with the financial system for cost data

Estimate testing costs based on the number of testers

Manually record test execution time in a spreadsheet

Certified Tester Expert Level Test Management Strategic Test Management

Domain 3Objective 2

Effectiveness, Efficiency and Satisfaction Metrics for the Test Policy Objectives CTEL-TM-SM Practice Questions (Page 2)

Part of the Evaluating Effectiveness and Efficiency domain, which makes up ~13% of our current practice bank.

29questions here

6free pages

8concepts

Questions 6–10

6expert · hard
A test policy objective is to 'reduce the cost of testing by 20% without reducing effectiveness.' The test manager is considering two metrics: cost per test case and DDP. The team has limited resources for data collection. Which metric set is most appropriate?
Select an answer first
7foundation · easy
What is the purpose of interpreting metric results?
Select an answer first
8foundation · easy
A test manager finds that the cost per defect found has increased significantly. Which decision is most appropriate based on this metric?
Select an answer first
9application · medium
A test policy objective is to 'optimize the use of testing resources.' The test manager is considering several efficiency metrics. Which metric is most appropriate for this objective?
Select an answer first
10application · medium
A test manager is collecting data to evaluate the efficiency of the testing process. The team has a test management tool that tracks test execution time and a financial system that tracks testing costs. Which data collection approach is most appropriate?
Select an answer first

Finished these 5 questions?

Review the revealed explanations, or continue through the curriculum.

Next 5 questions →Back to CTEL-TM-SM

Free Basic Practice is a study aid with revealable answers — not a scored exam. Examers.io is independent and not affiliated with or endorsed by ISTQB. “CTEL-TM-SM” is a trademark of its owner, used for identification only.