A test manager is evaluating the test process for a safety-critical system. The team has a high defect detection percentage (DDP) of 95%, but the number of critical defects found in production has increased. The manager suspects the DDP is misleading. What is the most appropriate action?

Analyze the DDP separately for critical and non-critical defects.

Report the DDP to stakeholders as is, since it is high.

Stop using DDP and rely on defect density.

Increase the number of test cases to improve DDP.

A project manager wants to measure the effectiveness of the testing process in finding defects before release. Which metric would be most appropriate to select?

Defect detection percentage (DDP)

When interpreting test effectiveness metrics, what should be considered to avoid misleading conclusions?

The opinion of the most senior tester

The context of the project, including its size and complexity

The number of testers on the team

A regulatory compliance project requires that all high-risk requirements be tested. The test manager needs a metric to demonstrate to auditors that this has been achieved. Which metric is most appropriate?

Requirements coverage percentage

Certified Tester Expert Level Assessing Test Processes

Domain 3Objective 5

Test Effectiveness Metrics CTEL-ITP-ATP Practice Questions (Page 6)

Part of the Domain 3: Analytical-based Improvement domain, which makes up ~32% of our current practice bank.

33questions here

7free pages

8concepts

Questions 26–30

26foundation · easy
Which category of test effectiveness metrics would 'defect density' (defects per size unit) belong to?
Select an answer first
27expert · hard
A test manager is evaluating the test process for a safety-critical system. The team has a high defect detection percentage (DDP) of 95%, but the number of critical defects found in production has increased. The manager suspects the DDP is misleading. What is the most appropriate action?
Select an answer first
28foundation · easy
A project manager wants to measure the effectiveness of the testing process in finding defects before release. Which metric would be most appropriate to select?
Select an answer first
29foundation · easy
When interpreting test effectiveness metrics, what should be considered to avoid misleading conclusions?
Select an answer first
30application · medium
A regulatory compliance project requires that all high-risk requirements be tested. The test manager needs a metric to demonstrate to auditors that this has been achieved. Which metric is most appropriate?
Select an answer first

Finished these 5 questions?

Review the revealed explanations, or continue through the curriculum.

Next 5 questions →Back to CTEL-ITP-ATP

Free Basic Practice is a study aid with revealable answers — not a scored exam. Examers.io is independent and not affiliated with or endorsed by ISTQB. “CTEL-ITP-ATP” is a trademark of its owner, used for identification only.