Which of the following is a common pitfall when using test effectiveness metrics?

Using metrics to identify areas for improvement

Collecting data automatically from test tools

Reviewing metrics with the test team

Using metrics to compare projects of different sizes without normalization

Which statement best describes test effectiveness metrics?

They are measures of the number of testers on a project

They are measures of the number of test cases executed per day

They are measures that indicate how well the test process is achieving its objectives

They are measures of the total cost of the testing effort

Why can a high defect detection percentage (DDP) be misleading?

Because it is always calculated incorrectly

Because it is not based on any data

Because it may be high simply because few defects are reported after release, even if many defects exist

Because it measures efficiency, not effectiveness

A test team reports a high test case pass rate of 95%. However, the number of defects found in production is also high. What is the most likely pitfall in this metric?

The pass rate is too high because the team is not running enough tests.

The pass rate is always a reliable indicator of product quality.

The pass rate is not a valid metric and should not be used.

The pass rate may be inflated by low-quality test cases that do not effectively detect defects.

Certified Tester Expert Level Assessing Test Processes

Domain 3Objective 5

Test Effectiveness Metrics CTEL-ITP-ATP Practice Questions (Page 3)

Part of the Domain 3: Analytical-based Improvement domain, which makes up ~32% of our current practice bank.

33questions here

7free pages

8concepts

Questions 11–15

11application · medium
A test team has 200 test cases, and 160 of them passed. They found 40 defects during testing, and 10 defects were found in production. What is the test case pass rate?
Select an answer first
12foundation · easy
Which of the following is a common pitfall when using test effectiveness metrics?
Select an answer first
13foundation · easy
Which statement best describes test effectiveness metrics?
Select an answer first
14foundation · easy
Why can a high defect detection percentage (DDP) be misleading?
Select an answer first
15application · medium
A test team reports a high test case pass rate of 95%. However, the number of defects found in production is also high. What is the most likely pitfall in this metric?
Select an answer first

Finished these 5 questions?

Review the revealed explanations, or continue through the curriculum.

Next 5 questions →Back to CTEL-ITP-ATP

Free Basic Practice is a study aid with revealable answers — not a scored exam. Examers.io is independent and not affiliated with or endorsed by ISTQB. “CTEL-ITP-ATP” is a trademark of its owner, used for identification only.