A test manager is planning the evaluation of a completed test project for a regulatory compliance system. The primary stakeholders are the compliance officer, who needs assurance that all required tests were executed, and the development lead, who wants to understand the efficiency of the test execution phase. The evaluation must be completed within two weeks using existing resources. What should the test manager do first?

Interview the compliance officer and development lead to gather their perceptions of the test project.

Collect all available test metrics and defect data from the test management tool.

Define the evaluation scope, objectives, and criteria tailored to each stakeholder's needs.

Draft a preliminary report of findings based on the test summary report.

Which of the following is a key performance indicator (KPI) for test efficiency?

Test execution time per test case

Percentage of requirements covered

Number of test cases designed per day

A test manager is evaluating the quality of the test process. The team found 120 defects during system testing, and after release, 15 additional defects were reported by users. The manager wants to report on the effectiveness of the testing effort in finding defects before release. Which metric should be used?

Defect removal efficiency = (120 / 135) × 100 = 88.9%

Test execution rate = (executed tests / planned tests) × 100

Defect detection percentage (DDP) = (120 / (120 + 15)) × 100 = 88.9%

Defect density = 120 / (size of the system)

A test manager is planning the evaluation of a test project that used a risk-based testing approach. The stakeholders include the project manager, who wants to know if the testing effort was aligned with the risk assessment, and the quality assurance director, who wants to know the overall quality of the release. The evaluation must be completed with minimal disruption to the team. What should the test manager prioritize in the evaluation plan?

Collecting data on risk coverage and defect detection in high-risk areas.

Focusing solely on the overall defect detection rate to assess quality.

Deferring the evaluation until after the release to avoid disruption.

Conducting in-depth interviews with all testers to gather their opinions.

Certified Tester Expert Level Test Management Operational Test Management

Domain 3Objective 5

Analysis and Design CTEL-TM-OTM Practice Questions (Page 4)

Part of the Test Project Evaluation and Reporting domain, which makes up ~47% of our current practice bank.

31questions here

7free pages

6concepts

Questions 16–20

16application · medium
A test manager is planning the evaluation of a completed test project for a regulatory compliance system. The primary stakeholders are the compliance officer, who needs assurance that all required tests were executed, and the development lead, who wants to understand the efficiency of the test execution phase. The evaluation must be completed within two weeks using existing resources. What should the test manager do first?
Select an answer first
17foundation · easy
Which of the following is a key performance indicator (KPI) for test efficiency?
Select an answer first
18application · medium
A test manager is evaluating the quality of the test process. The team found 120 defects during system testing, and after release, 15 additional defects were reported by users. The manager wants to report on the effectiveness of the testing effort in finding defects before release. Which metric should be used?
Select an answer first
19expert · hard
A test manager is planning the evaluation of a test project that used a risk-based testing approach. The stakeholders include the project manager, who wants to know if the testing effort was aligned with the risk assessment, and the quality assurance director, who wants to know the overall quality of the release. The evaluation must be completed with minimal disruption to the team. What should the test manager prioritize in the evaluation plan?
Select an answer first
20foundation · easy
Which analysis technique is used to identify the underlying reason for a deviation in test results?
Select an answer first

Finished these 5 questions?

Review the revealed explanations, or continue through the curriculum.

Next 5 questions →Back to CTEL-TM-OTM

Free Basic Practice is a study aid with revealable answers — not a scored exam. Examers.io is independent and not affiliated with or endorsed by ISTQB. “CTEL-TM-OTM” is a trademark of its owner, used for identification only.

Analysis and Design CTEL-TM-OTM Practice Questions (Page 4)

Questions 16–20

Which of the following is a key performance indicator (KPI) for test efficiency?

Which analysis technique is used to identify the underlying reason for a deviation in test results?

Keep studying — Test Project Evaluation and Reporting