A test manager is evaluating the efficiency of the test execution phase. The team planned to execute 800 test cases in 10 days, but they executed only 600 test cases in 12 days. Which metric best indicates the efficiency of test execution?

Test execution rate = (600 / 800) × 100 = 75%

Schedule variance = (12 - 10) / 10 = 20%

Defect detection rate = (defects found / 600) × 100

Test execution productivity = 600 / 12 = 50 test cases per day

A test manager is preparing the final evaluation report for a test project. The report will be reviewed by the project steering committee, which includes non-technical members. The test manager wants to present the test results in a way that is easily understood by this audience. Which approach is most appropriate?

Use a dashboard with key metrics and trend charts, accompanied by plain-language explanations.

Present only the final pass/fail status of the test project.

Include detailed tables of all test metrics and defect data.

Use technical jargon and acronyms to demonstrate expertise.

A test manager must present the final evaluation report to a mixed audience: senior management, who want a high-level summary of test effectiveness; and the test team, who need detailed information to improve their processes. What is the most effective way to structure the report?

Present all detailed metrics in the main body to ensure transparency.

Use only visualizations such as charts and graphs without textual explanation.

Distribute the report only to senior management to avoid confusion.

Provide an executive summary with key metrics and a detailed appendix for the test team.

A test manager is planning the evaluation of a test project that used a mix of manual and automated testing. The stakeholders have conflicting interests: the project sponsor wants to know the return on investment (ROI) of automation, while the test team wants to understand the effectiveness of their manual testing efforts. The evaluation budget is limited, and the manager must choose a single evaluation approach. What should the test manager do?

Defer the evaluation until the next project when more budget is available.

Focus the evaluation on automation ROI using cost-benefit analysis and present it to the sponsor.

Define evaluation objectives that balance both stakeholder needs, using metrics for automation ROI and manual testing effectiveness.

Conduct a survey of the test team about their manual testing experience and report the results to all stakeholders.

During test project evaluation planning, which of the following is a key stakeholder group that should be identified?

The project sponsor who funds the testing effort

The developers who write the application code

The test team members who execute the test cases

The end users who will use the final product

Certified Tester Expert Level Test Management Operational Test Management

Domain 3Objective 5

Analysis and Design CTEL-TM-OTM Practice Questions (Page 1)

Part of the Test Project Evaluation and Reporting domain, which makes up ~47% of our current practice bank.

31questions here

7free pages

6concepts

Questions 1–5

1application · medium
A test manager is evaluating the efficiency of the test execution phase. The team planned to execute 800 test cases in 10 days, but they executed only 600 test cases in 12 days. Which metric best indicates the efficiency of test execution?
Select an answer first
2application · medium
A test manager is preparing the final evaluation report for a test project. The report will be reviewed by the project steering committee, which includes non-technical members. The test manager wants to present the test results in a way that is easily understood by this audience. Which approach is most appropriate?
Select an answer first
3application · medium
A test manager must present the final evaluation report to a mixed audience: senior management, who want a high-level summary of test effectiveness; and the test team, who need detailed information to improve their processes. What is the most effective way to structure the report?
Select an answer first
4expert · hard
A test manager is planning the evaluation of a test project that used a mix of manual and automated testing. The stakeholders have conflicting interests: the project sponsor wants to know the return on investment (ROI) of automation, while the test team wants to understand the effectiveness of their manual testing efforts. The evaluation budget is limited, and the manager must choose a single evaluation approach. What should the test manager do?
Select an answer first
5foundation · easy
During test project evaluation planning, which of the following is a key stakeholder group that should be identified?
Select an answer first

Finished these 5 questions?

Review the revealed explanations, or continue through the curriculum.

Next 5 questions →Back to CTEL-TM-OTM

Free Basic Practice is a study aid with revealable answers — not a scored exam. Examers.io is independent and not affiliated with or endorsed by ISTQB. “CTEL-TM-OTM” is a trademark of its owner, used for identification only.

Analysis and Design CTEL-TM-OTM Practice Questions (Page 1)

Questions 1–5

A test manager is evaluating the efficiency of the test execution phase. The team planned to execute 800 test cases in 10 days, but they executed only 600 test cases in 12 days. Which metric best indicates the efficiency of test execution?

A test manager must present the final evaluation report to a mixed audience: senior management, who want a high-level summary of test effectiveness; and the test team, who need detailed information to improve their processes. What is the most effective way to structure the report?

During test project evaluation planning, which of the following is a key stakeholder group that should be identified?

Keep studying — Test Project Evaluation and Reporting