A test automation lead must present automation metrics to both the development team and the product owner. The development team wants to know where to focus fixes, and the product owner wants to know the business value. Which communication approach is most effective?

Present a technical report to the development team with failure trends by component, and a business-focused summary to the product owner with ROI and risk reduction

Present the same detailed technical report to both audiences to ensure consistency

Present the raw data to both audiences and let them draw their own conclusions

Present only the pass rate to both audiences to keep it simple

If the maintenance effort metric is high, what decision might be appropriate?

Ignore the metric and continue as is

Invest in improving test design or framework stability

Increase the number of test cases

How can test automation metrics support decision-making?

By automatically fixing defects

By eliminating the need for manual testing

By replacing the test manager's judgment

By providing data to prioritize automation efforts and allocate resources

A team has limited CI resources and needs to decide which tests to run on every commit. They have a set of fast unit tests and a set of slow end-to-end tests. The end-to-end tests have a high defect detection rate but take 30 minutes. What is the most informed decision based on metrics?

Run no tests on every commit and rely on nightly runs

Run only the unit tests on every commit and run end-to-end tests nightly

Run all tests on every commit to maximize coverage

Run only the end-to-end tests on every commit to catch defects early

A team wants to calculate the return on investment (ROI) of their test automation. They have the following data: manual regression takes 20 person-days per release, automated regression takes 5 person-days per release, and the automation maintenance costs 2 person-days per release. What is the net savings per release?

20 - 5 - 2 = 13 person-days saved

Certified Tester Test Automation Strategy

Domain 5Objective 2

Test Automation Metrics CT-TAS Practice Questions (Page 1)

Part of the Domain 5: Test Automation Impact Analysis domain, which makes up ~22% of our current practice bank. ISTQB does not publish an official question count, but from its 60-minute exam (~25–40 total, ~6–9 in this domain), expect 2–2 from this objective — we provide 26 practice questions to prepare you well beyond it. (estimate)

26questions here

6free pages

6concepts

Questions 1–5

1expert · hard
A test automation lead must present automation metrics to both the development team and the product owner. The development team wants to know where to focus fixes, and the product owner wants to know the business value. Which communication approach is most effective?
Select an answer first
2foundation · easy
If the maintenance effort metric is high, what decision might be appropriate?
Select an answer first
3foundation · easy
How can test automation metrics support decision-making?
Select an answer first
4application · medium
A team has limited CI resources and needs to decide which tests to run on every commit. They have a set of fast unit tests and a set of slow end-to-end tests. The end-to-end tests have a high defect detection rate but take 30 minutes. What is the most informed decision based on metrics?
Select an answer first
5expert · hard
A team wants to calculate the return on investment (ROI) of their test automation. They have the following data: manual regression takes 20 person-days per release, automated regression takes 5 person-days per release, and the automation maintenance costs 2 person-days per release. What is the net savings per release?
Select an answer first

Finished these 5 questions?

Review the revealed explanations, or continue through the curriculum.

Next 5 questions →Back to CT-TAS

Free Basic Practice is a study aid with revealable answers — not a scored exam. Examers.io is independent and not affiliated with or endorsed by ISTQB. “CT-TAS” is a trademark of its owner, used for identification only.