A team wants to measure the effectiveness of their test automation. They have been tracking the pass rate of automated tests, but they want a more comprehensive view. Which combination of metrics would provide the most insight?

Number of test automation tools and test maintenance effort

Test execution time and number of test environments

Test pass rate, defect detection percentage, and time to feedback

Number of automated tests and number of testers

A team wants to integrate automated tests into their CI pipeline to get rapid feedback on every commit. They are concerned about the pipeline becoming a bottleneck. Which practice is most effective to address this concern?

Disable automated tests in CI and run them manually before release

Run all tests, including UI tests, on every commit

Run only UI tests on every commit

Run unit tests on every commit and schedule integration and UI tests to run less frequently, such as nightly

A team's CI pipeline runs automated tests on every commit. Recently, the pipeline has become a bottleneck because the full test suite takes over an hour. The team wants to maintain fast feedback without sacrificing coverage. Which approach best balances these constraints?

Move all tests to a nightly run

Reduce the test suite by removing tests that take the longest

Increase the number of parallel test runners

Implement test impact analysis to run only tests affected by the code changes

Certified Tester Advanced Level Agile Technical Tester

Domain 3Objective 1

Test Automation Techniques CT-ATT Practice Questions (Page 5)

Part of the Test Automation domain, which makes up ~19% of our current practice bank. ISTQB does not publish an official question count, but from its 90-minute exam (~35–60 total, ~7–11 in this domain), expect 4–6 from this objective — we provide 28 practice questions to prepare you well beyond it. (estimate)

28questions here

6free pages

10concepts

Questions 21–25

21expert · hard
A team wants to measure the effectiveness of their test automation. They have been tracking the pass rate of automated tests, but they want a more comprehensive view. Which combination of metrics would provide the most insight?
Select an answer first
22foundation · easy
Which metric measures the percentage of automated tests that pass successfully?
Select an answer first
23application · medium
A team wants to integrate automated tests into their CI pipeline to get rapid feedback on every commit. They are concerned about the pipeline becoming a bottleneck. Which practice is most effective to address this concern?
Select an answer first
24application · medium
A team has a test suite where the same test steps are repeated across multiple test cases with different data sets. They want to reduce duplication and improve maintainability. Which test automation framework approach is most suitable?
Select an answer first
25expert · hard
A team's CI pipeline runs automated tests on every commit. Recently, the pipeline has become a bottleneck because the full test suite takes over an hour. The team wants to maintain fast feedback without sacrificing coverage. Which approach best balances these constraints?
Select an answer first

Finished these 5 questions?

Review the revealed explanations, or continue through the curriculum.

Next 5 questions →Back to CT-ATT

Free Basic Practice is a study aid with revealable answers — not a scored exam. Examers.io is independent and not affiliated with or endorsed by ISTQB. “CT-ATT” is a trademark of its owner, used for identification only.

Test Automation Techniques CT-ATT Practice Questions (Page 5)

Questions 21–25

A team wants to measure the effectiveness of their test automation. They have been tracking the pass rate of automated tests, but they want a more comprehensive view. Which combination of metrics would provide the most insight?

Which metric measures the percentage of automated tests that pass successfully?

A team wants to integrate automated tests into their CI pipeline to get rapid feedback on every commit. They are concerned about the pipeline becoming a bottleneck. Which practice is most effective to address this concern?

A team has a test suite where the same test steps are repeated across multiple test cases with different data sets. They want to reduce duplication and improve maintainability. Which test automation framework approach is most suitable?

A team's CI pipeline runs automated tests on every commit. Recently, the pipeline has become a bottleneck because the full test suite takes over an hour. The team wants to maintain fast feedback without sacrificing coverage. Which approach best balances these constraints?

Keep studying — Test Automation