After implementing AI-based prioritization, a team wants to measure whether the new order of tests detects faults earlier than the previous order. Which metric would best capture this?

Average percentage of faults detected (APFD)

When evaluating an AI-optimized regression suite, which two metrics are commonly used together to assess its value?

Fault detection rate and execution time

Number of testers and number of defects

A team has a large regression suite with many redundant tests. They want to reduce the suite while ensuring that each code module is still tested by at least one test. They are considering using clustering to group tests by the modules they cover. What is a key risk of this approach?

Tests that cover multiple modules may be assigned to only one cluster, potentially leaving other modules untested

Clustering will eliminate all tests that have ever failed

Clustering will always increase execution time

Clustering cannot be used with historical failure data

A team has a regression suite with tests that vary in execution time and fault detection capability. They want to reduce the suite to fit into a 1-hour nightly run. They are considering using clustering to group tests by similarity. What is a key challenge they must address?

Clustering will automatically balance execution time across clusters

Clustering will eliminate the need for prioritization

Ensuring that the selected representatives from each cluster fit within the time budget while maintaining coverage

Clustering will always select the fastest tests

Certified Tester AI Testing

Domain 11Objective 4

Using AI for the Optimization of Regression Test Suites CT-AI Practice Questions (Page 4)

Part of the Domain 11: Using AI for Testing domain, which makes up ~11% of our current practice bank. ISTQB does not publish an official question count, but from its 60-minute exam (~25–40 total, ~3–4 in this domain), expect 1–1 from this objective — we provide 26 practice questions to prepare you well beyond it. (estimate)

26questions here

6free pages

5concepts

Questions 16–20

16application · medium
After implementing AI-based prioritization, a team wants to measure whether the new order of tests detects faults earlier than the previous order. Which metric would best capture this?
Select an answer first
17foundation · easy
When evaluating an AI-optimized regression suite, which two metrics are commonly used together to assess its value?
Select an answer first
18expert · hard
A team has a large regression suite with many redundant tests. They want to reduce the suite while ensuring that each code module is still tested by at least one test. They are considering using clustering to group tests by the modules they cover. What is a key risk of this approach?
Select an answer first
19expert · hard
A team has a regression suite with tests that vary in execution time and fault detection capability. They want to reduce the suite to fit into a 1-hour nightly run. They are considering using clustering to group tests by similarity. What is a key challenge they must address?
Select an answer first
20foundation · easy
Which metric directly measures how many real defects the optimized regression suite detects?
Select an answer first

Finished these 5 questions?

Review the revealed explanations, or continue through the curriculum.

Next 5 questions →Back to CT-AI

Free Basic Practice is a study aid with revealable answers — not a scored exam. Examers.io is independent and not affiliated with or endorsed by ISTQB. “CT-AI” is a trademark of its owner, used for identification only.