Which metric is commonly used to evaluate the quality of AI-generated regression tests?

Time taken to generate the tests

Number of lines in the test script

A team maintains a large web application with an extensive manual regression suite. They want to use generative AI to automatically create new regression test cases from existing test scripts and requirements. The team's primary goal is to increase coverage of edge cases without duplicating existing tests. Which approach best meets this goal?

Ask the AI to generate a completely new set of test cases from scratch, ignoring the existing suite, to ensure freshness.

Feed the existing test scripts and requirements to the AI and ask it to generate additional test cases that cover scenarios not already addressed.

Use the AI to translate the existing manual test cases into automated scripts without adding new scenarios.

Have the AI generate test cases only from the requirements documents, excluding the existing test suite.

What is the primary purpose of regression testing?

To ensure the system is secure from external threats

To validate that the system meets performance requirements

To verify that new code changes do not break existing functionality

To test new features for the first time

A team uses generative AI to create test oracles for a legacy system with no existing automated tests. The AI generates oracles based on the system's current behavior. The team is concerned that the oracles may encode existing bugs as expected behavior. What is the best way to mitigate this risk?

Generate oracles from the system's documentation instead of its behavior.

Have domain experts review the AI-generated oracles to identify and correct any that encode known bugs.

Accept the oracles as-is because the AI is trained on correct behavior.

Use the oracles only for new features, not for existing functionality.

A team has a regression suite with many tests that rarely fail. They want to use generative AI to prioritize tests so that the most critical ones run first in their CI/CD pipeline. Which information should they provide to the AI to achieve effective prioritization?

Only the list of tests that have failed in the past.

Only the code changes, without any historical data.

Historical test results, code changes, and the mapping of tests to code modules.

Only the test names and their execution times.

Certified Tester Testing with Generative AI

Domain 2Objective 6

Automated Regression Testing with Generative AI CT-GENAI Practice Questions (Page 6)

Part of the Prompt Engineering for Effective Software Testing domain, which makes up ~30% of our current practice bank. ISTQB does not publish an official question count, but from its 60-minute exam (~25–40 total, ~8–12 in this domain), expect 1–1 from this objective — we provide 36 practice questions to prepare you well beyond it. (estimate)

36questions here

8free pages

10concepts

Questions 26–30

26foundation · easy
Which metric is commonly used to evaluate the quality of AI-generated regression tests?
Select an answer first
27application · medium
A team maintains a large web application with an extensive manual regression suite. They want to use generative AI to automatically create new regression test cases from existing test scripts and requirements. The team's primary goal is to increase coverage of edge cases without duplicating existing tests. Which approach best meets this goal?
Select an answer first
28foundation · easy
What is the primary purpose of regression testing?
Select an answer first
29expert · hard
A team uses generative AI to create test oracles for a legacy system with no existing automated tests. The AI generates oracles based on the system's current behavior. The team is concerned that the oracles may encode existing bugs as expected behavior. What is the best way to mitigate this risk?
Select an answer first
30application · medium
A team has a regression suite with many tests that rarely fail. They want to use generative AI to prioritize tests so that the most critical ones run first in their CI/CD pipeline. Which information should they provide to the AI to achieve effective prioritization?
Select an answer first

Finished these 5 questions?

Review the revealed explanations, or continue through the curriculum.

Next 5 questions →Back to CT-GENAI

Free Basic Practice is a study aid with revealable answers — not a scored exam. Examers.io is independent and not affiliated with or endorsed by ISTQB. “CT-GENAI” is a trademark of its owner, used for identification only.