Which metric is most useful for evaluating the effectiveness of a GenAI tool that generates test cases?

The number of defects found in the generated test cases themselves

The number of test cases generated per day

The time spent by testers reviewing the generated cases

The percentage of generated test cases that are valid and cover the intended requirements

A test team has diverse skill levels: some testers are experts in automation, others are new to testing. The team lead wants to build GenAI capabilities but has a limited training budget. The goal is to enable all testers to use GenAI for test design within three months. What is the most effective approach?

Hire an external GenAI consultant to train the entire team in a one-day workshop.

Focus training only on the automation experts, assuming they will train others.

Create a tiered training plan: basic prompt writing for beginners, advanced prompt engineering for experts, and cross-mentoring between the two groups.

Provide the same advanced GenAI training to all testers to ensure consistency.

What is the primary purpose of evaluating the impact of GenAI on team performance?

To justify the cost of the GenAI tools to management

To identify areas for improvement and guide continuous enhancement of GenAI usage

To decide whether to replace the test team with AI

To compare the performance of individual team members

A test team is planning to use GenAI for exploratory testing support. The team has no experience with GenAI. The test manager wants to build the necessary skills. What should be the first step in the upskilling plan?

Hire a GenAI specialist to handle all GenAI-related tasks.

Provide basic training on how to interact with GenAI tools, including prompt writing and understanding output limitations.

Immediately assign GenAI tasks to testers and let them learn by doing.

Train all testers in advanced machine learning concepts.

Certified Tester Testing with Generative AI

Domain 5Objective 6

Building Generative AI Capabilities in Test Teams CT-GENAI Practice Questions (Page 3)

Part of the Deploying and Integrating Generative AI in Test organizations domain, which makes up ~23% of our current practice bank. ISTQB does not publish an official question count, but from its 60-minute exam (~25–40 total, ~6–9 in this domain), expect 1–1 from this objective — we provide 28 practice questions to prepare you well beyond it. (estimate)

28questions here

6free pages

6concepts

Questions 11–15

11foundation · easy
Which role is specifically focused on integrating GenAI outputs into the test execution and validation process?
Select an answer first
12foundation · easy
Which metric is most useful for evaluating the effectiveness of a GenAI tool that generates test cases?
Select an answer first
13expert · hard
A test team has diverse skill levels: some testers are experts in automation, others are new to testing. The team lead wants to build GenAI capabilities but has a limited training budget. The goal is to enable all testers to use GenAI for test design within three months. What is the most effective approach?
Select an answer first
14foundation · easy
What is the primary purpose of evaluating the impact of GenAI on team performance?
Select an answer first
15application · easy
A test team is planning to use GenAI for exploratory testing support. The team has no experience with GenAI. The test manager wants to build the necessary skills. What should be the first step in the upskilling plan?
Select an answer first

Finished these 5 questions?

Review the revealed explanations, or continue through the curriculum.

Next 5 questions →Back to CT-GENAI

Free Basic Practice is a study aid with revealable answers — not a scored exam. Examers.io is independent and not affiliated with or endorsed by ISTQB. “CT-GENAI” is a trademark of its owner, used for identification only.

Building Generative AI Capabilities in Test Teams CT-GENAI Practice Questions (Page 3)

Questions 11–15

Which role is specifically focused on integrating GenAI outputs into the test execution and validation process?

Which metric is most useful for evaluating the effectiveness of a GenAI tool that generates test cases?

What is the primary purpose of evaluating the impact of GenAI on team performance?

A test team is planning to use GenAI for exploratory testing support. The team has no experience with GenAI. The test manager wants to build the necessary skills. What should be the first step in the upskilling plan?

Keep studying — Deploying and Integrating Generative AI in Test organizations