A team is preparing a hands-on exercise to demonstrate AI-based visual testing. They have a set of screenshots of a web application from different browsers and resolutions. The exercise requires the AI to detect visual regressions. The team has a limited amount of time and needs to ensure the exercise is both meaningful and feasible. What is the most important consideration when setting up the environment?

Minimize the number of screenshots to reduce the exercise time.

Use screenshots from only one browser to simplify the analysis.

Use the highest resolution screenshots available for all comparisons.

Ensure the screenshots are labeled with the expected visual state (baseline) for comparison.

A team is setting up a hands-on exercise to use reinforcement learning to optimize the order of test execution to find failures faster. The environment is a simulated version of the application under test. What is the most important element to include in the setup to allow the AI agent to learn effectively?

A reward function that provides feedback based on the number of failures found and the time taken.

A rule-based system to override the agent's decisions when it makes mistakes.

A fixed sequence of test cases that the agent must follow.

A large dataset of historical test results to pre-train the agent.

For a hands-on exercise on AI-based test oracle generation, a team sets up a dataset of input-output pairs for a calculator application. The exercise requires the AI to learn the correct output for a given input. Which data preparation step is essential to prevent the model from simply memorizing the training data and failing on new inputs?

Shuffle the dataset and hold out a portion of it as a separate test set.

Remove all input-output pairs where the output is zero.

Sort the dataset by input value to make it easier for the model to learn patterns.

Duplicate the dataset to give the model more training examples.

A team completes a hands-on exercise where an AI model was trained to predict which modules in a new build are most likely to contain defects. The model's predictions are compared against the actual defects found during the subsequent testing phase. Which metric is most appropriate for evaluating the model's ability to identify the riskiest modules?

The time taken to train the AI model.

The total number of test cases executed in the exercise.

Precision at the top of the ranked list of modules.

The number of features used in the model.

When setting up the environment for a hands-on AI testing exercise, which of the following is typically required to ensure the exercise can be completed successfully?

Access to the necessary software libraries and a compatible runtime

A high-performance GPU for all exercises

A production-like environment with live user traffic

A dedicated physical server for each participant

Certified Tester AI Testing

Domain 11Objective 1

Hands-On Exercise:The Use of AI in Testing CT-AI Practice Questions (Page 2)

Part of the Domain 11: Using AI for Testing domain, which makes up ~11% of our current practice bank. ISTQB does not publish an official question count, but from its 60-minute exam (~25–40 total, ~3–4 in this domain), expect 1–1 from this objective — we provide 19 practice questions to prepare you well beyond it. (estimate)

19questions here

4free pages

3concepts

Questions 6–10

6expert · hard
A team is preparing a hands-on exercise to demonstrate AI-based visual testing. They have a set of screenshots of a web application from different browsers and resolutions. The exercise requires the AI to detect visual regressions. The team has a limited amount of time and needs to ensure the exercise is both meaningful and feasible. What is the most important consideration when setting up the environment?
Select an answer first
7application · medium
A team is setting up a hands-on exercise to use reinforcement learning to optimize the order of test execution to find failures faster. The environment is a simulated version of the application under test. What is the most important element to include in the setup to allow the AI agent to learn effectively?
Select an answer first
8application · medium
For a hands-on exercise on AI-based test oracle generation, a team sets up a dataset of input-output pairs for a calculator application. The exercise requires the AI to learn the correct output for a given input. Which data preparation step is essential to prevent the model from simply memorizing the training data and failing on new inputs?
Select an answer first
9application · medium
A team completes a hands-on exercise where an AI model was trained to predict which modules in a new build are most likely to contain defects. The model's predictions are compared against the actual defects found during the subsequent testing phase. Which metric is most appropriate for evaluating the model's ability to identify the riskiest modules?
Select an answer first
10foundation · easy
When setting up the environment for a hands-on AI testing exercise, which of the following is typically required to ensure the exercise can be completed successfully?
Select an answer first

Finished these 5 questions?

Review the revealed explanations, or continue through the curriculum.

Next 5 questions →Back to CT-AI

Free Basic Practice is a study aid with revealable answers — not a scored exam. Examers.io is independent and not affiliated with or endorsed by ISTQB. “CT-AI” is a trademark of its owner, used for identification only.

Hands-On Exercise:The Use of AI in Testing CT-AI Practice Questions (Page 2)

Questions 6–10

When setting up the environment for a hands-on AI testing exercise, which of the following is typically required to ensure the exercise can be completed successfully?

Keep studying — Domain 11: Using AI for Testing