An LLM-powered agent is analyzing a batch of test failures. It groups the failures into clusters and suggests a root cause for each cluster. The QA lead notices that the agent has grouped two unrelated failures into the same cluster. What is the MOST likely reason for this mis-grouping?

The test runner executed the tests in the wrong order, causing the failures to be mixed up

The agent's training data did not include examples of these specific error messages

The agent is not capable of distinguishing between different types of failures

The agent relied on superficial similarities in the error messages rather than deeper contextual analysis

How does an LLM-powered agent typically automate the generation of test cases from requirements?

By copying test cases from a public repository without modification

By randomly generating test cases without any input from requirements

By executing the application and recording all possible user interactions

By analyzing the requirements text and producing test cases that cover the described functionality

An LLM-powered testing agent is configured to execute a suite of UI tests. The agent uses a browser-automation tool to interact with the application. During a run, the application becomes unresponsive and the agent's script times out. What should the agent be designed to do in this situation?

Retry the same test indefinitely until the application becomes responsive again

Silently skip the test and record it as 'not run' without any diagnostic information

Abort the entire test suite and notify a human operator to investigate the unresponsive application

Capture a screenshot and the console logs, mark the test as failed, and continue with the next test in the suite

Which of the following is a benefit of using LLM-powered agents in test automation?

They require no training or configuration for specific projects

They eliminate the need for any human testers

They guarantee that all software defects are found

They can generate test cases quickly from natural language requirements

A team wants to build an LLM-powered agent that can autonomously explore a web application, find broken links, and report them. The agent should be able to navigate the site, click links, and record any 404 errors. What is the PRIMARY role of the LLM in this agent?

To make the HTTP requests to fetch the web pages and check for 404 status codes

To render the web pages in a browser so the agent can see them

To store the list of broken links in a database for reporting

To decide which links to click next based on the current page content and the goal of finding broken links

Certified Tester Testing with Generative AI

Domain 4Objective 3

The Role of LLM-Powered Agents in Automating Test Processes CT-GENAI Practice Questions (Page 4)

Part of the LLM-Powered Test Infrastructure for Software Testing domain, which makes up ~18% of our current practice bank. ISTQB does not publish an official question count, but from its 60-minute exam (~25–40 total, ~5–7 in this domain), expect 1–1 from this objective — we provide 33 practice questions to prepare you well beyond it. (estimate)

33questions here

7free pages

8concepts

8 Concepts in This Objective

Definition and Purpose of LLM-Powered Agents
Agent Architecture and Components
Automation of Test Case Generation
Automation of Test Execution
Automation of Test Result Analysis
Integration with Test Infrastructure
Benefits and Limitations
Human Oversight and Collaboration

Questions 16–20

16application · medium
An LLM-powered agent is analyzing a batch of test failures. It groups the failures into clusters and suggests a root cause for each cluster. The QA lead notices that the agent has grouped two unrelated failures into the same cluster. What is the MOST likely reason for this mis-grouping?
Select an answer first
17foundation · easy
How does an LLM-powered agent typically automate the generation of test cases from requirements?
Select an answer first
18application · medium
An LLM-powered testing agent is configured to execute a suite of UI tests. The agent uses a browser-automation tool to interact with the application. During a run, the application becomes unresponsive and the agent's script times out. What should the agent be designed to do in this situation?
Select an answer first
19foundation · easy
Which of the following is a benefit of using LLM-powered agents in test automation?
Select an answer first
20application · medium
A team wants to build an LLM-powered agent that can autonomously explore a web application, find broken links, and report them. The agent should be able to navigate the site, click links, and record any 404 errors. What is the PRIMARY role of the LLM in this agent?
Select an answer first

Finished these 5 questions?

Review the revealed explanations, or continue through the curriculum.

Next 5 questions →Back to CT-GENAI

Free Basic Practice is a study aid with revealable answers — not a scored exam. Examers.io is independent and not affiliated with or endorsed by ISTQB. “CT-GENAI” is a trademark of its owner, used for identification only.