Certified Tester Testing with Generative AI
Domain 2Objective 8
Metrics for Evaluating the Results of Generative AI on Test Tasks CT-GENAI Practice Questions (Page 3)
Part of the Prompt Engineering for Effective Software Testing domain, which makes up ~30% of our current practice bank. ISTQB does not publish an official question count, but from its 60-minute exam (~25–40 total, ~8–12 in this domain), expect 1–1 from this objective — we provide 35 practice questions to prepare you well beyond it. (estimate)
35questions here
7free pages
9concepts
Questions 11–15
- 11
Which of the following best describes the role of evaluation metrics when assessing generative AI outputs for test tasks?
Select an answer first - 12
A team uses generative AI to produce user story acceptance test scenarios. They want to ensure the scenarios are understandable and actionable for the business stakeholders who will review them. Which evaluation approach is most appropriate?
Select an answer first - 13
Which metric incorporates expert judgment to evaluate the quality of generated test cases?
Select an answer first - 14
Which metric checks whether a generative AI model produces the same test case when given the same prompt multiple times?
Select an answer first - 15
A team uses generative AI to produce test oracles (expected outputs) for a financial calculation function. They need to ensure the expected outputs match the specification exactly. Which metric is most critical for this evaluation?
Select an answer first
Finished these 5 questions?
Review the revealed explanations, or continue through the curriculum.
Free Basic Practice is a study aid with revealable answers — not a scored exam. Examers.io is independent and not affiliated with or endorsed by ISTQB. “CT-GENAI” is a trademark of its owner, used for identification only.