How can generative AI be used to produce automated test scripts?

By manually writing scripts for each test case without any automation.

By converting natural language test steps into executable code in a target framework.

By executing tests directly on the production environment without any code.

By generating scripts that are guaranteed to be bug-free and require no review.

A team uses a generative AI model to generate test cases from requirements. They want to measure how well the model covers the requirements. Which metric is most appropriate?

Model accuracy: how often the model's output is factually correct.

Defect detection rate: the number of defects found by the test cases.

Requirement coverage: the percentage of requirements that have at least one corresponding test case.

Code coverage: the percentage of code lines executed by the test cases.

A team uses a generative AI model to generate automated test scripts from API specifications. The generated scripts pass in the local environment but fail in the CI environment due to different base URLs and authentication tokens. What is the best way to handle this?

Run the scripts only in the local environment to avoid configuration issues.

Use environment variables in the generated scripts for configurable values like base URL and tokens.

Hardcode the CI environment's base URL and tokens into the generated scripts.

Use a different AI model that generates environment-agnostic scripts.

A test team wants to use a generative AI service to generate test data for a global application. The service is hosted in a country with different data protection laws than the company's headquarters. The data includes personal information of users from multiple countries. What is the most important consideration?

Host the AI service in the company's headquarters to avoid legal issues.

Obtain consent from all users before using their data.

Use only synthetic data that does not contain real personal information.

Ensure compliance with the data protection laws of all countries where users reside.

What is the primary role of a human tester when working with generative AI?

To blindly accept all AI-generated test cases without review.

To review, validate, and provide context for AI-generated outputs.

To replace the AI system entirely with manual testing.

To write all test cases manually and ignore AI suggestions.

Certified Tester Testing with Generative AI

Domain 5Objective 5

Essential Skills and Knowledge for Testing with Generative AI CT-GENAI Practice Questions (Page 7)

Part of the Deploying and Integrating Generative AI in Test organizations domain, which makes up ~23% of our current practice bank. ISTQB does not publish an official question count, but from its 60-minute exam (~25–40 total, ~6–9 in this domain), expect 1–1 from this objective — we provide 36 practice questions to prepare you well beyond it. (estimate)

36questions here

8free pages

10concepts

10 Concepts in This Objective

Fundamentals of Generative AI
Generative AI in Software Testing
Test Data Generation
Test Case and Script Generation
Defect and Anomaly Detection
AI Model Evaluation and Validation
Ethical and Legal Considerations
Integration with Test Tools and Frameworks
Human Oversight and Collaboration
Challenges and Limitations

Questions 31–35

31foundation · easy
How can generative AI be used to produce automated test scripts?
Select an answer first
32application · medium
A team uses a generative AI model to generate test cases from requirements. They want to measure how well the model covers the requirements. Which metric is most appropriate?
Select an answer first
33expert · hard
A team uses a generative AI model to generate automated test scripts from API specifications. The generated scripts pass in the local environment but fail in the CI environment due to different base URLs and authentication tokens. What is the best way to handle this?
Select an answer first
34expert · hard
A test team wants to use a generative AI service to generate test data for a global application. The service is hosted in a country with different data protection laws than the company's headquarters. The data includes personal information of users from multiple countries. What is the most important consideration?
Select an answer first
35foundation · easy
What is the primary role of a human tester when working with generative AI?
Select an answer first

Finished these 5 questions?

Review the revealed explanations, or continue through the curriculum.

Next 5 questions →Back to CT-GENAI

Free Basic Practice is a study aid with revealable answers — not a scored exam. Examers.io is independent and not affiliated with or endorsed by ISTQB. “CT-GENAI” is a trademark of its owner, used for identification only.