A team is building a facial recognition system. The training data is predominantly from one demographic group. The team is concerned about bias. Which technique should they use to validate the training data?

Analyze the distribution of demographic attributes in the dataset

Use adversarial testing to find model vulnerabilities

Use a large test set to measure overall accuracy

Apply metamorphic testing to verify consistency

A team is testing a predictive maintenance system for industrial equipment. The system uses a complex neural network. The team has access to the model's architecture and weights. They need to ensure the model is robust to sensor noise. Which testing approach is most appropriate?

Black-box testing with random noise injection

Metamorphic testing with sensor data transformations

Differential testing against a simpler model

White-box testing with gradient-based adversarial perturbation

Certified Tester AI Testing

Domain 9Objective 8

Selecting Test Techniques for AI-Based Systems CT-AI Practice Questions (Page 4)

Part of the Domain 9: Methods and Techniques for the Testing of AI-Based Systems domain, which makes up ~13% of our current practice bank. ISTQB does not publish an official question count, but from its 60-minute exam (~25–40 total, ~3–5 in this domain), expect 1–1 from this objective — we provide 31 practice questions to prepare you well beyond it. (estimate)

31questions here

7free pages

7concepts

Questions 16–20

16application · medium
A team is building a facial recognition system. The training data is predominantly from one demographic group. The team is concerned about bias. Which technique should they use to validate the training data?
Select an answer first
17application · easy
A team is evaluating a regression model that predicts house prices. They need to assess the model's performance and understand the magnitude of errors. Which evaluation technique is most appropriate?
Select an answer first
18expert · hard
A team is testing a predictive maintenance system for industrial equipment. The system uses a complex neural network. The team has access to the model's architecture and weights. They need to ensure the model is robust to sensor noise. Which testing approach is most appropriate?
Select an answer first
19foundation · easy
Which technique is appropriate for validating the quality of test data used for an AI system?
Select an answer first
20foundation · easy
Which test technique is particularly suited to AI systems that exhibit non-deterministic behavior?
Select an answer first

Finished these 5 questions?

Review the revealed explanations, or continue through the curriculum.

Next 5 questions →Back to CT-AI

Free Basic Practice is a study aid with revealable answers — not a scored exam. Examers.io is independent and not affiliated with or endorsed by ISTQB. “CT-AI” is a trademark of its owner, used for identification only.

Selecting Test Techniques for AI-Based Systems CT-AI Practice Questions (Page 4)

Questions 16–20

A team is building a facial recognition system. The training data is predominantly from one demographic group. The team is concerned about bias. Which technique should they use to validate the training data?

A team is evaluating a regression model that predicts house prices. They need to assess the model's performance and understand the magnitude of errors. Which evaluation technique is most appropriate?

A team is testing a predictive maintenance system for industrial equipment. The system uses a complex neural network. The team has access to the model's architecture and weights. They need to ensure the model is robust to sensor noise. Which testing approach is most appropriate?

Which technique is appropriate for validating the quality of test data used for an AI system?

Which test technique is particularly suited to AI systems that exhibit non-deterministic behavior?

Keep studying — Domain 9: Methods and Techniques for the Testing of AI-Based Systems