Test Objectives and Acceptance Criteria CT-AI Practice Questions (Page 5)

Questions 21–25

1. 21foundation · easy

   Which statement best defines a test objective for an AI-based system?

   • AA list of all possible inputs and expected outputs for the AI system
   • BA summary of the defects found during the testing phase
   • CA clear, measurable goal that specifies what the testing effort intends to achieve for the AI system
   • DA detailed step-by-step procedure for executing a specific test case
   Reveal Solution Discussion Select an answer first
2. 22foundation · easy

   Which acceptance criterion is the most testable for an AI system?

   • AThe system should have high precision and recall
   • BThe system should perform well on the test set
   • CThe system should achieve a precision of at least 0.90 and a recall of at least 0.85 on the test set
   • DThe system should be reliable and accurate
   Reveal Solution Discussion Select an answer first
4. 23application · medium

   A logistics company is implementing an AI system to predict delivery delays. A non-functional requirement states: 'The system must provide predictions quickly enough to be useful for dispatchers.' The test lead must derive acceptance criteria from this requirement. Which acceptance criterion is most appropriate?

   • AThe system shall be fast enough that dispatchers do not complain about delays.
   • BThe system shall return a prediction within 2 seconds for 95% of requests when tested with a simulated load of 100 concurrent users.
   • CThe system shall use a lightweight model to ensure quick predictions.
   • DThe system shall predict delays with at least 90% accuracy.
   Reveal Solution Discussion Select an answer first
5. 24foundation · easy

   Which of the following is an example of a well-defined test objective for an AI system?

   • ATest the system thoroughly to ensure it is reliable
   • BCheck that the model does not make any mistakes
   • CVerify that the model performs well on the test data
   • DConfirm that the model's accuracy on the validation set is at least 95%
   Reveal Solution Discussion Select an answer first
6. 25expert · hard

   A team is evaluating the testability of an acceptance criterion for an AI system that recommends job candidates. The criterion states: 'The system shall recommend candidates who are a good fit for the company culture.' Why is this criterion difficult to test?

   • AThe system's recommendations are based on a neural network.
   • BThe system's training data is not publicly available.
   • CThe system does not have access to the company's internal culture documents.
   • DThe concept of 'good fit' is subjective and not objectively measurable.
   Reveal Solution Discussion Select an answer first