Testing Techniques for AI Solutions AAIA Practice Questions (Page 6)

Questions 26–30

1. 26application · medium

   A healthcare provider has deployed an AI system that triages patient messages and routes them to the appropriate department. The operations team is planning the testing phase. They need to verify that the system correctly interprets message intent and that the routing integrates with the existing patient management system. Which testing activity best addresses these requirements?

   • AReview the model's feature importance scores to understand which words influence routing decisions.
   • BDocument the test cases and results in a test report for the compliance team.
   • CExecute a set of predefined patient messages and compare the system's routing decisions against expected department assignments.
   • DMeasure the system's response time when handling a large volume of messages during peak hours.
   Reveal Solution Discussion Select an answer first
2. 27foundation · easy

   Which of the following scenarios is most relevant to robustness testing?

   • AFeeding the model inputs with missing values or out-of-range data to see if it crashes
   • BChecking that the model's output matches expected results for normal inputs
   • CMeasuring the model's response time when 10,000 users access it simultaneously
   • DReviewing the model's decision explanations for a sample of cases
   Reveal Solution Discussion Select an answer first
4. 28foundation · easy

   Which of the following is an example of a security threat that security testing aims to mitigate?

   • AData poisoning, where an attacker injects malicious data into the training set
   • BHigh latency, where the model takes too long to respond
   • CModel overfitting, where the model performs well on training data but poorly on new data
   • DBias in model outputs across demographic groups
   Reveal Solution Discussion Select an answer first
5. 29application · medium

   A logistics company has deployed an AI system that optimizes delivery routes. The system is integrated with the company's fleet management software. After a recent update, the company wants to ensure that the system still produces valid routes and that the integration with the fleet software still works. Which testing activity should they perform?

   • AConduct performance testing to measure how fast routes are generated.
   • BPerform bias testing to ensure routes are fair across different neighborhoods.
   • CReview the model's training data to ensure it is up to date.
   • DRun a set of functional test cases to verify route outputs and then perform integration testing with the fleet software.
   Reveal Solution Discussion Select an answer first
6. 30foundation · easy

   Why is documentation and reporting of test results important for AI solutions?

   • ATo support governance and compliance by providing a clear and auditable record of testing activities
   • BTo guarantee that the model is free of defects
   • CTo increase the speed of model training
   • DTo replace the need for ongoing monitoring
   Reveal Solution Discussion Select an answer first