Supervision of AI Solutions (e.g., Outputs, Impacts, and Decisions) AAIA Practice Questions (Page 3)

Questions 11–15

1. 11expert · hard

   A telecommunications company uses an AI system to detect fraudulent calls. The system was trained on historical call data. After a major network upgrade, the system's false positive rate increases significantly, causing legitimate calls to be blocked. The AI operations team must respond. Which approach best addresses the issue while minimizing customer impact?

   • AIncrease the system's fraud detection threshold to block more calls, assuming the network upgrade has increased fraud.
   • BTemporarily disable the fraud detection system and rely on manual review of flagged calls.
   • CImmediately lower the system's fraud detection threshold to reduce the number of blocked calls.
   • DInvestigate the root cause of the increased false positives, then retrain the model with data that reflects the network upgrade.
   Reveal Solution Discussion Select an answer first
2. 12foundation · easy

   What is the purpose of a feedback loop in AI monitoring?

   • ATo continuously improve the AI model based on detected anomalies and outcomes
   • BTo replace the AI model with a human decision-maker
   • CTo ensure the AI model is never changed after deployment
   • DTo increase the frequency of model retraining without any data
   Reveal Solution Discussion Select an answer first
4. 13foundation · easy

   What is the primary purpose of decision oversight in AI systems?

   • ATo ensure AI-driven decisions align with organizational policies and ethical standards
   • BTo maximize the speed of AI decision-making
   • CTo automate all decision-making processes without human intervention
   • DTo reduce the number of decisions made by AI
   Reveal Solution Discussion Select an answer first
5. 14application · medium

   An online retailer uses an AI system to generate personalized product recommendations. The system occasionally recommends products that are out of stock, leading to customer dissatisfaction. The company wants to implement a feedback mechanism to detect and correct this issue. Which mechanism is most effective?

   • ARetrain the model weekly with the latest inventory data to prevent out-of-stock recommendations.
   • BImplement an automated check that cross-references recommended products with current inventory levels.
   • CRely on customers to report when they see an out-of-stock recommendation.
   • DConduct a weekly manual review of the most popular recommendations.
   Reveal Solution Discussion Select an answer first
6. 15foundation · easy

   Which of the following is an example of monitoring AI outputs for completeness?

   • AChecking that the output contains all required fields and records
   • BEnsuring the output is generated within the expected time frame
   • CConfirming that the output is stored in the correct folder
   • DVerifying that the output is formatted in a readable font
   Reveal Solution Discussion Select an answer first