AI Audit Outputs and Reports AAIA Practice Questions (Page 1)

Questions 1–5

1. 1application · medium

   An AI audit of a credit-scoring model has identified a material finding: the model's performance degrades significantly for applicants under age 30, but the root cause is not yet fully determined. The audit team must present this to the board of directors, who are non-technical and focused on regulatory risk. Which approach best communicates the finding to the board?

   • ASummarize the finding in business terms, emphasize the potential regulatory and reputational impact, and state that a root-cause analysis is underway.
   • BProvide only the final recommendation and the remediation timeline, omitting the performance gap details to avoid alarming the board.
   • CInclude the full audit methodology and testing procedures in the board presentation to demonstrate audit rigor.
   • DPresent a detailed technical explanation of the model's feature importance and the statistical significance of the performance gap.
   Reveal Solution Discussion Select an answer first
2. 2application · medium

   Before issuing an AI audit report, the audit manager performs a quality review. The report includes a finding that a model's accuracy drops during peak usage periods. The manager notices that the report does not explain the potential impact on users or the likelihood of the issue occurring. Which quality aspect is most lacking?

   • AClarity of the finding's significance and risk
   • BCompleteness of the audit scope description
   • CAlignment with the audit objectives
   • DAccuracy of the data presented in the report
   Reveal Solution Discussion Select an answer first
4. 3application · medium

   An AI audit of a natural language processing tool found that the tool sometimes misinterprets user intent, leading to incorrect responses. The audit team is writing the report. Which approach best communicates this finding?

   • ADescribe the specific scenarios where misinterpretation occurs and recommend adding a fallback mechanism for uncertain cases.
   • BInclude a detailed technical analysis of the model's attention mechanisms to explain the misinterpretation.
   • CRecommend that the tool be used only for simple queries and avoid complex ones.
   • DState that the tool is generally reliable and mention the misinterpretation only as a minor issue.
   Reveal Solution Discussion Select an answer first
5. 4foundation · easy

   What is a key characteristic of an actionable recommendation in an AI audit report?

   • AIt focuses only on technical fixes without considering business context
   • BIt includes specific steps, responsible parties, and a timeline
   • CIt is generic and applies to any AI system
   • DIt is based on the auditor's personal preference
   Reveal Solution Discussion Select an answer first
6. 5expert · hard

   An AI audit report is being finalized, and the audit team is conducting a quality review. The report includes a finding that a model's predictions are not explainable, which could hinder regulatory compliance. The team is debating how to present the finding. Which approach best ensures the report is high quality?

   • APresent the finding as a minor issue, since the model's accuracy is high.
   • BInclude a detailed technical explanation of why the model is not explainable, with references to academic papers.
   • CClearly state the regulatory risk and the potential consequences, and recommend specific actions to improve explainability.
   • DRecommend that the model be replaced with a simpler, explainable model, regardless of performance trade-offs.
   Reveal Solution Discussion Select an answer first