AI Audit Outputs and Reports AAIA Practice Questions (Page 3)

Questions 11–15

1. 11application · medium

   An AI audit of a predictive maintenance model found that the model performs well overall, but its accuracy varies across different equipment types. The audit team is preparing the report for plant managers who are not data scientists. Which approach best communicates this finding?

   • AState that the model is generally accurate and omit the variation to avoid confusion.
   • BDescribe in plain language that the model is less reliable for certain equipment, and suggest focusing manual inspections on those types.
   • CProvide a detailed explanation of the model's algorithm and training data to justify the variation.
   • DInclude a table of precision and recall metrics for each equipment type, with technical footnotes.
   Reveal Solution Discussion Select an answer first
2. 12expert · hard

   An AI auditor is documenting workpapers for a complex model validation. The auditor used a combination of automated tests and manual review, and some tests were rerun after fixing data issues. The auditor is concerned about the clarity and reviewability of the workpapers. Which approach best ensures the workpapers are clear and support the final report?

   • ADocument only the final test results and conclusions, as earlier versions are no longer relevant.
   • BCreate a summary document that lists each test, its purpose, the date, the results, and how it relates to the final conclusions.
   • CStore the workpapers in a shared drive with a naming convention that indicates the date and test name, but without a summary.
   • DInclude all raw data and test outputs in the workpapers without any summary or explanation.
   Reveal Solution Discussion Select an answer first
4. 13application · medium

   An AI audit report includes a finding that a model's predictions are not explainable, which could hinder regulatory compliance. The audit team is reviewing the report for quality. Which check is most important to ensure the finding is presented effectively?

   • AConfirm that the finding includes the exact algorithm used by the model.
   • BEnsure that the finding is placed in the appendix rather than the main body to avoid alarming readers.
   • CCheck that the finding uses technical jargon to demonstrate the auditor's expertise.
   • DVerify that the finding clearly explains the regulatory risk and the potential consequences of non-compliance.
   Reveal Solution Discussion Select an answer first
5. 14application · medium

   An AI auditor is documenting workpapers for a model validation audit. The auditor ran several tests, including data quality checks and model performance metrics, and some tests were repeated after receiving corrected data. Which practice best ensures the workpapers are reviewable and support the final report?

   • ARecord the test objectives, the exact procedures performed, the data used, the results, and the date of each test, including reruns.
   • BStore all raw data and test scripts in a separate folder without linking them to specific findings.
   • CInclude only the final test results and conclusions, as earlier versions are superseded.
   • DSummarize the tests in a narrative paragraph in the workpaper, without detailed logs or outputs.
   Reveal Solution Discussion Select an answer first
6. 15foundation · easy

   What is the primary purpose of documenting evidence and testing procedures in audit workpapers?

   • ATo store only the final conclusions without supporting evidence
   • BTo replace the need for a final audit report
   • CTo provide a detailed record that supports the audit report and is reviewable by others
   • DTo serve as a marketing document for the audit team
   Reveal Solution Discussion Select an answer first