Audit Evidence Collection Techniques AAIA Practice Questions (Page 4)

Questions 16–20

1. 16expert · hard

   An auditor is testing an AI system that approves insurance claims. The system processes 10,000 claims per day. The audit objective is to evaluate the accuracy of the system's claim approval decisions. The auditor has limited time and must complete the testing within two weeks. The auditor wants to use a sampling approach that provides a high level of confidence in the results. Which of the following is the most appropriate approach?

   • ASelect a haphazard sample of claims from the system's dashboard.
   • BUse statistical sampling with a sample size determined based on the desired confidence level and margin of error.
   • CTest all claims processed during a single day.
   • DSelect a judgmental sample of claims that the auditor believes are most likely to be incorrect.
   Reveal Solution Discussion Select an answer first
2. 17application · medium

   An auditor is testing an AI system that processes millions of transactions daily. The audit objective is to evaluate the accuracy of the system's fraud detection alerts. The auditor has limited time and resources. Which sampling method is most appropriate to obtain a representative sample of transactions for testing?

   • ABlock sampling, selecting a consecutive block of transactions from a specific time period.
   • BHaphazard sampling, selecting transactions that are easily accessible from the system's log files.
   • CStratified random sampling, grouping transactions by type and amount, then randomly selecting from each group.
   • DJudgmental sampling, selecting transactions that the auditor believes are most likely to be fraudulent.
   Reveal Solution Discussion Select an answer first
4. 18application · medium

   An auditor is extracting data from an AI system's log files for analysis. The logs contain timestamps in different formats (e.g., Unix epoch and ISO 8601). The auditor needs to standardize the timestamps to a single format for accurate analysis. Which of the following is the most appropriate approach?

   • AWrite a transformation script to parse each timestamp format and convert them to a common standard format.
   • BManually adjust the timestamps in the log files using a text editor.
   • CAsk the system administrator to provide the logs in a single format.
   • DIgnore the timestamp inconsistencies and proceed with the analysis.
   Reveal Solution Discussion Select an answer first
5. 19foundation · easy

   Why is it important to document the evidence collection process during an AI audit?

   • ATo replace the need for audit evidence retention.
   • BTo provide a clear record of what was done, enabling the audit to be reviewed and replicated.
   • CTo increase the speed of the audit.
   • DTo ensure that all evidence is collected automatically.
   Reveal Solution Discussion Select an answer first
6. 20application · medium

   An auditor is planning evidence collection for an AI system that predicts equipment failures in a manufacturing plant. The audit objective is to assess the accuracy of the predictions. The auditor has identified the system's logs, sensor data, and maintenance records as potential sources. Which of the following is the most appropriate next step in the evidence collection plan?

   • AInterview the maintenance staff to understand how they use the system's predictions.
   • BIdentify the stakeholders responsible for the system and the data sources, and document the scope of the evidence collection.
   • CReview the system's user manual to understand its features.
   • DBegin collecting data from the system's logs immediately to avoid delays.
   Reveal Solution Discussion Select an answer first