Objective 3.4 Evaluate the Model AIP-210 Practice Questions (Page 4)

Questions 16–20

1. 16application · medium

   A binary classifier is evaluated on a test set. The ROC curve is plotted, and the AUC is calculated. Which statement about the AUC is correct?

   • AAUC of 0.5 indicates the model performs no better than random chance
   • BAUC is only applicable to multi-class problems
   • CAUC is calculated from the confusion matrix directly
   • DAUC of 1.0 indicates the model is always correct on every sample
   Reveal Solution Discussion Select an answer first
2. 17foundation · easy

   A fraud detection model has a recall of 0.95 but a precision of 0.20. What is the most likely business impact of deploying this model?

   • AThe model will automatically block all transactions
   • BA large number of legitimate transactions will be flagged for review, increasing operational costs
   • CThe model will have no impact on business operations
   • DMany fraudulent transactions will be missed
   Reveal Solution Discussion Select an answer first
4. 18foundation · easy

   What does a residual represent in regression analysis?

   • AThe difference between the actual value and the predicted value
   • BThe average of the actual values
   • CThe slope of the regression line
   • DThe correlation between the independent and dependent variables
   Reveal Solution Discussion Select an answer first
5. 19application · medium

   A team is comparing two models for a regression task. Model A has high bias and low variance; Model B has low bias and high variance. Which model is more likely to underfit the training data, and what is the tradeoff?

   • AModel B; it will have low variance and high bias
   • BModel A; it may not capture complex patterns, leading to poor training performance
   • CModel B; it may overfit and perform poorly on unseen data
   • DModel A; it will have high variance and low bias
   Reveal Solution Discussion Select an answer first
6. 20foundation · easy

   In a ROC curve, what does the x-axis represent?

   • AThreshold value
   • BTrue positive rate (recall)
   • CPrecision
   • DFalse positive rate
   Reveal Solution Discussion Select an answer first