Task 2.3: Analyze Model Performance MLA-C01 Practice Questions (Page 8)

Questions 36–39

1. 36foundation · easy

   Which AWS service allows you to monitor tensors and system metrics during training to debug issues like vanishing gradients?

   • AAmazon CloudWatch
   • BAmazon SageMaker Clarify
   • CAmazon SageMaker Debugger
   • DAWS X-Ray
   Reveal Solution Discussion Select an answer first
2. 37application · medium

   A marketing team is building a model to identify customers who are likely to churn. The cost of a false positive (offering a discount to a customer who would not churn) is $10. The cost of a false negative (missing a customer who will churn) is $100. The churn rate in the customer base is 5%. The team has trained a model and obtained the following confusion matrix on a test set of 10,000 customers: Predicted churn: 600 (400 actual churn, 200 actual no-churn). Predicted no-churn: 9,400 (100 actual churn, 9,300 actual no-churn). What is the total cost of the model's errors on this test set?

   • A$2,000
   • B$12,000
   • C$60,000
   • D$10,000
   Reveal Solution Discussion Select an answer first
4. 38foundation · easy

   What is a key practice for ensuring reproducibility in machine learning experiments?

   • AUsing different data splits for each run
   • BUsing random seeds for data splitting and model initialization
   • CUsing a fixed learning rate but varying the optimizer
   • DNot recording hyperparameters
   Reveal Solution Discussion Select an answer first
5. 39application · medium

   A medical diagnostics team is evaluating a binary classifier that detects a specific disease. The test set contains 1,000 patients, of which 100 have the disease. The model's confusion matrix is: True Positives: 80, False Negatives: 20, False Positives: 50, True Negatives: 850. The team needs to report the model's precision and recall to the medical board. What are the precision and recall values?

   • APrecision = 80/850 = 9.4%, Recall = 80/100 = 80%
   • BPrecision = 80/130 = 61.5%, Recall = 80/100 = 80%
   • CPrecision = 80/100 = 80%, Recall = 80/20 = 400%
   • DPrecision = 80/100 = 80%, Recall = 80/130 = 61.5%
   Reveal Solution Discussion Select an answer first