Design Use Cases CERTIFIED-DATA-SCIENCE-PRACTITIONER Practice Questions (Page 5)

Questions 21–25

1. 21foundation · easy

   A data science team has developed a churn prediction model and is about to deploy it to production. Which scenario most directly requires model testing before deployment?

   • AThe team needs to decide which programming language to use for the model's implementation.
   • BThe team wants to document the model's architecture for the project's technical report.
   • CThe team wants to estimate the cost of cloud resources needed for running the model in production.
   • DThe model's training accuracy was high, but the team needs to confirm it performs well on unseen data and meets business expectations.
   Reveal Solution Discussion Select an answer first
2. 22expert · hard

   An insurance company is testing a model to predict claim fraud. They want to minimize the cost of investigating false claims while not missing actual fraud. The cost of a false positive is $50 (investigation cost), and the cost of a false negative is $500 (fraud loss). Which success criterion best reflects this cost asymmetry?

   • AMaximize precision
   • BMaximize recall
   • CMinimize the total cost, calculated as 50 × false positives + 500 × false negatives
   • DMaximize accuracy
   Reveal Solution Discussion Select an answer first
4. 23expert · hard

   A pharmaceutical company is testing a model that predicts drug side effects. They have a very small dataset of 500 patients and need to ensure the model is reliable before clinical trials. Which testing method is most appropriate?

   • AA/B testing on patients
   • BLeave-one-out cross-validation (LOOCV)
   • CBootstrap with replacement
   • DSimple holdout with 50% test split
   Reveal Solution Discussion Select an answer first
5. 24foundation · easy

   A team is designing test cases for a spam detection model. Which test case best represents an adversarial condition?

   • AAn email that is exactly the same as one in the training data
   • BAn email with a very large attachment
   • CAn email with a standard subject line and normal body text
   • DAn email that deliberately uses misspellings and unusual characters to evade detection
   Reveal Solution Discussion Select an answer first
6. 25application · medium

   A marketing team is deploying a model to predict customer response to a campaign. They need to define success criteria that align with business goals. Which success criterion is most appropriate?

   • AThe model runs in under 100 milliseconds
   • BThe model achieves an AUC of at least 0.85 on the validation set
   • CThe model uses at least 50 features
   • DThe model is interpretable by the marketing team
   Reveal Solution Discussion Select an answer first