Define Success Criteria for Test CERTIFIED-DATA-SCIENCE-PRACTITIONER Practice Questions (Page 1)

Questions 1–5

1. 1foundation · medium

   Which of the following is a business-specific success criterion for a model that predicts customer churn?

   • AThe model must be retrained monthly.
   • BThe model must use at least 20 features.
   • CThe model must reduce customer churn by at least 5% within six months.
   • DThe model's precision must be at least 0.90.
   Reveal Solution Discussion Select an answer first
2. 2application · medium

   A credit card company is developing a fraud detection model. The cost of a false negative (missing a fraudulent transaction) is much higher than the cost of a false positive (blocking a legitimate transaction). The business wants to minimize the total financial loss. Which success criterion should be the primary focus during model testing?

   • AMaximize recall
   • BMaximize precision
   • CMaximize accuracy
   • DMaximize F1-score
   Reveal Solution Discussion Select an answer first
4. 3foundation · medium

   Which of the following is an example of a benchmark for a success criterion?

   • AThe model's recall should be at least 0.90.
   • BThe model should use a random forest algorithm.
   • CThe model should be trained on at least 10,000 samples.
   • DThe model should be deployed to production.
   Reveal Solution Discussion Select an answer first
5. 4application · medium

   An e-commerce company wants to build a recommendation system. The business goal is to increase revenue per user. The data science team is considering two metrics: click-through rate (CTR) and conversion rate. Which success criterion is more aligned with the business objective?

   • AMaximize conversion rate
   • BMaximize CTR
   • CMaximize both CTR and conversion rate equally
   • DMaximize the number of recommendations shown
   Reveal Solution Discussion Select an answer first
6. 5application · medium

   A team is building a binary classification model to identify defective products on a manufacturing line. The business has set a target that at least 95% of actual defects must be caught (recall ≥ 0.95). The team is testing the model and finds that at the current threshold, recall is 0.93. What should the team do to meet the success criterion?

   • AAccept the current recall as sufficient
   • BRaise the classification threshold to increase recall
   • CChange the success criterion to precision ≥ 0.95
   • DLower the classification threshold to increase recall
   Reveal Solution Discussion Select an answer first