Design Use Cases CERTIFIED-DATA-SCIENCE-PRACTITIONER Practice Questions (Page 3)

Questions 11–15

1. 11expert · hard

   A cybersecurity firm is testing an intrusion detection model. They need to ensure it detects known attack patterns, handles novel attacks, and does not generate excessive false alarms. Which test case design best meets these requirements?

   • AInclude only normal traffic
   • BInclude only synthetic novel attacks
   • CInclude only historical attack data
   • DInclude historical attack data, synthetic novel attacks, and normal traffic
   Reveal Solution Discussion Select an answer first
2. 12expert · hard

   A hospital has a dataset of 2,000 patient records and needs to test a model for predicting disease progression. The dataset is imbalanced, with only 10% positive cases. They need a reliable performance estimate and want to ensure the model generalizes well. Which testing approach is most appropriate?

   • ASimple holdout with a 70/30 split
   • BStratified k-fold cross-validation
   • CBootstrap sampling without replacement
   • DA/B testing on live patients
   Reveal Solution Discussion Select an answer first
4. 13application · medium

   A self-driving car company is testing a pedestrian detection model. They need to ensure it works in various weather conditions, at different times of day, and with pedestrians in unusual poses. Which test case design best covers these scenarios?

   • ATest cases with only pedestrians walking normally
   • BTest cases with clear daytime images only
   • CTest cases covering rain, fog, night, and unusual pedestrian poses
   • DTest cases with only high-resolution images
   Reveal Solution Discussion Select an answer first
5. 14application · medium

   A financial institution is testing a model that predicts loan default. They want to minimize the risk of approving high-risk borrowers. Which success criterion is most aligned with this goal?

   • AHigh overall accuracy
   • BLow false positive rate for the non-default class
   • CHigh precision for the default class
   • DHigh recall for the default class
   Reveal Solution Discussion Select an answer first
6. 15expert · hard

   A logistics company has developed a model to predict delivery delays. They plan to use it to proactively reroute shipments. Before deployment, they need to validate that the model's predictions are reliable enough to act on. They have historical data with known delays. Which combination of testing use case and method is most appropriate?

   • AUse case: ensure speed; method: A/B testing on live shipments
   • BUse case: ensure interpretability; method: holdout validation
   • CUse case: ensure reliability; method: cross-validation on historical data
   • DUse case: ensure compliance; method: bootstrap sampling
   Reveal Solution Discussion Select an answer first