Test Creation CERTIFIED-DATA-SCIENCE-PRACTITIONER Practice Questions (Page 1)

Questions 1–5

1. 1foundation · easy

   What should be included in the documentation of test results?

   • AThe model's training code
   • BThe names of the data scientists
   • CThe company's financial reports
   • DThe test data used and the performance metrics obtained
   Reveal Solution Discussion Select an answer first
2. 2foundation · easy

   What is the primary activity during the execution of tests on a model?

   • AWriting the test cases
   • BRunning the test cases and collecting performance metrics
   • CModifying the model's architecture
   • DCleaning the test data
   Reveal Solution Discussion Select an answer first
4. 3expert · hard

   A team is executing tests on a model and notices that the model's performance on the test set is much worse than on the training set. They suspect overfitting. What is the best way to confirm this?

   • ACompare the model's performance on the training set and a separate validation set.
   • BIncrease the size of the test set.
   • CUse a different performance metric.
   • DRetrain the model with more data.
   Reveal Solution Discussion Select an answer first
5. 4foundation · easy

   Which step is part of the test creation process for model validation?

   • ADefining the test data and expected outcomes
   • BDeploying the model to production
   • CTuning hyperparameters on the test set
   • DCollecting more training data
   Reveal Solution Discussion Select an answer first
6. 5application · medium

   A team is designing test cases for a model that predicts whether a loan applicant will default. They want to include cases where the applicant has missing income data, extreme debt-to-income ratios, and recent bankruptcy. What is the primary goal of including these cases?

   • ATo test the model's behavior on unusual but realistic scenarios.
   • BTo reduce the risk of data leakage.
   • CTo increase the size of the test set.
   • DTo ensure the test set is representative of the general population.
   Reveal Solution Discussion Select an answer first