A data science team needs to run a suite of model tests every time a new version of the model is deployed. They want to ensure that the tests are executed in the same environment, with the same data, and that results are automatically logged for comparison. Which approach best meets these requirements?

Run tests manually on a developer's laptop and record observations in a document.

Use a random sample of data each time to test the model's robustness.

Use a containerized test harness that runs in a CI/CD pipeline and stores results in a structured format.

Create a script that runs the tests and saves results to a shared spreadsheet.

What is the main purpose of a test harness in model validation?

To replace the need for a validation dataset

To automate the execution of test cases and record results consistently

To visualize the model's decision boundaries

To tune the model's hyperparameters

Why is it important to document test results?

To replace the need for test execution

To provide a record for analysis and reporting

To increase the model's accuracy

After running a series of test cases, the team notices that the model's accuracy is high, but the recall for a specific class is very low. What should they do next to better understand the model's behavior?

Examine the confusion matrix to see where misclassifications occur.

Change the model's threshold without retesting.

Collect more data for that specific class and retest.

What is the primary purpose of creating tests for model validation?

To increase the size of the dataset

To improve the model's accuracy on the training data

To replace the need for cross-validation

To evaluate the model's performance on unseen data

CertNexusCertified Data Science Practitioner (CDSP)

Domain 5Objective 4

Test Creation CERTIFIED-DATA-SCIENCE-PRACTITIONER Practice Questions (Page 2)

Part of the 5.0 Testing models domain, which accounts for 4-7% of the CERTIFIED-DATA-SCIENCE-PRACTITIONER exam.

25questions here

5free pages

6concepts

4-7%of the exam

Questions 6–10

6application · medium
A data science team needs to run a suite of model tests every time a new version of the model is deployed. They want to ensure that the tests are executed in the same environment, with the same data, and that results are automatically logged for comparison. Which approach best meets these requirements?
Select an answer first
7foundation · easy
What is the main purpose of a test harness in model validation?
Select an answer first
8foundation · easy
Why is it important to document test results?
Select an answer first
9application · medium
After running a series of test cases, the team notices that the model's accuracy is high, but the recall for a specific class is very low. What should they do next to better understand the model's behavior?
Select an answer first
10foundation · easy
What is the primary purpose of creating tests for model validation?
Select an answer first

Finished these 5 questions?

Review the revealed explanations, or continue through the curriculum.

Next 5 questions →Back to CERTIFIED-DATA-SCIENCE-PRACTITIONER

Free Basic Practice is a study aid with revealable answers — not a scored exam. Examers.io is independent and not affiliated with or endorsed by CertNexus. “CERTIFIED-DATA-SCIENCE-PRACTITIONER” is a trademark of its owner, used for identification only.