Oversee AI/ML Model QA/QC (e.g., Configuration Management, Model Performance) PMI-CPMAI Practice Questions (Page 2)

Questions 6–10

1. 6expert · hard

   A model is being developed for a credit scoring application. The team has a testing protocol that requires the model to be evaluated on a fixed test set. During development, the team notices that the model's performance on the test set has improved, but the performance on a newly collected validation set has degraded. What is the most likely cause?

   • AThe validation set is not representative of the test set
   • BThe test set has changed since the last evaluation
   • CThe model is underfitting and needs more training
   • DThe model is overfitting to the test set because it was used for tuning
   Reveal Solution Discussion Select an answer first
2. 7foundation · easy

   Which element is typically included in a model testing protocol?

   • AThe names of all stakeholders who will review the final model
   • BThe model's hyperparameter tuning history
   • CThe specific pass/fail criteria for each test case
   • DThe business justification for deploying the model
   Reveal Solution Discussion Select an answer first
4. 8foundation · easy

   What is the main goal of establishing quality assurance (QA) procedures for AI/ML models?

   • ATo ensure the model meets quality standards through data validation, model validation, and reproducibility checks
   • BTo reduce the cost of training the model
   • CTo document the model's business requirements
   • DTo automate the deployment of the model to production
   Reveal Solution Discussion Select an answer first
5. 9foundation · easy

   What is a key benefit of applying best practices throughout the model lifecycle?

   • AGuaranteed higher model accuracy
   • BElimination of all model biases
   • CAutomatic deployment to production
   • DImproved reproducibility and easier maintenance of models
   Reveal Solution Discussion Select an answer first
6. 10foundation · easy

   What is the main purpose of conducting peer reviews of model designs, code, and results?

   • ATo document the model's business case for stakeholders
   • BTo assign ownership of the model to a specific developer
   • CTo automate the model's deployment pipeline
   • DTo catch errors and ensure technical soundness through independent review
   Reveal Solution Discussion Select an answer first