Manage AI/ML Model Training PMI-CPMAI Practice Questions (Page 3)

Questions 11–15

1. 11foundation · easy

   Which tool is commonly used for experiment tracking?

   • AMLflow
   • BDocker
   • CGit
   • DMicrosoft Excel
   Reveal Solution Discussion Select an answer first
2. 12foundation · easy

   What is the primary purpose of cross-validation?

   • ATo speed up model training
   • BTo increase the size of the training dataset
   • CTo obtain a reliable estimate of model performance
   • DTo reduce the number of features
   Reveal Solution Discussion Select an answer first
4. 13application · medium

   A team is planning a hyperparameter tuning campaign for a gradient boosting model. They have limited compute budget and need to explore a large hyperparameter space. Which approach should they use to maximize the chance of finding good hyperparameters within the budget?

   • ABayesian optimization, which uses past trial results to focus the search on promising hyperparameter regions.
   • BManual tuning based on the team's intuition, trying a few combinations.
   • CRandom search with a fixed number of trials, then select the best based on validation performance.
   • DGrid search over a coarse grid of all hyperparameters, using all available compute.
   Reveal Solution Discussion Select an answer first
5. 14expert · hard

   A team is developing a model to predict rare diseases. The dataset is highly imbalanced (1% positive cases). They are using stratified k-fold cross-validation to evaluate models. However, they notice that the F1-score varies significantly across folds. What is the most likely cause and what should they do?

   • AThe folds are not stratified properly; they should use a different random seed.
   • BThe dataset is too small, and the variance is due to the rarity of positive cases; they should use repeated stratified k-fold cross-validation and average the results.
   • CThey should use a single large holdout set instead of cross-validation to reduce variance.
   • DThey should use a different metric, such as AUC, which is less sensitive to class imbalance.
   Reveal Solution Discussion Select an answer first
6. 15foundation · easy

   A project manager is creating a training schedule for a new model. Which activity is part of training schedule planning?

   • AEstimating the duration of training runs
   • BCollecting raw data from sources
   • CSelecting the model architecture
   • DDeploying the trained model to production
   Reveal Solution Discussion Select an answer first