Specialized Testing Considerations CT-AI Practice Questions (Page 5)

Questions 21–25

1. 21foundation · easy

   Which of the following is an example of applying a standard documentation format for an AI component?

   • AUsing a model card template to describe the model's intended use, limitations, and performance.
   • BWriting a free-form essay about the AI component's history.
   • CStoring documentation in a personal notebook.
   • DDocumenting only the final accuracy of the model.
   Reveal Solution Discussion Select an answer first
2. 22application · medium

   A weather forecasting AI system has been in production for a year. The test team wants to detect if concept drift is occurring. Which method would be most effective for detecting concept drift?

   • ACheck the model's training loss to see if it has increased over time.
   • BCompare the distribution of input features between the training data and the current production data.
   • CReview the model's source code for any changes made by the development team.
   • DMonitor the model's prediction accuracy against actual outcomes over time using a sliding window.
   Reveal Solution Discussion Select an answer first
4. 23application · medium

   An AI system that recommends news articles has been in production for six months. The test team detects concept drift because user preferences have changed. To maintain the system's accuracy, which combination of actions is most appropriate?

   • AStop the system and manually review all recommendations.
   • BRetrain the model on recent user interaction data and update the test suite with new test cases based on recent data.
   • CKeep the current model and increase the number of recommendations shown to users.
   • DRevert to a previous version of the model that performed well in the past.
   Reveal Solution Discussion Select an answer first
5. 24application · medium

   A software company is integrating an AI-based recommendation engine into its e-commerce platform. The test team needs to document the AI component in a standardized format to ensure consistency across projects. Which approach best supports this requirement?

   • ADocument the AI component in the same format as the rest of the software, using standard code comments.
   • BUse a free-form document that allows each developer to describe the AI component in their own words.
   • CCreate a company-wide template that includes sections for data description, model details, performance metrics, and known limitations.
   • DRely on the AI model's built-in documentation features, if any, without additional effort.
   Reveal Solution Discussion Select an answer first
6. 25foundation · easy

   How should test cases be updated in response to concept drift?

   • ABy only adding test cases that are easy to pass.
   • BBy keeping all test cases unchanged to ensure consistency.
   • CBy adding new test cases that reflect the current concept and removing obsolete ones.
   • DBy deleting all test cases and starting from scratch.
   Reveal Solution Discussion Select an answer first