Specialized Testing Considerations CT-AI Practice Questions (Page 1)

Questions 1–5

1. 1foundation · easy

   Which approach is appropriate for testing the impact of concept drift on an AI system?

   • AUsing historical data from a period when the concept was different to evaluate the current model.
   • BRemoving all test data to avoid confusion.
   • CTesting the model only with data from the current time period.
   • DUsing only synthetic data generated from the original training distribution.
   Reveal Solution Discussion Select an answer first
2. 2foundation · easy

   Which statement best defines automation bias in the context of AI-based systems?

   • AThe tendency of testers to rely on automated testing tools more than manual testing.
   • BThe tendency of humans to favor outputs from automated or AI systems over contradictory information from other sources.
   • CThe tendency of automated systems to fail when they encounter inputs outside their training distribution.
   • DThe tendency of AI models to favor certain classes of data over others during training.
   Reveal Solution Discussion Select an answer first
4. 3application · medium

   A team is working on an AI system for natural language processing. They need to document the model in a way that is consistent with industry best practices. Which documentation format is most widely recognized for this purpose?

   • AModel card, which provides a structured summary of the model's intended use, performance, and limitations.
   • BA PDF report generated at the end of the project.
   • CA wiki page that team members can edit freely.
   • DA README file in the repository that describes the model in prose.
   Reveal Solution Discussion Select an answer first
5. 4foundation · easy

   Why is documentation important for the maintenance of AI components?

   • AIt guarantees the model will never fail.
   • BIt makes the model more accurate automatically.
   • CIt provides the information needed to understand and update the model when the environment changes.
   • DIt eliminates the need for retraining the model.
   Reveal Solution Discussion Select an answer first
6. 5foundation · easy

   Which method is commonly used to detect concept drift in an AI-based system?

   • AIncreasing the model's learning rate during training.
   • BMonitoring the model's prediction accuracy over time on a fixed validation set.
   • CReducing the number of features in the model.
   • DAdding more layers to the neural network.
   Reveal Solution Discussion Select an answer first