Test Environments for AI-Based Systems CT-AI Practice Questions (Page 3)

Questions 11–15

1. 11expert · hard

   A company wants to automate the deployment of a new model version to a test environment whenever a new model is registered in the model registry. The test environment should automatically run a suite of tests and report the results. What is the best way to implement this?

   • AConfigure a CI/CD pipeline that triggers on new model registry entries, deploys the model to the test environment, runs tests, and reports results.
   • BUse a cron job that periodically checks for new models and deploys them.
   • CManually deploy the model and run tests after each registration.
   • DDeploy the model directly to production and run tests there.
   Reveal Solution Discussion Select an answer first
2. 12foundation · easy

   What is the role of a model registry in an AI test environment?

   • ATo store and manage versions of trained models
   • BTo monitor system performance in real time
   • CTo provide a user interface for testers
   • DTo generate synthetic test data
   Reveal Solution Discussion Select an answer first
4. 13foundation · easy

   Why might synthetic data be used in AI testing?

   • ATo replace the need for validation data
   • BTo increase the complexity of the test environment
   • CTo create additional test cases when real data is scarce or sensitive
   • DTo automatically fix model bugs
   Reveal Solution Discussion Select an answer first
5. 14foundation · easy

   How does continuous integration benefit AI model development?

   • ABy eliminating the need for test data
   • BBy automatically building and testing the model whenever code changes are made
   • CBy reducing the need for model monitoring
   • DBy manually deploying the model to production
   Reveal Solution Discussion Select an answer first
6. 15foundation · easy

   Which of the following is a key security consideration for an AI test environment?

   • ADisabling all logging to protect privacy
   • BEnsuring the test environment is publicly accessible
   • CControlling access to sensitive data and models
   • DUsing the same credentials as production
   Reveal Solution Discussion Select an answer first