Essential Skills and Knowledge for Testing with Generative AI CT-GENAI Practice Questions (Page 6)

Questions 26–30

1. 26expert · hard

   A test team uses a generative AI model to generate test scripts for a web application. The model's output is evaluated using a metric that measures how many generated scripts are syntactically valid. The team notices that the metric is high, but many scripts fail at runtime. What is the most likely issue with the evaluation?

   • AThe test environment is not configured correctly.
   • BThe metric is too strict and rejects valid scripts.
   • CThe model is overfitting to the training data.
   • DThe metric only measures syntactic validity, not functional correctness.
   Reveal Solution Discussion Select an answer first
2. 27expert · hard

   A test organization wants to use generative AI to automatically generate test cases from user stories. The team is concerned about the AI producing biased test cases that overlook certain user groups. What is the best way to mitigate this risk?

   • AUse a larger AI model that is less likely to be biased.
   • BAvoid using generative AI for test case generation to prevent bias.
   • CInclude diverse examples and personas in the prompt to guide the AI.
   • DUse the AI to generate test cases and then run them all, regardless of bias.
   Reveal Solution Discussion Select an answer first
4. 28foundation · easy

   What is a key ethical concern when using generative AI to create test data?

   • AThe generated data might inadvertently include sensitive information from the training data.
   • BThe generated data is always identical to production data.
   • CThe generated data is always too small to be useful.
   • DThe generated data is always free from bias.
   Reveal Solution Discussion Select an answer first
5. 29foundation · easy

   Which of the following is an example of integrating generative AI with an automation framework?

   • AUsing the AI to write documentation for the automation framework.
   • BReplacing the automation framework with a generative AI model that executes tests directly.
   • CUsing a plugin that generates Selenium test scripts from natural language descriptions.
   • DRunning the automation framework manually and then asking an AI to interpret the results.
   Reveal Solution Discussion Select an answer first
6. 30foundation · easy

   Which technique is commonly used by generative AI to create diverse test data?

   • AManually writing data entries in a spreadsheet.
   • BCopying and pasting records from the production database.
   • CRandomly generating characters without any reference to real data patterns.
   • DSampling from a learned probability distribution of the original data.
   Reveal Solution Discussion Select an answer first