Hands-On Exercise: Metamorphic Testing CT-AI Practice Questions (Page 1)

Questions 1–5

1. 1application · medium

   A team is testing an AI system that recommends movies based on user preferences. They have no way to know if a single recommendation is 'correct'. They decide to use metamorphic testing. Which of the following best describes why metamorphic testing is a suitable approach in this situation?

   • AIt is only applicable to classification systems, not recommendation systems.
   • BIt eliminates the need for any test cases by using the AI system itself as the oracle.
   • CIt allows testing without a test oracle by checking relations between outputs of related inputs.
   • DIt guarantees that all defects in the AI system will be found.
   Reveal Solution Discussion Select an answer first
2. 2expert · hard

   A team is testing an AI system that generates captions for images. They define a metamorphic relation: if the image is flipped horizontally, the generated caption should describe the same objects and actions, but the positions of objects may change (e.g., 'left' becomes 'right'). They have a source test case: an image of a cat on the left side of a sofa. The source caption is 'A cat sits on the left side of a sofa.' Which of the following is the correct follow-up test case?

   • AUse the same image but change the caption to 'A cat sits on the right side of a sofa.'
   • BGenerate a caption for the original image and manually change 'left' to 'right' in the caption.
   • CFlip the image horizontally and generate a caption for the flipped image.
   • DFlip the image vertically and generate a caption for the flipped image.
   Reveal Solution Discussion Select an answer first
4. 3foundation · easy

   Given a metamorphic relation that states 'if the input text is translated to another language and then back to the original, the output should be the same as the original input', what is the source test case?

   • AThe translated text.
   • BThe output of the translation system.
   • CThe original input text.
   • DThe back-translated text.
   Reveal Solution Discussion Select an answer first
5. 4application · medium

   A team is testing a chatbot that answers customer queries. They define a metamorphic relation: if a query is rephrased using synonyms, the chatbot's answer should be semantically equivalent. They have a source test case: 'What is the return policy?' The source output is 'You can return items within 30 days.' Which of the following is the correct follow-up test case?

   • A'What is the refund policy?'
   • B'How do I track my order?'
   • C'What is the return policy?' (repeated exactly)
   • D'What is the return policy for electronics?'
   Reveal Solution Discussion Select an answer first
6. 5foundation · easy

   How is the result of a metamorphic test determined?

   • ABy checking if the follow-up output is different from the source output.
   • BBy verifying that the system does not crash during execution.
   • CBy checking whether the outputs of the source and follow-up test cases satisfy the metamorphic relation.
   • DBy comparing the outputs to a pre-defined expected output.
   Reveal Solution Discussion Select an answer first