Hands-On Exercise: Metamorphic Testing CT-AI Practice Questions (Page 3)

Questions 11–15

1. 11foundation · easy

   What is the primary action when executing metamorphic test cases on an AI system?

   • ARun the follow-up test case first, then the source test case.
   • BOnly run the source test case and predict the follow-up output.
   • CRun the test cases only if the system is in a specific state.
   • DRun the source and follow-up test cases through the system and record their outputs.
   Reveal Solution Discussion Select an answer first
2. 12application · medium

   A team is testing a medical diagnosis AI that predicts the risk of a disease (low, medium, high). They define a metamorphic relation: if a patient's age is increased by 10 years (all else unchanged), the risk should not decrease. They run several source and follow-up test cases. In one case, the source output is 'high' and the follow-up output is 'medium'. In another case, the source output is 'low' and the follow-up output is 'low'. What is the most appropriate interpretation of these results?

   • AThe results are inconclusive because the relation is not well-defined for categorical outputs.
   • BBoth cases violate the relation because the risk should always increase with age.
   • CThe first case violates the relation and indicates a potential defect; the second case satisfies the relation and provides no evidence of a defect.
   • DBoth cases satisfy the relation because the risk did not increase in either case.
   Reveal Solution Discussion Select an answer first
4. 13foundation · easy

   After executing a source test case and a follow-up test case, what should the tester do with the outputs?

   • AImmediately mark the test as passed if the outputs are different.
   • BDiscard them if they seem incorrect.
   • CRecord them for later comparison against the metamorphic relation.
   • DUse them to modify the metamorphic relation.
   Reveal Solution Discussion Select an answer first
5. 14expert · hard

   A team is testing an AI system that translates legal documents from English to German. They want to use metamorphic testing to check for consistency. They define a relation: translating a document and then translating it back to English should produce a document that is semantically equivalent to the original. However, they find that this relation often fails even when the system is working correctly. What is the most likely reason for this?

   • AThe team should use a different source language because German is not suitable for metamorphic testing.
   • BThe team is not executing the test cases correctly because they should only translate in one direction.
   • CThe relation is not suitable for legal documents because translations may not be perfectly reversible due to language differences.
   • DThe relation is too weak because it does not require the translated document to be identical to the original.
   Reveal Solution Discussion Select an answer first
6. 15foundation · easy

   If a metamorphic relation states that the output should be the same for source and follow-up inputs, and the outputs are different, what is the result?

   • AThe test passes because the system produced an output.
   • BThe test fails because the relation is not satisfied.
   • CThe test passes because the outputs are different.
   • DThe test is inconclusive because the relation is not clear.
   Reveal Solution Discussion Select an answer first