Identify Hallucinations, Reasoning Errors and Biases in LLM Output CT-GENAI Practice Questions (Page 2)

Questions 6–10

1. 6application · medium

   An LLM is asked to generate a test case for a login function. It outputs: 'Enter valid credentials and click Login. The system should display an error message if the password is incorrect.' The team notices the output is logically sound but omits the expected behavior for a locked account. How should this output be classified?

   • AReasoning error
   • BContextual hallucination
   • CFactual hallucination
   • DCorrect response with incomplete coverage
   Reveal Solution Discussion Select an answer first
2. 7foundation · easy

   Why is it important to recognize biases in LLM outputs when using them for software testing?

   • ABiased outputs are always harder to read.
   • BBiased outputs can lead to unfair or incomplete test coverage.
   • CBiased outputs are faster to generate.
   • DBiased outputs are more likely to contain syntax errors.
   Reveal Solution Discussion Select an answer first
4. 8foundation · easy

   Which of the following is an example of gender bias in an LLM output?

   • AThe model provides accurate information about both men and women.
   • BThe model avoids mentioning gender altogether.
   • CThe model uses gender-neutral language.
   • DThe model consistently associates nursing with women and engineering with men.
   Reveal Solution Discussion Select an answer first
5. 9application · medium

   An LLM is used to generate test oracles for a sorting algorithm. The LLM outputs: 'If the input array is [3,1,2], the expected output is [1,2,3].' The team verifies this is correct. However, the LLM also states: 'If the input array is [5,4,3], the expected output is [3,4,5] because the algorithm uses a stable sort.' The algorithm is actually an unstable sort. How should the second statement be classified?

   • AFactual hallucination
   • BCorrect response
   • CReasoning error
   • DContextual hallucination
   Reveal Solution Discussion Select an answer first
6. 10foundation · easy

   Which type of hallucination occurs when an LLM produces a statement that contradicts the information provided in the prompt?

   • ASemantic hallucination
   • BFactual hallucination
   • CContextual hallucination
   • DLogical hallucination
   Reveal Solution Discussion Select an answer first