Retrieval-Augmented Generation CT-GENAI Practice Questions (Page 1)

Questions 1–5

1. 1foundation · easy

   When evaluating a RAG system used for test analysis, what does 'generation relevance' measure?

   • AHow many documents were retrieved
   • BHow many tokens the LLM uses in the response
   • CHow fast the LLM generates the response
   • DHow well the LLM's output addresses the user's query using the retrieved context
   Reveal Solution Discussion Select an answer first
2. 2foundation · easy

   Which metric is commonly used to measure the retrieval accuracy of a RAG system?

   • AF1 score
   • BRecall@k
   • CPerplexity
   • DBLEU score
   Reveal Solution Discussion Select an answer first
4. 3application · medium

   A team evaluates their RAG system for test case generation. They want to measure how often the generated test cases are actually relevant to the user's query. Which metric is most appropriate?

   • ALatency
   • BChunk size
   • CRetrieval precision
   • DGeneration relevance
   Reveal Solution Discussion Select an answer first
5. 4foundation · easy

   When constructing a prompt that includes retrieved context for test generation, what is a key best practice?

   • AInclude as much retrieved context as possible without any filtering
   • BClearly instruct the LLM to use only the provided context when generating the test case
   • CPlace the retrieved context after the question to avoid distraction
   • DOmit the retrieved context and rely on the model's training data
   Reveal Solution Discussion Select an answer first
6. 5expert · hard

   A team is building a RAG system for test case retrieval. They have a mix of exact test case IDs and natural language descriptions. They want to ensure that users can find test cases by either method. Which retrieval approach is best?

   • ABoolean search only
   • BVector search only
   • CKeyword search only
   • DHybrid search with keyword and vector components
   Reveal Solution Discussion Select an answer first