Selecting LLMs/SLMs for Software Test Tasks CT-GENAI Practice Questions (Page 2)

Questions 6–10

1. 6expert · hard

   A testing team must choose between an LLM and an SLM for generating detailed test plans. The LLM produces higher-quality plans but costs $0.02 per call and takes 5 seconds. The SLM costs $0.001 per call and takes 1 second, but its plans require more manual review. The team runs 10,000 test plan generations per month. Manual review costs $50 per hour, and reviewing an LLM plan takes 10 minutes, while an SLM plan takes 30 minutes. Which model is more cost-effective considering total cost of ownership?

   • ASLM, because it has lower latency
   • BLLM, because it is faster per call
   • CSLM, because the per-call cost is lower
   • DLLM, because the higher quality reduces manual review time
   Reveal Solution Discussion Select an answer first
2. 7foundation · easy

   Which characteristic is most typical of a small language model (SLM) compared to a large language model (LLM)?

   • AHigher accuracy on complex reasoning tasks
   • BLower computational resource requirements
   • CBetter performance on zero-shot generalization
   • DLarger training dataset size
   Reveal Solution Discussion Select an answer first
4. 8foundation · easy

   A test team is considering an SLM for a test automation task to reduce operational costs. What operational constraint is most likely to be relaxed by choosing an SLM?

   • AHardware requirements
   • BAccuracy requirements
   • CData privacy requirements
   • DIntegration complexity
   Reveal Solution Discussion Select an answer first
5. 9foundation · easy

   In a cost-benefit analysis for selecting an SLM over an LLM for a testing task, what benefit is most likely to justify the choice?

   • AHigher accuracy
   • BLower operational costs
   • CFaster integration
   • DBetter domain specificity
   Reveal Solution Discussion Select an answer first
6. 10expert · hard

   A healthcare company wants to use a model to generate test data for patient records. The data is highly sensitive and subject to HIPAA. The company has a limited IT budget and cannot afford a dedicated on-premises GPU server. They are considering a cloud LLM with a Business Associate Agreement (BAA) and a cloud SLM with a BAA. Which option best balances compliance and cost?

   • AUse an on-premises LLM despite the budget constraint
   • BUse the cloud SLM with a BAA
   • CUse an on-premises SLM despite the budget constraint
   • DUse the cloud LLM with a BAA
   Reveal Solution Discussion Select an answer first