Key Architectural Components and Concepts of LLM-Powered Test Infrastructure CT-GENAI Practice Questions (Page 5)

Questions 21–25

1. 21expert · hard

   A team is evaluating whether to build an LLM-powered test infrastructure or use a commercial solution. They have unique testing requirements and need to integrate with existing internal tools. They also have concerns about data security. What is the most important factor in this decision?

   • AThe ability to customize and integrate with existing tools while ensuring data security.
   • BThe speed of deployment of the commercial solution.
   • CThe brand reputation of the commercial vendor.
   • DThe cost of the commercial solution compared to building in-house.
   Reveal Solution Discussion Select an answer first
2. 22expert · hard · select all that apply

   A QA team is designing an LLM-powered test infrastructure. They want to ensure that the LLM is used effectively for test generation and analysis. Which of the following are core components that should be included in the architecture? (Select all that apply.)

   • ALLM orchestration service to manage prompts and model calls.
   • BResult analysis module to interpret and report test outcomes.
   • CTest data management to provide consistent and traceable data.
   • DA dedicated network firewall to protect the LLM endpoints.
   • EA manual test execution environment that does not use LLM.
   Check answers Discussion Select an answer first
4. 23foundation · easy

   What is a common use of LLMs in the validation phase of test execution?

   • ATo replace the need for assertions in test code
   • BTo execute the test cases on the application
   • CTo compare actual test outputs with expected results and identify discrepancies
   • DTo automatically fix all failed tests without human intervention
   Reveal Solution Discussion Select an answer first
5. 24foundation · easy

   Which of the following sequences correctly represents the typical data flow in an LLM-powered test infrastructure?

   • AResult analysis → LLM processing → Test data → Test execution
   • BTest data → LLM processing → Test execution → Result analysis
   • CLLM processing → Test execution → Test data → Result analysis
   • DTest execution → Test data → LLM processing → Result analysis
   Reveal Solution Discussion Select an answer first
6. 25foundation · easy

   Why is scalability an important infrastructure consideration for LLM-powered testing?

   • ABecause testing workloads can vary significantly, and the infrastructure must handle peak demands without performance degradation
   • BBecause LLMs require a fixed amount of memory regardless of workload
   • CBecause LLMs cannot run on multiple servers
   • DBecause test data is always the same size
   Reveal Solution Discussion Select an answer first