LLMOps When Deploying and Managing LLMs for Software Testing CT-GENAI Practice Questions (Page 6)

Questions 26–30

1. 26foundation · easy

   When scaling LLM inference for a test environment, which resource is typically the most critical to consider?

   • ADisk storage
   • BGPU memory
   • CNetwork bandwidth
   • DCPU cores
   Reveal Solution Discussion Select an answer first
2. 27foundation · easy

   What is a key advantage of using a managed API for LLM deployment in a testing environment?

   • AIt reduces the operational overhead of managing infrastructure
   • BIt provides full control over the underlying hardware
   • CIt eliminates the need for any network connectivity
   • DIt guarantees zero latency for all test calls
   Reveal Solution Discussion Select an answer first
4. 28foundation · easy

   What is the role of a CI/CD pipeline in LLM deployment for testing?

   • ATo replace the need for any testing of the LLM
   • BTo manually review every model update before deployment
   • CTo store the training data for the LLM
   • DTo automate the build, test, and deployment of LLM updates
   Reveal Solution Discussion Select an answer first
5. 29expert · hard

   A team is deploying an LLM-based test oracle. They have multiple versions of the model, and they need to ensure that the version used in production is the one that has passed all quality checks. They also need to be able to roll back to a previous version if the new one fails. What is the best practice?

   • AUse a model registry that tracks model versions and their associated metadata, and promote models to production only after they pass all checks.
   • BKeep all model versions in a shared folder and manually update the production path.
   • CUse the latest model version in production without any checks.
   • DUse a CI/CD pipeline that deploys the model to production automatically, but without version tracking.
   Reveal Solution Discussion Select an answer first
6. 30foundation · easy

   What is the purpose of a model registry in LLM management for testing?

   • ATo provide a central repository for model versions and metadata
   • BTo monitor the performance of the LLM in real-time
   • CTo store the training data used for the LLM
   • DTo execute test cases automatically
   Reveal Solution Discussion Select an answer first