A financial services company is developing a model to analyze test logs that contain sensitive customer data. They have strict data privacy requirements that prohibit sending data to external cloud services. The team has a dedicated on-premises server with a single high-end GPU. Which model deployment is most appropriate?

Use a cloud SLM with encryption

Use a cloud LLM with a data processing agreement

When integrating a language model into a CI/CD pipeline, which factor is most critical to ensure smooth operation?

Compatibility with the pipeline's programming language

The model's ability to generate images

For benchmarking a model's ability to analyze test logs, which benchmark dataset would be most appropriate?

A collection of generic text documents

A list of common English sentences

A set of historical test logs with known defect labels

Certified Tester Testing with Generative AI

Domain 5Objective 3

Selecting LLMs/SLMs for Software Test Tasks CT-GENAI Practice Questions (Page 5)

Part of the Deploying and Integrating Generative AI in Test organizations domain, which makes up ~23% of our current practice bank. ISTQB does not publish an official question count, but from its 60-minute exam (~25–40 total, ~6–9 in this domain), expect 1–1 from this objective — we provide 30 practice questions to prepare you well beyond it. (estimate)

30questions here

6free pages

10concepts

Questions 21–25

21application · medium
A financial services company is developing a model to analyze test logs that contain sensitive customer data. They have strict data privacy requirements that prohibit sending data to external cloud services. The team has a dedicated on-premises server with a single high-end GPU. Which model deployment is most appropriate?
Select an answer first
22foundation · easy
When integrating a language model into a CI/CD pipeline, which factor is most critical to ensure smooth operation?
Select an answer first
23foundation · easy
A testing team must choose between an LLM and an SLM for generating test data. The team has strict data privacy requirements and limited computational resources. Which model selection criterion is most influential in this scenario?
Select an answer first
24foundation · easy
For benchmarking a model's ability to analyze test logs, which benchmark dataset would be most appropriate?
Select an answer first
25foundation · easy
When analyzing test task requirements for model selection, which requirement is most critical for a test case generation task that must run in real time within a CI/CD pipeline?
Select an answer first

Finished these 5 questions?

Review the revealed explanations, or continue through the curriculum.

Next 5 questions →Back to CT-GENAI

Free Basic Practice is a study aid with revealable answers — not a scored exam. Examers.io is independent and not affiliated with or endorsed by ISTQB. “CT-GENAI” is a trademark of its owner, used for identification only.

Selecting LLMs/SLMs for Software Test Tasks CT-GENAI Practice Questions (Page 5)

Questions 21–25

When integrating a language model into a CI/CD pipeline, which factor is most critical to ensure smooth operation?

A testing team must choose between an LLM and an SLM for generating test data. The team has strict data privacy requirements and limited computational resources. Which model selection criterion is most influential in this scenario?

For benchmarking a model's ability to analyze test logs, which benchmark dataset would be most appropriate?

When analyzing test task requirements for model selection, which requirement is most critical for a test case generation task that must run in real time within a CI/CD pipeline?

Keep studying — Deploying and Integrating Generative AI in Test organizations