A usability team is conducting a test with multiple facilitators to accommodate a large number of participants. They are concerned about inter-rater reliability, as different facilitators may interpret and record observations differently. Which quality control method would be most effective in ensuring consistency across facilitators?

Provide a detailed observation checklist and conduct a calibration session where all facilitators practice coding the same session.

Use only one facilitator for all sessions, even if it means extending the test schedule.

Have each facilitator conduct a pilot session and compare their notes to identify discrepancies.

Assign each facilitator to a different set of tasks to avoid overlap.

Which of the following is a criterion used to evaluate the quality of a usability test?

The validity of the test results.

The number of participants in the test.

The duration of the test sessions.

A usability team is testing a new mobile app for a global audience. They are facing logistical challenges because participants are in different time zones. Which mitigation strategy would best address this challenge while maintaining data quality?

Conduct all sessions at a fixed time that is convenient for the team, regardless of participant time zones.

Limit the test to participants in the same time zone as the team to simplify logistics.

Send the test tasks to participants via email and ask them to complete them on their own time.

Use a remote moderated testing tool that allows scheduling sessions across multiple time zones.

Which of the following is an effective strategy to mitigate the risk of small sample sizes in usability testing?

Recruiting participants who are easily available.

Using only quantitative metrics.

Increasing the length of the test session.

Conducting multiple rounds of testing with a small number of participants each.

A usability team is conducting a test with only 5 participants due to budget constraints. The team lead is aware that this is a small sample size but wants to maximize the insights gained. Which practice would be most effective in mitigating the risk of missing critical usability issues?

Use a diverse group of participants to cover a wide range of user characteristics.

Run a pilot test with the same participants to ensure tasks are clear before the actual test.

Combine the small sample with expert reviews and heuristic evaluations to identify additional issues.

Conduct multiple rounds of testing with the same 5 participants to gather more data.

Certified Tester Usability Testing

Domain 5Objective 4

Quality and Best Practices CT-UT Practice Questions (Page 5)

Part of the Usability Testing domain, which makes up ~15% of our current practice bank. ISTQB does not publish an official question count, but from its 60-minute exam (~25–40 total, ~4–6 in this domain), expect 1–2 from this objective — we provide 32 practice questions to prepare you well beyond it. (estimate)

32questions here

7free pages

7concepts

Questions 21–25

21expert · hard
A usability team is conducting a test with multiple facilitators to accommodate a large number of participants. They are concerned about inter-rater reliability, as different facilitators may interpret and record observations differently. Which quality control method would be most effective in ensuring consistency across facilitators?
Select an answer first
22foundation · easy
Which of the following is a criterion used to evaluate the quality of a usability test?
Select an answer first
23application · medium
A usability team is testing a new mobile app for a global audience. They are facing logistical challenges because participants are in different time zones. Which mitigation strategy would best address this challenge while maintaining data quality?
Select an answer first
24foundation · easy
Which of the following is an effective strategy to mitigate the risk of small sample sizes in usability testing?
Select an answer first
25application · medium
A usability team is conducting a test with only 5 participants due to budget constraints. The team lead is aware that this is a small sample size but wants to maximize the insights gained. Which practice would be most effective in mitigating the risk of missing critical usability issues?
Select an answer first

Finished these 5 questions?

Review the revealed explanations, or continue through the curriculum.

Next 5 questions →Back to CT-UT

Free Basic Practice is a study aid with revealable answers — not a scored exam. Examers.io is independent and not affiliated with or endorsed by ISTQB. “CT-UT” is a trademark of its owner, used for identification only.