Quality and Best Practices CT-UT Practice Questions (Page 2)

Questions 6–10

1. 6expert · hard

   A usability team is testing a new website. They have collected both quantitative data (task completion rates) and qualitative data (participant comments). During analysis, they find that the quantitative data shows high task completion, but the qualitative data reveals that participants were confused and frustrated. Which quality criterion is most at risk if the team only reports the quantitative data?

   • AObjectivity
   • BValidity
   • CReliability
   • DCompleteness
   Reveal Solution Discussion Select an answer first
2. 7expert · hard

   A usability team is analyzing data from a test where the facilitator inadvertently gave different levels of assistance to participants. Some participants received detailed hints, while others received none. The team is now writing the report. Which approach best handles this issue to maintain the quality of the findings?

   • AAnalyze the data separately for participants who received assistance and those who did not, and report both sets of findings.
   • BReport the results as if all participants received the same level of assistance, to avoid confusion.
   • CDiscard the data from participants who received assistance, as it is not valid.
   • DAverage the results across all participants to smooth out the differences.
   Reveal Solution Discussion Select an answer first
4. 8expert · hard

   A usability team is testing a new health app with elderly users. They are concerned about the 'digital divide' and want to ensure that participants are comfortable with technology. They also have a tight deadline and limited budget. Which mitigation strategy best balances these constraints?

   • AUse a mixed-methods approach: conduct a few in-depth sessions with less tech-savvy users and supplement with remote unmoderated tests with more tech-savvy users.
   • BRecruit only tech-savvy elderly users to ensure they can complete the tasks without frustration.
   • CProvide a brief training session before the test to familiarize participants with the basic device operations.
   • DConduct the test in a lab with a facilitator who can provide assistance when needed.
   Reveal Solution Discussion Select an answer first
5. 9foundation · easy

   Which of the following is a method for ensuring quality during the planning phase of a usability test?

   • AReviewing the test plan against the research objectives.
   • BConducting a pilot test with a small group of participants.
   • CDebriefing the test moderator after each session.
   • DAnalyzing the test data for outliers.
   Reveal Solution Discussion Select an answer first
6. 10application · medium

   A usability test for a new online learning platform is being planned. The team has a limited budget and can only afford 6 participants. They are concerned about the reliability of the results. Which approach would best improve the reliability of the test given the constraint?

   • AIncrease the number of tasks per participant to gather more data from each session.
   • BEnsure that each participant performs the same tasks in the same order with the same instructions.
   • CSelect participants who are all familiar with online learning platforms to ensure they can complete tasks.
   • DUse a think-aloud protocol and record all sessions for later analysis.
   Reveal Solution Discussion Select an answer first