A usability team tested a new checkout flow with 12 participants. Task success rates varied: 10 participants completed the purchase, but 2 abandoned at the payment step. Time-on-task data shows the 10 successful completions took an average of 4 minutes, while the 2 failures took over 10 minutes before giving up. The team must decide which issue to report as the top priority. What is the most defensible approach?

Combine the quantitative data with qualitative observations from the 2 failures to determine whether the payment issue is a systemic problem or an isolated incident before prioritizing.

Prioritize the issue based solely on the average time-on-task of successful completions, since faster completions indicate a more efficient flow.

Treat the 2 failures as outliers and exclude them from the analysis to avoid skewing the overall success rate.

Report the payment-step abandonment as the top issue because it has the highest severity, even though it affected only 2 participants.

What is the primary purpose of synthesizing usability data from multiple test sessions?

To select the most favorable participant quotes for the report

To identify patterns and recurring usability issues

To calculate the average time-on-task for each participant

To ensure all participants completed the same tasks

A usability tester observed that several participants struggled to complete a multi-step form. In the report, which statement best communicates the finding in a clear, objective, and actionable manner?

5 of 8 participants abandoned the form at the 'Billing Address' step, citing unclear labels and missing validation feedback.

The form is poorly designed and should be completely redesigned.

Some users had trouble, but it is probably not a big deal.

Participants found the form confusing and frustrating, and they did not like it.

A usability test report is being written for a client who is not familiar with usability testing. The report includes technical jargon and complex statistical analyses. The client has expressed confusion about the findings. What is the best way to revise the report to make it accessible?

Rewrite the report using plain language, define any necessary terms, and include a glossary.

Keep the technical jargon but add more charts and graphs to explain the data.

Remove all statistical data and only include qualitative quotes.

Ask the client to take a usability testing course before reading the report.

Which metric is commonly reported as a quantitative usability metric?

Participant satisfaction comments

User interface color preferences

Certified Tester Usability Testing

Domain 5Objective 3

Analysis and Reporting CT-UT Practice Questions (Page 6)

Part of the Usability Testing domain, which makes up ~15% of our current practice bank. ISTQB does not publish an official question count, but from its 60-minute exam (~25–40 total, ~4–6 in this domain), expect 1–2 from this objective — we provide 32 practice questions to prepare you well beyond it. (estimate)

32questions here

7free pages

8concepts

Questions 26–30

26application · medium
A usability team tested a new checkout flow with 12 participants. Task success rates varied: 10 participants completed the purchase, but 2 abandoned at the payment step. Time-on-task data shows the 10 successful completions took an average of 4 minutes, while the 2 failures took over 10 minutes before giving up. The team must decide which issue to report as the top priority. What is the most defensible approach?
Select an answer first
27foundation · easy
What is the primary purpose of synthesizing usability data from multiple test sessions?
Select an answer first
28application · medium
A usability tester observed that several participants struggled to complete a multi-step form. In the report, which statement best communicates the finding in a clear, objective, and actionable manner?
Select an answer first
29expert · hard
A usability test report is being written for a client who is not familiar with usability testing. The report includes technical jargon and complex statistical analyses. The client has expressed confusion about the findings. What is the best way to revise the report to make it accessible?
Select an answer first
30foundation · easy
Which metric is commonly reported as a quantitative usability metric?
Select an answer first

Finished these 5 questions?

Review the revealed explanations, or continue through the curriculum.

Next 5 questions →Back to CT-UT

Free Basic Practice is a study aid with revealable answers — not a scored exam. Examers.io is independent and not affiliated with or endorsed by ISTQB. “CT-UT” is a trademark of its owner, used for identification only.