A usability team has drafted a test plan for a new mobile banking app. Before running the full study, they schedule a pilot session with a colleague who is familiar with the app's functionality. The colleague completes all tasks quickly and reports no issues. The team is about to proceed with the main study. What should they do first?

Revise the tasks to be more complex to ensure the pilot participant is challenged.

Proceed with the main study since the pilot showed no problems.

Skip the pilot and start the main study to save time, as the test plan was thoroughly reviewed.

Run another pilot with a participant who matches the target user profile and observe for any issues with the tasks, environment, and data collection.

When preparing for a pilot usability test session, which of the following is the most important consideration for selecting participants?

They should be usability experts who can provide detailed feedback on the test design

They should be the same participants who will take part in the main study

They should be colleagues who are familiar with the project to save time

They should be representative of the target user population

After analyzing the pilot session data, the usability team finds that participants consistently misinterpreted Task 3 and that the time allotted for the entire session was insufficient. What should the team do?

Shorten other tasks to fit the original time frame.

Keep the task as is but remove it from the main study to save time.

Revise Task 3 to be clearer and extend the session time for the main study.

Proceed with the main study as planned, assuming the pilot participants were not representative.

Which of the following is an example of collecting data accurately during a usability test session?

Recording the participant's actions and verbal comments

Noting the participant's appearance and dress

Asking the participant to rate their own performance after each task

Writing down the facilitator's interpretations of the participant's actions

What is the purpose of obtaining informed consent from a participant before a usability test?

To ensure the participant understands the test procedures and agrees to participate

To legally bind the participant to complete the test

To collect the participant's personal data for marketing purposes

To waive the participant's right to see the test results

Certified Tester Usability Testing

Domain 5Objective 2

Execution CT-UT Practice Questions (Page 3)

Part of the Usability Testing domain, which makes up ~15% of our current practice bank. ISTQB does not publish an official question count, but from its 60-minute exam (~25–40 total, ~4–6 in this domain), expect 1–2 from this objective — we provide 40 practice questions to prepare you well beyond it. (estimate)

40questions here

8free pages

11concepts

Questions 11–15

11application · medium
A usability team has drafted a test plan for a new mobile banking app. Before running the full study, they schedule a pilot session with a colleague who is familiar with the app's functionality. The colleague completes all tasks quickly and reports no issues. The team is about to proceed with the main study. What should they do first?
Select an answer first
12foundation · easy
When preparing for a pilot usability test session, which of the following is the most important consideration for selecting participants?
Select an answer first
13application · medium
After analyzing the pilot session data, the usability team finds that participants consistently misinterpreted Task 3 and that the time allotted for the entire session was insufficient. What should the team do?
Select an answer first
14foundation · easy
Which of the following is an example of collecting data accurately during a usability test session?
Select an answer first
15foundation · easy
What is the purpose of obtaining informed consent from a participant before a usability test?
Select an answer first

Finished these 5 questions?

Review the revealed explanations, or continue through the curriculum.

Next 5 questions →Back to CT-UT

Free Basic Practice is a study aid with revealable answers — not a scored exam. Examers.io is independent and not affiliated with or endorsed by ISTQB. “CT-UT” is a trademark of its owner, used for identification only.