Contribution of the Test Analyst to Usability Testing CTAL-TA Practice Questions (Page 6)

Questions 26–30

1. 26expert · hard

   A test analyst has collected usability data from 12 participants. The data shows that 9 participants failed to complete a critical task, but the failure was due to different reasons: 4 participants could not find the feature, 3 misunderstood the terminology, and 2 encountered a technical error. How should the test analyst analyze and report these findings?

   • AReport the task failure rate as a single metric without detailing the reasons, as stakeholders only care about the overall success rate.
   • BReport only the most common reason (finding the feature) and ignore the other reasons to keep the report concise.
   • CReport all 9 failures as a single usability issue with a high severity rating, since the task failed for the majority of participants.
   • DAnalyze the failures by root cause, report each as a separate usability issue with its own severity rating, and provide evidence for each.
   Reveal Solution Discussion Select an answer first
2. 27foundation · easy

   Which element of a usability test plan describes the characteristics of the people who will participate?

   • ATest schedule
   • BSuccess criteria
   • CTest environment
   • DUser profiles
   Reveal Solution Discussion Select an answer first
4. 28foundation · easy

   Which of the following best describes usability testing?

   • AA test of the system's ability to handle multiple concurrent users
   • BA test that verifies the system's output is correct for given inputs
   • CA review of the user interface by design experts to find violations of style guides
   • DA test that measures how well users can learn and use the system to achieve their goals
   Reveal Solution Discussion Select an answer first
5. 29expert · hard

   A test analyst is designing tasks for a usability test of a complex data analytics dashboard. The dashboard has many features, and the test time is limited to 60 minutes per participant. The analyst needs to evaluate both the learnability for new users and the efficiency for experienced users. What is the most effective task design strategy?

   • ADesign a set of core tasks that all participants perform, and then add additional complex tasks for experienced users to evaluate efficiency.
   • BFocus only on experienced users, as they are the primary users of the dashboard.
   • CUse the same set of tasks for all participants, regardless of their experience level, to ensure comparability of results.
   • DGive new users simple tasks and experienced users complex tasks, with no overlap, to tailor the test to each group.
   Reveal Solution Discussion Select an answer first
6. 30application · medium

   A test analyst is creating a usability test plan for a new online learning platform. The platform is intended for both students and instructors. Which element is most important to include in the plan to ensure the test evaluates the right aspects?

   • AA description of the user profiles for both students and instructors, along with specific tasks and success criteria for each group.
   • BA list of all the hardware and software requirements for the test environment, including screen resolution and browser versions.
   • CA detailed schedule of when each test session will occur, including breaks for the moderator.
   • DA list of usability heuristics that will be used to evaluate the interface during the test.
   Reveal Solution Discussion Select an answer first