Test Automation Metrics CT-TAS Practice Questions (Page 2)

Questions 6–10

1. 6application · medium

   A manager asks the test automation team to reduce the time it takes to get feedback from the regression suite. The team measures that the full suite takes 4 hours to run, and 60% of that time is spent on 10 long-running end-to-end tests. Which decision is most aligned with using metrics for resource allocation?

   • ARun the 10 long tests in parallel on separate agents
   • BReduce the number of test environments to save cost
   • CRemove the 10 long tests from the suite entirely
   • DIncrease the frequency of the full suite to every hour
   Reveal Solution Discussion Select an answer first
2. 7foundation · easy

   What insight can be derived from a consistently high pass/fail rate in automated tests?

   • AThe tests are not executing at all
   • BThe tests are likely stable and the software is behaving as expected
   • CThe test environment is misconfigured
   • DThe automation team is overstaffed
   Reveal Solution Discussion Select an answer first
4. 8expert · hard

   A team has a limited budget for CI infrastructure. They have two options: (1) increase the number of parallel agents to reduce execution time, or (2) invest in test data management to reduce flakiness. Current metrics show the suite takes 2 hours, and 15% of test failures are due to flaky tests. Which decision is most justified by the metrics?

   • ADo both simultaneously, even if it exceeds the budget
   • BReduce the test suite size to lower both execution time and flakiness
   • CIncrease parallel agents first, because reducing execution time is the most important metric
   • DInvest in test data management first, because flakiness undermines trust and wastes time on false failures
   Reveal Solution Discussion Select an answer first
5. 9foundation · easy

   Where can test automation metrics typically be collected from?

   • AAutomation tools and logs
   • BUser feedback forms
   • CMarketing reports
   • DTeam meeting minutes
   Reveal Solution Discussion Select an answer first
6. 10application · medium

   A team wants to measure how much of their manual regression suite is automated. They have 200 manual test cases, and 80 of them have been automated. Which metric should they report?

   • AAutomation coverage = 80 / 80 = 100%
   • BAutomation coverage = 80 / 120 = 66.7%
   • CAutomation coverage = 120 / 200 = 60%
   • DAutomation coverage = 80 / 200 = 40%
   Reveal Solution Discussion Select an answer first