Test Automation Metrics CT-TAS Practice Questions (Page 5)

Questions 21–25

1. 21foundation · easy

   Which metric would best help analyze the stability of automated tests over time?

   • ATrend of pass/fail rates over multiple runs
   • BNumber of testers
   • CTotal number of test cases
   • DName of the automation framework
   Reveal Solution Discussion Select an answer first
2. 22expert · hard

   A team's automation suite has a pass rate of 98%, but the defect detection rate is only 5%. The team is considering adding more test cases to increase coverage. Based on the metrics, what is the most likely issue and the best action?

   • AThe tests are too flaky; the team should focus on stabilizing the environment
   • BThe team should add more test cases to increase the chance of finding defects
   • CThe team should reduce the number of tests to lower maintenance effort
   • DThe tests are not effective; the team should review test design and assertions before adding more tests
   Reveal Solution Discussion Select an answer first
4. 23application · medium

   A test automation lead needs to present the value of the automation effort to the VP of Engineering. The VP is concerned about the return on investment. Which presentation approach is most effective?

   • AList the tools and frameworks used and their features
   • BShow a trend chart of automation coverage and pass rate over the last six months
   • CPresent the number of test cases automated and the total execution time saved compared to manual testing
   • DShow a pie chart of test failures by component
   Reveal Solution Discussion Select an answer first
5. 24application · medium

   A team notices that the pass rate of their automated regression suite has dropped from 95% to 80% over the last two weeks. The failure log shows that 70% of the failures are in the checkout flow tests, and these tests have not been modified recently. What is the most likely insight from this analysis?

   • AThe test automation framework is unstable and needs rewriting
   • BThe test data is corrupted and needs to be regenerated
   • CThe tests are flaky and should be removed from the suite
   • DThe checkout flow has a new defect that needs investigation
   Reveal Solution Discussion Select an answer first
6. 25foundation · easy

   Which metric measures the percentage of automated test cases that pass?

   • AMaintenance effort
   • BExecution time
   • CAutomation coverage
   • DPass/fail rate
   Reveal Solution Discussion Select an answer first