A team wants to measure the efficiency of their test automation suite. Which combination of metrics would best provide a balanced view of efficiency?

The pass rate and the defect detection rate

The number of test cases and the number of testers

Execution time per test case and the cost of maintaining the automation scripts

The number of test environments and the number of test data sets

Which of the following is a common source of raw data for test automation metrics?

The organization's marketing materials

The test automation engineer's personal notes

The test automation team's meeting minutes

Dashboards provided by the test automation tool

A test run shows that a performance test failed because the average response time exceeded the threshold. The team also notices that the application server's CPU usage was at 100% during the test. What is the most likely conclusion?

The network latency was high during the test

The application server was saturated, causing the response time to exceed the threshold

The test automation tool was misconfigured

The test data was incorrect, causing the test to fail

During a soak test (long-duration stability test), the application's memory usage gradually increases until the application becomes unresponsive. The test fails. What SUT data would be most useful to confirm a memory leak?

Memory usage over time, correlated with the test timeline

The version of the test automation tool

The number of test cases that passed before the failure

The total number of virtual users in the test

Certified Tester Advanced Level Test Automation Engineering

Domain 6Objective 2

Objective: Analyze Data from the Test Automation Solution and the System Under Test CTAL-TAE Practice Questions (Page 7)

Part of the Domain 6: Test Automation Reporting and Metrics domain, which makes up ~12% of our current practice bank. ISTQB does not publish an official question count, but from its 90-minute exam (~35–60 total, ~4–7 in this domain), expect 1–2 from this objective — we provide 34 practice questions to prepare you well beyond it. (estimate)

34questions here

7free pages

7concepts

Questions 31–34

31application · medium
A team wants to measure the efficiency of their test automation suite. Which combination of metrics would best provide a balanced view of efficiency?
Select an answer first
32foundation · easy
Which of the following is a common source of raw data for test automation metrics?
Select an answer first
33application · medium
A test run shows that a performance test failed because the average response time exceeded the threshold. The team also notices that the application server's CPU usage was at 100% during the test. What is the most likely conclusion?
Select an answer first
34application · medium
During a soak test (long-duration stability test), the application's memory usage gradually increases until the application becomes unresponsive. The test fails. What SUT data would be most useful to confirm a memory leak?
Select an answer first

Finished these 4 questions?

Review the revealed explanations, or continue through the curriculum.

No more pagesBack to CTAL-TAE

Free Basic Practice is a study aid with revealable answers — not a scored exam. Examers.io is independent and not affiliated with or endorsed by ISTQB. “CTAL-TAE” is a trademark of its owner, used for identification only.