An organization wants to evaluate the performance of its MBT approach by measuring the percentage of test cases that fail during execution. What is the primary purpose of this metric?

To evaluate the coverage of the model

To assess the quality of the generated test cases

To determine the number of test cases needed

To measure the efficiency of the MBT tool

A company is deploying MBT to improve the quality of their software. They have set a KPI of 'defect detection percentage' and have achieved a value of 85%. However, they are not satisfied with this result. What is the most likely reason for their dissatisfaction?

The KPI is too difficult to measure

The KPI is not a valid measure of quality

The KPI is not aligned with the company's goal of improving quality

The KPI does not measure the cost of achieving that defect detection percentage

A company is adopting MBT to reduce the cost of testing. They want to set a KPI that measures the cost-effectiveness of the MBT approach. Which KPI is most suitable?

Number of test cases executed per day

Percentage of requirements covered

A team is comparing the effectiveness of MBT with their previous manual testing. They have data on the number of defects found and the number of test cases executed for both approaches. Which metric would best allow a fair comparison?

Defect detection percentage (DDP)

A company wants to evaluate the success of their MBT deployment in improving the overall testing process. They have set a KPI of 'percentage of test cases generated automatically from models'. What does this KPI primarily measure?

The coverage of the system under test

The level of automation in test generation

The efficiency of test execution

Certified Tester Model-Based Testing

Domain 5Objective 2

Metrics and Key Performance Indicator CT-MBT Practice Questions (Page 4)

Part of the Evaluating and Deploying an MBT Approach domain, which makes up ~17% of our current practice bank. ISTQB does not publish an official question count, but from its 60-minute exam (~25–40 total, ~4–7 in this domain), expect 1–1 from this objective — we provide 20 practice questions to prepare you well beyond it. (estimate)

20questions here

4free pages

4concepts

Questions 16–20

16foundation · easy
An organization wants to evaluate the performance of its MBT approach by measuring the percentage of test cases that fail during execution. What is the primary purpose of this metric?
Select an answer first
17expert · hard
A company is deploying MBT to improve the quality of their software. They have set a KPI of 'defect detection percentage' and have achieved a value of 85%. However, they are not satisfied with this result. What is the most likely reason for their dissatisfaction?
Select an answer first
18application · medium
A company is adopting MBT to reduce the cost of testing. They want to set a KPI that measures the cost-effectiveness of the MBT approach. Which KPI is most suitable?
Select an answer first
19application · medium
A team is comparing the effectiveness of MBT with their previous manual testing. They have data on the number of defects found and the number of test cases executed for both approaches. Which metric would best allow a fair comparison?
Select an answer first
20application · medium
A company wants to evaluate the success of their MBT deployment in improving the overall testing process. They have set a KPI of 'percentage of test cases generated automatically from models'. What does this KPI primarily measure?
Select an answer first

Finished these 5 questions?

Review the revealed explanations, or continue through the curriculum.

No more pagesBack to CT-MBT

Free Basic Practice is a study aid with revealable answers — not a scored exam. Examers.io is independent and not affiliated with or endorsed by ISTQB. “CT-MBT” is a trademark of its owner, used for identification only.