Benchmark Suites for ML CT-AI Practice Questions (Page 2)

Questions 6–10

1. 6foundation · easy

   Which benchmark suite would be most appropriate for evaluating a model designed to predict customer churn from structured tabular data?

   • AA tabular benchmark dataset such as the UCI Adult dataset
   • BCOCO
   • CImageNet
   • DGLUE
   Reveal Solution Discussion Select an answer first
2. 7foundation · easy

   When selecting a benchmark suite for evaluating a model that classifies medical images, which factor is most important to consider?

   • AThe benchmark suite is the most popular one in the research community
   • BThe benchmark suite is the easiest to achieve high accuracy on
   • CThe benchmark suite uses the largest possible number of images
   • DThe benchmark suite includes images similar to the target medical domain and uses clinically relevant metrics
   Reveal Solution Discussion Select an answer first
4. 8foundation · easy

   Which of the following best describes the role of a benchmark suite in ML model evaluation?

   • AIt ensures the model will meet all regulatory compliance requirements
   • BIt provides a fixed set of tasks, data, and metrics to assess model performance consistently
   • CIt automatically generates training data for the model
   • DIt acts as a formal certification that a model is safe for production use
   Reveal Solution Discussion Select an answer first
5. 9expert · hard

   A startup is building a sentiment analysis model for customer reviews in a niche industry. They plan to evaluate on the GLUE benchmark and report high accuracy. A reviewer points out that the benchmark may not reflect their real-world use case. What is the most important limitation to consider?

   • AGLUE is too small and lacks enough data for training.
   • BGLUE contains only English text, so it cannot evaluate multilingual models.
   • CGLUE does not provide a standard metric, making comparison difficult.
   • DGLUE's tasks and data may not represent the specific language and topics of the startup's customer reviews.
   Reveal Solution Discussion Select an answer first
6. 10application · medium

   A team is developing a model to classify X-ray images into disease categories. They need a benchmark suite to compare their model's performance against published state-of-the-art results. Which benchmark suite is most appropriate for this task?

   • ACIFAR-10
   • BCheXpert
   • CGLUE
   • DImageNet
   Reveal Solution Discussion Select an answer first