After running experiments, a team has results for two models on a sentiment classification task: Model A has 92% accuracy and 0.88 F1; Model B has 90% accuracy and 0.91 F1. The dataset is imbalanced. Which model should they choose?

Model A because it has a higher accuracy and F1 is not important

Model A because accuracy is higher

Model B because it has a higher recall

After running experiments on two models, Model A achieved an accuracy of 0.92 and Model B achieved 0.88 on the same test set. What is the most appropriate conclusion?

Model B is better on this test set

Model A is better on this test set

The result is inconclusive without more metrics

DatabricksCertified Generative AI Engineer Associate

Domain 3Objective 1

Model Selection and Evaluation GENERATIVE-AI-ENGINEER-ASSOCIATE Practice Questions (Page 3)

Part of the Section 3: Application Development domain, which makes up ~18% of our current practice bank. Databricks does not publish an official question count, but from its 90-minute exam (~35–60 total, ~6–11 in this domain), expect 1–2 from this objective — we provide 24 practice questions to prepare you well beyond it. (estimate)

24questions here

5free pages

6concepts

Questions 11–15

11foundation · easy
A team wants to filter models on a hub to find only those that support a specific language. Which metadata field should they use as a filter?
Select an answer first
12foundation · easy
A developer is browsing a model hub to find a model for a commercial product. Which metadata is most important to verify to ensure the model can be legally used in the product?
Select an answer first
13foundation · easy
A team is evaluating a model for a text classification task where false positives and false negatives are equally important. Which metric is most appropriate to use?
Select an answer first
14application · medium
After running experiments, a team has results for two models on a sentiment classification task: Model A has 92% accuracy and 0.88 F1; Model B has 90% accuracy and 0.91 F1. The dataset is imbalanced. Which model should they choose?
Select an answer first
15foundation · easy
After running experiments on two models, Model A achieved an accuracy of 0.92 and Model B achieved 0.88 on the same test set. What is the most appropriate conclusion?
Select an answer first

Finished these 5 questions?

Review the revealed explanations, or continue through the curriculum.

Next 5 questions →Back to GENERATIVE-AI-ENGINEER-ASSOCIATE

Free Basic Practice is a study aid with revealable answers — not a scored exam. Examers.io is independent and not affiliated with or endorsed by Databricks. “GENERATIVE-AI-ENGINEER-ASSOCIATE” is a trademark of its owner, used for identification only.

Model Selection and Evaluation GENERATIVE-AI-ENGINEER-ASSOCIATE Practice Questions (Page 3)

Questions 11–15

A team wants to filter models on a hub to find only those that support a specific language. Which metadata field should they use as a filter?

A developer is browsing a model hub to find a model for a commercial product. Which metadata is most important to verify to ensure the model can be legally used in the product?

A team is evaluating a model for a text classification task where false positives and false negatives are equally important. Which metric is most appropriate to use?

After running experiments, a team has results for two models on a sentiment classification task: Model A has 92% accuracy and 0.88 F1; Model B has 90% accuracy and 0.91 F1. The dataset is imbalanced. Which model should they choose?

After running experiments on two models, Model A achieved an accuracy of 0.92 and Model B achieved 0.88 on the same test set. What is the most appropriate conclusion?

Keep studying — Section 3: Application Development