A team is selecting a model for a sentiment analysis task. They find two models with similar F1 scores. Model A's card states it was trained on product reviews; Model B's card states it was trained on social media posts. The task is to analyze customer feedback on a retail website. Which model should they choose?

Model B because social media is more current

Either model because F1 scores are similar

Model B because social media data is more diverse

Model A because the training data matches the task domain

DatabricksCertified Generative AI Engineer Associate

Domain 3Objective 1

Model Selection and Evaluation GENERATIVE-AI-ENGINEER-ASSOCIATE Practice Questions (Page 1)

Part of the Section 3: Application Development domain, which makes up ~18% of our current practice bank. Databricks does not publish an official question count, but from its 90-minute exam (~35–60 total, ~6–11 in this domain), expect 1–2 from this objective — we provide 24 practice questions to prepare you well beyond it. (estimate)

24questions here

5free pages

6concepts

Questions 1–5

1application · easy
A team has deployed a sentiment analysis model. They now want to track its performance on live data to detect when accuracy drops. What is this activity called?
Select an answer first
2foundation · easy
A researcher is comparing two language models on their ability to predict the next word in a sequence. Which metric is specifically designed for this task?
Select an answer first
3foundation · easy
A model card states: 'Intended for English text summarization; not recommended for code generation.' Which part of the model card provides this information?
Select an answer first
4expert · medium
A team is selecting a model for a sentiment analysis task. They find two models with similar F1 scores. Model A's card states it was trained on product reviews; Model B's card states it was trained on social media posts. The task is to analyze customer feedback on a retail website. Which model should they choose?
Select an answer first
5expert · medium
A developer is looking for an LLM for a chatbot that must respond in multiple languages. They are on a model hub and need to filter models that support the required languages. What metadata should they use to filter?
Select an answer first

Finished these 5 questions?

Review the revealed explanations, or continue through the curriculum.

Next 5 questions →Back to GENERATIVE-AI-ENGINEER-ASSOCIATE

Free Basic Practice is a study aid with revealable answers — not a scored exam. Examers.io is independent and not affiliated with or endorsed by Databricks. “GENERATIVE-AI-ENGINEER-ASSOCIATE” is a trademark of its owner, used for identification only.

Model Selection and Evaluation GENERATIVE-AI-ENGINEER-ASSOCIATE Practice Questions (Page 1)

Questions 1–5

A team has deployed a sentiment analysis model. They now want to track its performance on live data to detect when accuracy drops. What is this activity called?

A researcher is comparing two language models on their ability to predict the next word in a sequence. Which metric is specifically designed for this task?

A model card states: 'Intended for English text summarization; not recommended for code generation.' Which part of the model card provides this information?

A developer is looking for an LLM for a chatbot that must respond in multiple languages. They are on a model hub and need to filter models that support the required languages. What metadata should they use to filter?

Keep studying — Section 3: Application Development