Optimize AI/BI Genie Spaces by Tracking User Questions, Response Accuracy, and Feedback; Updating Instructions and Trusted Assets Based on Stakeholder Input; Validating Accuracy with Benchmarks; Refreshing Unity Catalog Metadata. DATA-ANALYST-ASSOCIATE Practice Questions (Page 5)

Questions 21–25

1. 21foundation · easy

   A table used by an AI/BI Genie space has a new column added. What should the analyst do to ensure the Genie reflects this change?

   • AChange the workspace's pricing tier
   • BRestart the cluster
   • CRefresh the Unity Catalog metadata for the table
   • DRename the Genie space
   Reveal Solution Discussion Select an answer first
2. 22foundation · easy

   A data analyst wants to verify that an AI/BI Genie response is correct. What is the most direct way to assess the response's accuracy?

   • ACheck the number of tokens used to generate the response
   • BReview the cluster's autoscaling metrics
   • CConfirm the user has read access to the Genie space
   • DCompare the response to a known correct result or authoritative data source
   Reveal Solution Discussion Select an answer first
4. 23expert · hard

   An AI/BI Genie space for customer service has been updated with new instructions based on stakeholder feedback. However, after the update, users are complaining that the Genie space is now too restrictive and refuses to answer some legitimate questions. The team has collected feedback indicating that the instructions are too narrow. What is the best way to balance the stakeholder requirements with user needs?

   • ARevert the instructions to the previous version to avoid user complaints.
   • BReview the feedback to identify the specific restrictions that are problematic and adjust the instructions to be more flexible while still meeting stakeholder goals.
   • CDisable the Genie space until the instructions can be completely rewritten.
   • DKeep the instructions as they are and inform users that the restrictions are necessary.
   Reveal Solution Discussion Select an answer first
5. 24application · medium

   A data team has deployed an AI/BI Genie space for sales analytics. After a month, they notice that users frequently ask about 'monthly recurring revenue by region,' but the Genie space often returns incorrect numbers. The team has a set of known correct values for a few sample months. What should they do first to systematically identify the root cause of the inaccuracies?

   • AImmediately update the instructions in the Genie space to clarify the definition of 'monthly recurring revenue.'
   • BRun the sample questions through the Genie space and compare the responses to the known correct values.
   • CRefresh the Unity Catalog metadata for the sales tables to ensure the latest schema is available.
   • DReview the user feedback logs to see which questions users marked as unhelpful.
   Reveal Solution Discussion Select an answer first
6. 25application · medium

   A marketing team uses an AI/BI Genie space to answer questions about campaign performance. Stakeholders report that the Genie space frequently confuses 'impressions' with 'reach' and sometimes uses a deprecated campaign table. The team has collected feedback from users highlighting these issues. What should the team do to address both problems?

   • AUpdate the instructions to define 'impressions' and 'reach' clearly, and replace the deprecated table with the approved one in trusted assets.
   • BDisable user feedback collection to prevent further confusion among users.
   • COnly update the instructions to clarify the definitions, and keep the deprecated table for historical consistency.
   • DRefresh the Unity Catalog metadata for the deprecated table to ensure it is up to date.
   Reveal Solution Discussion Select an answer first