Optimize AI/BI Genie Spaces by Tracking User Questions, Response Accuracy, and Feedback; Updating Instructions and Trusted Assets Based on Stakeholder Input; Validating Accuracy with Benchmarks; Refreshing Unity Catalog Metadata. DATA-ANALYST-ASSOCIATE Practice Questions (Page 4)

Questions 16–20

1. 16foundation · easy

   A data analyst wants to identify areas where an AI/BI Genie space could be improved based on user experience. Which source of information is most relevant?

   • AUser feedback collected on the Genie responses
   • BThe IP addresses of users who accessed the space
   • CThe name of the SQL warehouse used by the space
   • DThe total number of tables in the workspace
   Reveal Solution Discussion Select an answer first
2. 17expert · hard

   A data science team has created a benchmark set of 100 questions to validate an AI/BI Genie space. After a recent update to the underlying data, the team runs the benchmark and finds that accuracy dropped from 90% to 80%. The team suspects the drop is due to schema changes in the Unity Catalog. What should the team do to confirm this hypothesis?

   • ACompare the benchmark results to the previous baseline to identify which questions failed.
   • BRefresh the Unity Catalog metadata and rerun the benchmark to see if accuracy improves.
   • CCollect user feedback to see if they have noticed any issues.
   • DReview the benchmark questions to see if any are now ambiguous or outdated.
   Reveal Solution Discussion Select an answer first
4. 18application · medium

   A marketing team wants to improve their AI/BI Genie space. They have noticed that users often ask about 'customer lifetime value' but the Genie space does not have a clear definition. The team has also identified that the 'customers' table is missing some key columns. What should the team do to address both the definition and the data issue?

   • AUpdate the instructions to define 'customer lifetime value' and update the trusted assets to include the missing columns.
   • BOnly update the trusted assets to include the missing columns.
   • COnly update the instructions to define 'customer lifetime value'.
   • DRefresh the Unity Catalog metadata for the 'customers' table.
   Reveal Solution Discussion Select an answer first
5. 19foundation · easy

   Which type of information is most useful for identifying recurring themes in how users interact with an AI/BI Genie space?

   • AThe names of the workspace administrators
   • BThe text of questions submitted by users over a period of time
   • CThe list of cluster sizes used by the Genie space
   • DThe version number of the Databricks Runtime
   Reveal Solution Discussion Select an answer first
6. 20foundation · easy

   A data analyst wants to understand which topics users most frequently ask about in an AI/BI Genie space. Which action directly supports this goal?

   • AReviewing the logged user questions and their timestamps in the Genie space usage logs
   • BReviewing the cluster configuration for the Genie space
   • CChecking the number of tables registered in the Unity Catalog metastore
   • DExamining the permissions assigned to the Genie space users
   Reveal Solution Discussion Select an answer first