Optimize AI/BI Genie Spaces by Tracking User Questions, Response Accuracy, and Feedback; Updating Instructions and Trusted Assets Based on Stakeholder Input; Validating Accuracy with Benchmarks; Refreshing Unity Catalog Metadata. DATA-ANALYST-ASSOCIATE Practice Questions (Page 1)

Questions 1–5

1. 1foundation · easy

   Which approach best supports ongoing monitoring of response accuracy in an AI/BI Genie space?

   • AChanging the workspace display name
   • BPeriodically comparing Genie responses to a set of known-answer questions
   • CIncreasing the cluster size for the Genie space
   • DAdding more users to the Genie space
   Reveal Solution Discussion Select an answer first
2. 2application · medium

   A logistics company has an AI/BI Genie space for shipment tracking. They have a set of known correct answers for common questions, but they have not used them recently. The team wants to ensure the Genie space is still accurate after a recent update to the instructions. What is the most reliable way to verify accuracy?

   • ARefresh the Unity Catalog metadata to ensure the data is current.
   • BRun the known correct answers as benchmark questions and compare the Genie space's responses.
   • CAsk a few users to test the Genie space and report any issues.
   • DReview the instruction changes to see if they are logically sound.
   Reveal Solution Discussion Select an answer first
4. 3foundation · easy

   What is the primary purpose of using benchmark datasets to validate an AI/BI Genie space?

   • ATo change the workspace's region
   • BTo verify that responses are correct against known answers
   • CTo reduce the number of tables in the Unity Catalog
   • DTo increase the speed of the underlying cluster
   Reveal Solution Discussion Select an answer first
5. 4expert · hard

   An AI/BI Genie space for financial reporting has been updated with new instructions and trusted assets. Before rolling it out to all users, the team wants to ensure the changes did not degrade response quality. They have a set of 50 benchmark questions with known correct answers. However, running all 50 takes time and some questions are now irrelevant due to the changes. What is the most efficient approach to validate the updates?

   • ASelect a subset of benchmark questions that are still relevant and run them to compare accuracy.
   • BSkip the benchmark and rely on user feedback from the pilot group.
   • CRun the full benchmark suite and compare the results to the previous baseline.
   • DRefresh the Unity Catalog metadata and assume the updates are correct.
   Reveal Solution Discussion Select an answer first
6. 5expert · hard

   An AI/BI Genie space for HR analytics has been receiving mixed feedback. Some users praise the responses, while others complain about inaccuracies. The team has a benchmark set of 20 questions, but the benchmark accuracy is high (95%). The team suspects that the inaccuracies are due to questions outside the benchmark scope. What is the best way to identify the gap between benchmark performance and real-world user issues?

   • AAnalyze user feedback to identify common themes and compare them to the benchmark questions.
   • BRefresh the Unity Catalog metadata to ensure all tables are up to date.
   • CUpdate the instructions to be more general to cover a wider range of questions.
   • DExpand the benchmark set to include more questions from the existing pool.
   Reveal Solution Discussion Select an answer first