Analyze, Monitor, and Tune AI-powered Business Solutions AB-100 Practice Questions (Page 2)

Questions 6–10

1. 6expert · hard

   An AI agent that handles customer service is experiencing a gradual decline in response quality over several weeks. Telemetry shows that the average response length is increasing, and the relevance score is decreasing. The team suspects the model is drifting. They want to identify the cause and tune the agent. What should they do?

   • AIncrease the max_tokens to allow longer responses.
   • BImmediately lower the temperature to reduce response length.
   • CUse AI-based anomaly detection on telemetry to identify when the decline started and correlate it with changes in input data or prompts.
   • DRetrain the model on all historical data to reset its behavior.
   Reveal Solution Discussion Select an answer first
2. 7foundation · easy

   What is the role of AI-based tools in identifying issues within AI-powered business solutions?

   • ATo replace human administrators entirely
   • BTo automatically generate user documentation
   • CTo store all telemetry data indefinitely
   • DTo detect patterns and anomalies in telemetry data that may indicate problems
   Reveal Solution Discussion Select an answer first
4. 8foundation · easy

   Based on analysis, a team decides to adjust the temperature parameter of an AI model to reduce overly creative responses. What is this action called?

   • ADeploying the AI solution
   • BTuning the AI solution
   • CMonitoring the AI solution
   • DRetraining the AI model
   Reveal Solution Discussion Select an answer first
5. 9foundation · easy

   Which AI-based tool can be used to analyze logs and telemetry from an AI-powered business solution to identify anomalies?

   • AMicrosoft Copilot Studio
   • BAzure Machine Learning
   • CPower Automate
   • DAzure Monitor with Application Insights
   Reveal Solution Discussion Select an answer first
6. 10application · medium

   A government agency is deploying an AI assistant for citizen services. They need to monitor the assistant's performance but have strict requirements for data residency and auditability. Which monitoring process should they design?

   • AUse a monitoring solution that stores all logs in the agency's chosen region and provides an audit trail of access.
   • BUse a free third-party monitoring tool that stores data in a foreign country.
   • CMonitor only the assistant's response time and ignore other metrics.
   • DStore all logs in a central repository without access controls for easier analysis.
   Reveal Solution Discussion Select an answer first