5.4 Describe How Token Usage and Context‑window Management Affect Prototyping Cost, Latency, and Output Quality AI-TECHNICAL-PRACTITIONER Practice Questions (Page 6)

Questions 26–27

1. 26application · medium

   A developer is prototyping a customer-support chatbot that sends the entire conversation history to the LLM on every request. The team notices the API bill is rising sharply. Which change would most directly reduce token usage and cost without losing the ability to answer the current question?

   • AUse a lower temperature setting.
   • BIncrease the max tokens for the model's response.
   • CSend only the most recent messages plus a short summary of earlier ones.
   • DSwitch to a model with a larger context window.
   Reveal Solution Discussion Select an answer first
2. 27foundation · easy

   Which practice is most effective for controlling prototyping costs when using an LLM API?

   • AIncreasing the context window size to allow longer responses
   • BReducing the number of tokens sent and received per request
   • CSending the entire conversation history with every request
   • DUsing a more powerful model with a larger context window
   Reveal Solution Discussion Select an answer first