1.3 Explain Role of Context Windows, Token Limits and Response Management AI-TECHNICAL-PRACTITIONER Practice Questions (Page 4)

Questions 16–20

1. 16application · medium

   A developer is using an API that has a 4,000-token limit for both input and output. The user's question is 500 tokens, and the developer wants to include 3,000 tokens of supporting documentation. The expected answer is about 800 tokens. What is the best way to ensure the request succeeds?

   • AIncrease the max_tokens parameter to 4,000 to allow a longer response.
   • BSend the documentation in a separate API call and then combine the results.
   • CReduce the documentation to 2,500 tokens so the total input and output fit within the limit.
   • DSend the question and documentation as-is, and let the API truncate the response.
   Reveal Solution Discussion Select an answer first
2. 17expert · hard

   A developer is using an API with a 4,000-token context window. The user's prompt is 3,000 tokens, and the developer wants a 1,500-token response. The developer cannot reduce the prompt. What should the developer do?

   • ASend the prompt in two separate requests and combine the responses.
   • BSet max_tokens to 1,000 to fit within the limit.
   • CSend the prompt as-is and set max_tokens to 1,500.
   • DUse a model with a larger context window.
   Reveal Solution Discussion Select an answer first
4. 18foundation · easy

   Which strategy is most appropriate when a long document must be processed by a model with a smaller context window?

   • AIncreasing the model's token limit by changing a setting
   • BChunking the document into smaller sections and processing each separately
   • CSending the entire document and hoping the model handles it
   • DUsing a different model with a smaller context window
   Reveal Solution Discussion Select an answer first
5. 19expert · hard

   A developer is building a chatbot that must handle long conversations. The model has a 4,000-token context window. The developer wants to maintain context over a 10,000-token conversation. Which strategy is most effective?

   • AUse a higher temperature to make the model remember more context.
   • BIncrease the max_tokens parameter to allow a longer response.
   • CSummarize the conversation history periodically and include only the summary with the latest message.
   • DSend the entire conversation history with each new message.
   Reveal Solution Discussion Select an answer first
6. 20foundation · easy

   What is the primary purpose of a context window in a generative AI model?

   • ATo define the maximum number of tokens the model can process in a single request
   • BTo determine the number of layers in the neural network
   • CTo store the model's training data for later retrieval
   • DTo control the randomness of the model's output
   Reveal Solution Discussion Select an answer first