Question 80
While evaluating AI productivity and governance, staff identify: A long-running support bot drops the oldest messages whenever its context fills, and one of the discarded messages contained essential instructions about the authorized customer account scope. Which design change best satisfies the stated AI workflow requirement?
Explanation
Correct Answer
The main issue is: Naive conversation truncation can remove governing context as well as irrelevant history, changing model behavior despite an otherwise identical user question. The appropriate correction is: Keep stable system and authorization constraints outside disposable chat history and summarize only noncritical conversation facts using a controlled approach. Verify success by checking: A long test conversation preserves tenant-specific restrictions after many turns while still fitting the model context limit.
Incorrect Answers
This action addresses output token cap truncates structured answer, whose causal condition is: The model's output token allowance can stop generation before a structured response is complete, independent of whether the prompt fits the input context. The current scenario instead requires attention to: Naive conversation truncation can remove governing context as well as irrelevant history, changing model behavior despite an otherwise identical user question.
This action addresses edge device memory too small for selected language model, whose causal condition is: An offline model still requires local storage and working memory for model weights and inference context, which resource-constrained edge devices may not provide. In this question the necessary remedy is “Keep stable system and authorization constraints outside disposable chat history and summarize only noncritical conversation facts using a controlled approach”, which this alternative does not provide.
This action addresses prompt context exceeds model token window, whose causal condition is: A language model has a finite combined context budget for instructions, conversation, retrieved text and often generated output, so unlimited source concatenation is not supported. The observed condition is a long-running support bot drops the oldest messages whenever its context fills, and one of the discarded messages contained essential instructions about the authorized customer account scope; this mechanism addresses another problem.