Question 390
Before accepting this AI feature, reviewers note: A document assistant includes hundreds of manual pages, chat history and the requested answer in a single prompt, and the model endpoint rejects the input as exceeding its context limit. Which supported corrective action most directly addresses this problem?
Explanation
Correct Answer
The main issue is: A language model has a finite combined context budget for instructions, conversation, retrieved text and often generated output, so unlimited source concatenation is not supported. The appropriate correction is: Estimate tokens before invocation and select or summarize relevant passages with an explicit output allowance inside the model's supported window. Verify success by checking: A representative oversized manual request is reduced to a valid token budget and still answers a question using relevant supplied passages.
Incorrect Answers
This action addresses multimodal invoice interpretation excludes embedded chart images, whose causal condition is: A text-only representation may omit layout and visual evidence that is necessary to interpret scanned content, so a multimodal or OCR-supported process can be required. The current scenario instead requires attention to: A language model has a finite combined context budget for instructions, conversation, retrieved text and often generated output, so unlimited source concatenation is not supported.
This action addresses output token cap truncates structured answer, whose causal condition is: The model's output token allowance can stop generation before a structured response is complete, independent of whether the prompt fits the input context. In this question the necessary remedy is “Estimate tokens before invocation and select or summarize relevant passages with an explicit output allowance inside the model's supported window”, which this alternative does not provide.
This action addresses edge device memory too small for selected language model, whose causal condition is: An offline model still requires local storage and working memory for model weights and inference context, which resource-constrained edge devices may not provide. The observed condition is a document assistant includes hundreds of manual pages, chat history and the requested answer in a single prompt, and the model endpoint rejects the input as exceeding its context limit; this mechanism addresses another problem.