Question 460
A retrieval pipeline sends 30 redundant paragraphs to a small context window, truncating the one passage needed. Initial testing shows: Critical evidence appears in the model context and grounded answers improve. Which limitation should the team still consider?
Explanation
Correct Answer
Shorter context may omit important caveats if chunking is too aggressive. Prompt context selection should account for model token budget and evidence ranking. Rerank/deduplicate passages and reserve a budget for instructions and answers.
Incorrect Answers
Deduplicate, rank and budget evidence so the decisive passage survives the context limit.
Measure grounded claims and citations on actual context, not fluency or retrieved count.
Control duplicate evidence and token budget; optimize selection for relevance and diversity. The genuine residual limitation is: Shorter context may omit important caveats if chunking is too aggressive.