Question 260
During a functional test, the implementation team observes this scenario: A product support chatbot loses critical exceptions when only the first result is used. Which result should determine whether the implementation can proceed?
Explanation
Correct Answer
“Relevant-passage recall at k, irrelevant-context rate, answer quality and model-token cost” is supported by this requirement: A product support chatbot loses critical exceptions when only the first result is used. Retrieval-depth decisions trade off answer evidence, noise and context expenditure. Verify it using relevant-passage recall at k, irrelevant-context rate, answer quality and model-token cost.
Incorrect Answers
“Raw index storage volume alone” would not meet the requirement that a product support chatbot loses critical exceptions when only the first result is used. Retrieval-depth decisions trade off answer evidence, noise and context expenditure. The more reliable approach is to tune top-k retrieval and any reranking based on measured recall, precision, cost and final answer quality.
“Single-passage retrieval count even when evidence spans multiple files” would not meet the requirement that a product support chatbot loses critical exceptions when only the first result is used. Retrieval-depth decisions trade off answer evidence, noise and context expenditure. The more reliable approach is to tune top-k retrieval and any reranking based on measured recall, precision, cost and final answer quality.
“Maximum number of returned passages with no ranking relevance” would not meet the requirement that a product support chatbot loses critical exceptions when only the first result is used. Retrieval-depth decisions trade off answer evidence, noise and context expenditure. The more reliable approach is to tune top-k retrieval and any reranking based on measured recall, precision, cost and final answer quality.