Question 710
A retrieval evaluator computes Precision@5 by counting five relevant documents returned, but one is the same source repeated under five different chunk IDs. What should the metric implementation consider?
Explanation
Correct Answer
Metrics must reflect the chosen relevance unit; redundant chunks are not five independent documents or facts.
Incorrect Answers
Token output size is not retrieval coverage.
Using the system's own results as truth biases evaluation.
Counting duplicates as distinct overstates diversity.