Question 170
A consulting firm wants conversational search across approved internal documents and also requests strong permission trimming and source attribution. Which limitation must be considered before claiming the issue is fully resolved?
Explanation
Correct Answer
A plausible model response is not proof that protected sources were excluded. This caution prevents extrapolating beyond the specific evidence or product boundary. AI enhancements require information boundaries and measurable answer quality. The unresolved point should be tested using access-control matrix, retrieval test set and evaluation of cited grounded responses rather than assuming a working interface proves full compliance or resilience.
Incorrect Answers
A cited response proves the source access policy was correctly enforced. This limitation is framed as a blanket exception, but the case requires a different, narrower caution. The relevant boundary is that a plausible model response is not proof that protected sources were excluded. AI enhancements require information boundaries and measurable answer quality. Inspect access-control matrix, retrieval test set and evaluation of cited grounded responses.
Embedding models preserve document permissions automatically without filtering. The proposed claim mistakes an incomplete signal or product feature for a universal guarantee. The relevant boundary is that a plausible model response is not proof that protected sources were excluded. AI enhancements require information boundaries and measurable answer quality. Inspect access-control matrix, retrieval test set and evaluation of cited grounded responses.
Vector search quality and document access control are equivalent metrics. This claim exceeds the evidence and ignores an important risk or operational dependency. The relevant boundary is that a plausible model response is not proof that protected sources were excluded. AI enhancements require information boundaries and measurable answer quality. Inspect access-control matrix, retrieval test set and evaluation of cited grounded responses.