Question 60
At a product launch with privacy and security stakeholders, an AI project leader faces this situation: An internal investigation cannot tell who altered a held-out validation sample after the initial review. The response should respect the organization's actual data and review obligations. Which situation is this mechanism intended to address?
Explanation
Correct Answer
In a product launch with privacy and security stakeholders, this is the matching use case: Use chain-of-custody controls for protected model evaluation and incident evidence. The reason is: Data provenance and controlled handling maintain confidence in evidence used to evaluate disputed AI outcomes. In the reported scenario, an internal investigation cannot tell who altered a held-out validation sample after the initial review. The appropriate action is: Log access and transformations for protected evaluation snapshots and preserve their hashes.
Incorrect Answers
Auditable model selection requires documented evaluation criteria and the decision's rationale. The appropriate correction for the reported case is: Log access and transformations for protected evaluation snapshots and preserve their hashes.
AI pipeline logs and derived features can retain personal information after the original use ends. Fixing that different mechanism would not address the current root cause: data provenance and controlled handling maintain confidence in evidence used to evaluate disputed AI outcomes.
Ongoing compliance is demonstrated through auditable controls, ownership, exceptions and evidence. Its verification is distinct from the reported condition: An internal investigation cannot tell who altered a held-out validation sample after the initial review. The response should respect the organization's actual data and review obligations.