Question 320
Before funding a Gen AI deployment, a sponsor asks about this use case: A research chat app must restrict unreleased reports to authorized analysts. What measurement should be required at the technical acceptance gate?
Explanation
Correct Answer
“Blocked unauthorized access attempts plus successful authorized workflows and auditable tool invocation boundaries” is supported by this requirement: A research chat app must restrict unreleased reports to authorized analysts. A model can describe a policy but only security controls can enforce data access. Verify it using blocked unauthorized access attempts plus successful authorized workflows and auditable tool invocation boundaries.
Incorrect Answers
“Only chatbot helpfulness ratings from administrators” would not meet the requirement that a research chat app must restrict unreleased reports to authorized analysts. A model can describe a policy but only security controls can enforce data access. The more reliable approach is to keep user-facing AI capabilities behind a role-scoped service and validate tool parameters and permitted datasets.
“The number of unrestricted queries executed” would not meet the requirement that a research chat app must restrict unreleased reports to authorized analysts. A model can describe a policy but only security controls can enforce data access. The more reliable approach is to keep user-facing AI capabilities behind a role-scoped service and validate tool parameters and permitted datasets.
“Volume of detailed secrets captured in public logs” would not meet the requirement that a research chat app must restrict unreleased reports to authorized analysts. A model can describe a policy but only security controls can enforce data access. The more reliable approach is to keep user-facing AI capabilities behind a role-scoped service and validate tool parameters and permitted datasets.