Question 310
An agentic AI adoption exercise reports: A policy chatbot receives a question about an unpublished reimbursement threshold and confidently invents a number even though the retrieval stage found no matching policy passage. Which monitoring control would best limit this AI workflow risk?
Explanation
Correct Answer
This safeguard addresses answer hallucinates source when no evidence was retrieved: Maintain no-answer fixtures and monitor unsupported-claim rates rather than measuring only fluent or confident response text. The prevented failure mechanism is: A model can generate plausible statements without evidence, and a prompt that demands a definitive answer can suppress appropriate uncertainty. A control for an unrelated service cannot establish the required protection.
Incorrect Answers
A narrow few-shot example set can bias the task framing and misrepresent the range of legitimate user expression for the same underlying label. “Review few-shot examples for demographic and language balance rather than treating one small illustrative set as a full benchmark” would remedy that alternative situation, but it would not correct the present issue: a model can generate plausible statements without evidence, and a prompt that demands a definitive answer can suppress appropriate uncertainty.
“Add retrieved-document prompt-injection fixtures to RAG evaluation and monitor suspicious instruction-like spans in external content” is the supported response when retrieved webpages and documents are untrusted task data; instructions inside them do not have the authority of the system or application developer. Here the decisive response is “Maintain no-answer fixtures and monitor unsupported-claim rates rather than measuring only fluent or confident response text”, so that different intervention does not meet the stated requirement.
A tool response is lower-trust observation data even if its format resembles a command; treating it as an instruction can create prompt-injection-driven workflow hijacking. “Use tool-output injection tests and action-level authorization checks before expanding agent tool access” applies to that other condition. The reported evidence is a policy chatbot receives a question about an unpublished reimbursement threshold and confidently invents a number even though the retrieval stage found no matching policy passage; this alternative would address the wrong dependency.