Question 240
A business team evaluating model-assisted work finds: An AI help-desk developer mixes administrator instructions, user questions and copied customer messages in one undifferentiated prompt and the model sometimes treats customer text as higher-priority operating policy. Which configuration or workflow step should be implemented first?
Explanation
Correct Answer
The main issue is: When high-priority behavior and lower-trust user-supplied content are not separated by clear roles and delimiters, the model may confuse quoted material with governing instructions. The appropriate correction is: Place stable operating constraints in the appropriate high-priority instruction role and mark user-provided evidence as lower-trust data with an explicit task boundary. Verify success by checking: An adversarial customer message is treated as content to summarize and cannot redefine the authorized support-bot policy or output format.
Incorrect Answers
This action addresses tool result text attempts to redirect agent work, whose causal condition is: A tool response is lower-trust observation data even if its format resembles a command; treating it as an instruction can create prompt-injection-driven workflow hijacking. The current scenario instead requires attention to: When high-priority behavior and lower-trust user-supplied content are not separated by clear roles and delimiters, the model may confuse quoted material with governing instructions.
This action addresses few shot examples improve specialized classification, whose causal condition is: Task-specific labeled examples can clarify the intended decision boundary when category names alone are too ambiguous for consistent few-shot classification. In this question the necessary remedy is “Place stable operating constraints in the appropriate high-priority instruction role and mark user-provided evidence as lower-trust data with an explicit task boundary”, which this alternative does not provide.
This action addresses generated answer omits required structured fields, whose causal condition is: Unconstrained natural-language instructions do not reliably impose the exact keys, data types and machine-readable format expected by a downstream parser. The observed condition is an AI help-desk developer mixes administrator instructions, user questions and copied customer messages in one undifferentiated prompt and the model sometimes treats customer text as higher-priority operating policy; this mechanism addresses another problem.