Question 530
A Databricks RAG or agent workflow behaves unexpectedly: A support assistant reveals hidden instructions when users ask it to ignore the normal helpdesk policy. Which diagnostic check has the highest value?
Explanation
Correct Answer
Correct. User-provided instructions may attempt to bypass agent policies or cause data leakage; classification and tool boundaries need separate tests. In the given situation — A support assistant reveals hidden instructions when users ask it to ignore the normal helpdesk policy. — the targeted diagnose action is: Inspect adversarial prompt examples, tool permissions and whether refusals are enforced outside the model. It inspects the stage or constraint most likely to explain the observed failure before changing the system.
Incorrect Answers
Not the strongest diagnose choice for this specific question. Inspect whether the task requires real external state, permitted action or just text transformation. This action primarily relates to Agent tool wrappers versus direct LLM responses: A tool-using agent needs explicit callable interfaces and typed tool results, whereas plain generation requires no action execution. However, the described case — A support assistant reveals hidden instructions when users ask it to ignore the normal helpdesk policy. — is testing Unsafe model output and jailbreak response diagnosis. It does not directly establish the diagnose outcome or constraint that the question requires; it may still be useful in a different stage or incident.
Not the strongest diagnose choice for this specific question. Inspect decoding parameters, expected output variance, schema requirements and task acceptance criteria. This action primarily relates to Temperature and deterministic format tradeoffs: Decoding settings can affect variability and cost but cannot replace validation, grounding or application logic. However, the described case — A support assistant reveals hidden instructions when users ask it to ignore the normal helpdesk policy. — is testing Unsafe model output and jailbreak response diagnosis. It does not directly establish the diagnose outcome or constraint that the question requires; it may still be useful in a different stage or incident.
Not the strongest diagnose choice for this specific question. Inspect parsed intent, extracted keys, authorization check and actual query filter predicates. This action primarily relates to Query-field driven prompt and retrieval filters: User intent and structured fields such as account_id should drive authorized SQL lookups or retrieval filters, not be ignored in free text. However, the described case — A support assistant reveals hidden instructions when users ask it to ignore the normal helpdesk policy. — is testing Unsafe model output and jailbreak response diagnosis. It does not directly establish the diagnose outcome or constraint that the question requires; it may still be useful in a different stage or incident.