Question 100
After implementing the approved response to: A customer-insights agent returns a polished report but skips a required region in the prompt. Which outcome most directly confirms success?
Explanation
Correct Answer
The revised report covers every required region and reconciles aggregate totals. This result tests whether the response solved the particular situation: A customer-insights agent returns a polished report but skips a required region in the prompt. The proposed control is: Ask the agent to fill the missing region with authoritative source references. Its basis is: Agent outputs need requirements-based acceptance checks rather than appearance-based approval. Even after this result, completion checks can still miss incorrect figures inside a covered region.
Incorrect Answers
The agent uses authorized evidence without revealing restricted material. That outcome would validate the separate task: A user expects a financial-analysis agent to summarize restricted CFO documents that the user cannot access. It does not demonstrate resolution of this case: A customer-insights agent returns a polished report but skips a required region in the prompt. The relevant acceptance test is: The revised report covers every required region and reconciles aggregate totals. It follows from the control: Ask the agent to fill the missing region with authoritative source references.
A reproducible analysis identifies candidate trends with clear assumptions. That outcome would validate the separate task: An operations group wants to explore trends in a structured dataset and distinguish anomalies from normal variation. It does not demonstrate resolution of this case: A customer-insights agent returns a polished report but skips a required region in the prompt. The relevant acceptance test is: The revised report covers every required region and reconciles aggregate totals. It follows from the control: Ask the agent to fill the missing region with authoritative source references.
The user receives the complete requested report rather than a search progress message. That outcome would validate the separate task: A specialized agent reports that it found sources but has not produced the requested briefing. It does not demonstrate resolution of this case: A customer-insights agent returns a polished report but skips a required region in the prompt. The relevant acceptance test is: The revised report covers every required region and reconciles aggregate totals. It follows from the control: Ask the agent to fill the missing region with authoritative source references.