Question 320
At an organization testing AI for a business workflow, an AI project leader faces this situation: A summarization feature passes model tests but employees report its output is too hard to verify. Business value and risks must be compared with simpler alternatives. Which governance precaution best applies to this situation?
Explanation
Correct Answer
In an organization testing AI for a business workflow, the key precaution is: Avoid using satisfaction survey responses as the sole evidence of objective accuracy. The planned action is: Define task completion, editing effort and user satisfaction indicators before pilot rollout. This caution matters because: Successful AI delivery requires observable user utility and satisfaction alongside model metrics. The team should still verify: A representative pilot compares baseline completion effort with assisted work outcomes.
Incorrect Answers
Domain experts must validate problem boundaries and the operational meaning of a successful outcome. The appropriate correction for the reported case is: Define task completion, editing effort and user satisfaction indicators before pilot rollout.
A feasibility review needs explicit no-go criteria so sunk costs do not dictate the chosen solution. Fixing that different mechanism would not address the current root cause: successful AI delivery requires observable user utility and satisfaction alongside model metrics.
AI-specific input channels can carry adversarial content that conventional functional tests may overlook. Its verification is distinct from the reported condition: A summarization feature passes model tests but employees report its output is too hard to verify. Business value and risks must be compared with simpler alternatives.