Question 290
While evaluating AI productivity and governance, staff identify: An analyst evaluates an AI-assisted incident classifier on a dataset with nearly all benign records and reports very high accuracy although almost every true incident is missed. Which design change best satisfies the stated AI workflow requirement?
Explanation
Correct Answer
The main issue is: Overall classification accuracy can conceal poor minority-class recall when the source distribution is highly imbalanced. The appropriate correction is: Assess class-specific precision, recall and confusion matrices and select an evaluation metric aligned with the incident-detection use case. Verify success by checking: A held-out set with known rare incidents reveals the missed-positive rate, and model selection considers that rate rather than accuracy alone.
Incorrect Answers
This action addresses brainstorming output treated as validated research evidence, whose causal condition is: Creative ideation can generate plausible hypotheses but does not by itself establish empirical findings or causal evidence about actual users. The current scenario instead requires attention to: Overall classification accuracy can conceal poor minority-class recall when the source distribution is highly imbalanced.
This action addresses exploratory analysis outlier mistaken for overall trend, whose causal condition is: Exploratory data analysis must distinguish distributional patterns from outliers, and a mean alone can be misleading when values are strongly skewed. In this question the necessary remedy is “Assess class-specific precision, recall and confusion matrices and select an evaluation metric aligned with the incident-detection use case”, which this alternative does not provide.
This action addresses duplicate survey records inflate ai generated insight, whose causal condition is: Joining or concatenating data without stable deduplication keys can count one response multiple times and distort inferred population trends. The observed condition is an analyst evaluates an AI-assisted incident classifier on a dataset with nearly all benign records and reports very high accuracy although almost every true incident is missed; this mechanism addresses another problem.