Question 630
A reviewer is challenging several proposals for this case: A medical triage model shows good overall accuracy but almost no validation cases for a small language group. Which proposal should be rejected because it most directly violates the case's control objective?
Explanation
Correct Answer
High aggregate performance does not establish acceptable outcomes for underrepresented people. “Authorize universal deployment based only on the pooled average accuracy.” would not meet the stated operational condition. Require subgroup performance evidence and limitations before use for that group. Review stratified sample counts, calibration and error intervals by group.
Incorrect Answers
“Document the model evaluation without minorities decision, its owner, limitations and a review date before closure.” records a controlled change and supports accountable evaluation. High aggregate performance does not establish acceptable outcomes for underrepresented people. Review stratified sample counts, calibration and error intervals by group.
Require subgroup performance evidence and limitations before use for that group. High aggregate performance does not establish acceptable outcomes for underrepresented people. Review stratified sample counts, calibration and error intervals by group.
Review stratified sample counts, calibration and error intervals by group. High aggregate performance does not establish acceptable outcomes for underrepresented people. Require subgroup performance evidence and limitations before use for that group.