Question 540
The business case is: A customer-help model handles one language well but repeatedly fails another supported language. Select TWO: the appropriate design decision and convincing validation evidence. (Select TWO.)
Explanation
Correct Answers
The intervention for the stated situation A customer-help model handles one language well but repeatedly fails another supported language is: Assess source data and generated outcomes across relevant populations and use corrective governance when performance differs unfairly. It directly mitigates: Biased historical records or unequal error rates can lead to harmful decisions even when overall accuracy looks high.
A separate outcome check for the situation A customer-help model handles one language well but repeatedly fails another supported language is: An equity evaluation reports error and outcome metrics by relevant cohort with documented remediation and oversight. It measures the effect of the selected intervention rather than relying on the existence of a proposal.
Incorrect Answers
This choice addresses postdeployment monitoring and drift; its main associated risk is: A model that passed initial acceptance can deteriorate after source, traffic or product changes without visible errors. However, the situation A customer-help model handles one language well but repeatedly fails another supported language is primarily about bias, fairness and representativeness. The targeted decision is: Assess source data and generated outcomes across relevant populations and use corrective governance when performance differs unfairly.
This choice addresses data-dependency and poor-source limitations; its main associated risk is: A strong model cannot reliably answer questions whose necessary evidence is missing, contradictory or inaccessible. However, the situation A customer-help model handles one language well but repeatedly fails another supported language is primarily about bias, fairness and representativeness. The targeted decision is: Assess source data and generated outcomes across relevant populations and use corrective governance when performance differs unfairly.
This choice addresses evaluation metrics and representative data; its main associated risk is: Optimizing one easy metric can hide incorrect factual claims and failures on rare but important scenarios. However, the situation A customer-help model handles one language well but repeatedly fails another supported language is primarily about bias, fairness and representativeness. The targeted decision is: Assess source data and generated outcomes across relevant populations and use corrective governance when performance differs unfairly.