Question 250
An audit of a Cortex-enabled workflow finds the following issue: A financial reporting bot moves to a new model with unknown behavior on complex queries. What measurement should be required at the technical acceptance gate?
Explanation
Correct Answer
“Post-deployment regression metrics, incident response readiness and tested restoration of the last approved version” is supported by this requirement: A financial reporting bot moves to a new model with unknown behavior on complex queries. AI release governance requires measurable risk gates, reproducibility and rollback capabilities. Verify it using post-deployment regression metrics, incident response readiness and tested restoration of the last approved version.
Incorrect Answers
“Frequency of untraceable model changes” would not meet the requirement that a financial reporting bot moves to a new model with unknown behavior on complex queries. AI release governance requires measurable risk gates, reproducibility and rollback capabilities. The more reliable approach is to stage a controlled model or prompt rollout with predeclared quality gates, versioned artifacts and a tested rollback path.
“Visual appeal of one demo instead of comparative correctness” would not meet the requirement that a financial reporting bot moves to a new model with unknown behavior on complex queries. AI release governance requires measurable risk gates, reproducibility and rollback capabilities. The more reliable approach is to stage a controlled model or prompt rollout with predeclared quality gates, versioned artifacts and a tested rollback path.
“Number of complaints received before intervention” would not meet the requirement that a financial reporting bot moves to a new model with unknown behavior on complex queries. AI release governance requires measurable risk gates, reproducibility and rollback capabilities. The more reliable approach is to stage a controlled model or prompt rollout with predeclared quality gates, versioned artifacts and a tested rollback path.