Question 460
The business case is: A model upgrade changes output structure but no regression benchmark runs. Select TWO: the appropriate design decision and convincing validation evidence. (Select TWO.)
Explanation
Correct Answers
The intervention for the stated situation A model upgrade changes output structure but no regression benchmark runs is: Include evaluation datasets, model metrics and operational monitoring in the deployment plan for Google Cloud AI applications. It directly mitigates: A prototype that is never measured after release may degrade quietly as models, prompts and source documents change.
A separate outcome check for the situation A model upgrade changes output structure but no regression benchmark runs is: A staged release records output quality, cost, latency and drift using versioned representative tests. It measures the effect of the selected intervention rather than relying on the existence of a proposal.
Incorrect Answers
This choice addresses agent platform managed agent development; its main associated risk is: A platform chosen without testing runtime permissions, capacity and supported agent features may not meet production requirements. However, the situation A model upgrade changes output structure but no regression benchmark runs is primarily about managed evaluation and model monitoring. The targeted decision is: Include evaluation datasets, model metrics and operational monitoring in the deployment plan for Google Cloud AI applications.
This choice addresses agent studio low-code agent prototyping; its main associated risk is: A visually successful demo can hide missing custom integration, access or lifecycle capabilities. However, the situation A model upgrade changes output structure but no regression benchmark runs is primarily about managed evaluation and model monitoring. The targeted decision is: Include evaluation datasets, model metrics and operational monitoring in the deployment plan for Google Cloud AI applications.
This choice addresses operational deployment of custom ai apps; its main associated risk is: A model API alone does not provide a governed production service or a tested recovery path. However, the situation A model upgrade changes output structure but no regression benchmark runs is primarily about managed evaluation and model monitoring. The targeted decision is: Include evaluation datasets, model metrics and operational monitoring in the deployment plan for Google Cloud AI applications.