Question 560
The business case is: A sponsor wants adaptation without any measurable baseline or labeled evaluation set. Select TWO: the appropriate design decision and convincing validation evidence. (Select TWO.)
Explanation
Correct Answers
The intervention for the stated situation A sponsor wants adaptation without any measurable baseline or labeled evaluation set is: Start with clear instructions, representative examples and grounding before considering costly task-specific model adaptation. It directly mitigates: Fine-tuning to compensate for missing current facts or poor requirements can bake outdated errors into a model.
A separate outcome check for the situation A sponsor wants adaptation without any measurable baseline or labeled evaluation set is: A controlled study compares baseline instructions, grounded context and any justified customization on unseen cases. It measures the effect of the selected intervention rather than relying on the existence of a proposal.
Incorrect Answers
This choice addresses evaluation metrics and representative data; its main associated risk is: Optimizing one easy metric can hide incorrect factual claims and failures on rare but important scenarios. However, the situation A sponsor wants adaptation without any measurable baseline or labeled evaluation set is primarily about prompt improvements before fine-tuning. The targeted decision is: Start with clear instructions, representative examples and grounding before considering costly task-specific model adaptation.
This choice addresses human-in-the-loop for high-impact outputs; its main associated risk is: A generative system given unilateral decision authority can approve unsafe or inaccurate changes based on plausible text. However, the situation A sponsor wants adaptation without any measurable baseline or labeled evaluation set is primarily about prompt improvements before fine-tuning. The targeted decision is: Start with clear instructions, representative examples and grounding before considering costly task-specific model adaptation.
This choice addresses knowledge cutoff and changing external facts; its main associated risk is: A model's training information may not reflect current prices, regulations, releases or world events. However, the situation A sponsor wants adaptation without any measurable baseline or labeled evaluation set is primarily about prompt improvements before fine-tuning. The targeted decision is: Start with clear instructions, representative examples and grounding before considering costly task-specific model adaptation.