Question 150
A production Snowflake Gen AI workflow must handle the following: A contract extraction task requires stable field labels on repeated invoices. Before accepting the change, what evidence most directly demonstrates that the intended outcome was achieved?
Explanation
Correct Answer
“Answer variance across repeated prompts plus independent factual and policy-compliance review” is supported by this requirement: A contract extraction task requires stable field labels on repeated invoices. Sampling controls influence output variation but do not guarantee truth, compliance or deterministic runtime behavior. Verify it using answer variance across repeated prompts plus independent factual and policy-compliance review.
Incorrect Answers
“Creative vocabulary diversity as the only success criterion” would not meet the requirement that a contract extraction task requires stable field labels on repeated invoices. Sampling controls influence output variation but do not guarantee truth, compliance or deterministic runtime behavior. The more reliable approach is to evaluate lower-randomness generation settings for consistency while checking facts and source grounding separately.
“Consistency alone without checking whether the repeated answer is false” would not meet the requirement that a contract extraction task requires stable field labels on repeated invoices. Sampling controls influence output variation but do not guarantee truth, compliance or deterministic runtime behavior. The more reliable approach is to evaluate lower-randomness generation settings for consistency while checking facts and source grounding separately.
“One response sample from one model configuration” would not meet the requirement that a contract extraction task requires stable field labels on repeated invoices. Sampling controls influence output variation but do not guarantee truth, compliance or deterministic runtime behavior. The more reliable approach is to evaluate lower-randomness generation settings for consistency while checking facts and source grounding separately.