Question 430
A Cortex implementation engineer receives the following request: A regulated manufacturing report generator must be consistent without inventing evidence. Before accepting the change, what evidence most directly demonstrates that the intended outcome was achieved?
Explanation
Correct Answer
“Answer variance across repeated prompts plus independent factual and policy-compliance review” is supported by this requirement: A regulated manufacturing report generator must be consistent without inventing evidence. Sampling controls influence output variation but do not guarantee truth, compliance or deterministic runtime behavior. Verify it using answer variance across repeated prompts plus independent factual and policy-compliance review.
Incorrect Answers
“One response sample from one model configuration” would not meet the requirement that a regulated manufacturing report generator must be consistent without inventing evidence. Sampling controls influence output variation but do not guarantee truth, compliance or deterministic runtime behavior. The more reliable approach is to evaluate lower-randomness generation settings for consistency while checking facts and source grounding separately.
“Consistency alone without checking whether the repeated answer is false” would not meet the requirement that a regulated manufacturing report generator must be consistent without inventing evidence. Sampling controls influence output variation but do not guarantee truth, compliance or deterministic runtime behavior. The more reliable approach is to evaluate lower-randomness generation settings for consistency while checking facts and source grounding separately.
“Creative vocabulary diversity as the only success criterion” would not meet the requirement that a regulated manufacturing report generator must be consistent without inventing evidence. Sampling controls influence output variation but do not guarantee truth, compliance or deterministic runtime behavior. The more reliable approach is to evaluate lower-randomness generation settings for consistency while checking facts and source grounding separately.