Question 620
The business case is: A team measures chain-of-thought length as its only reliability metric. Select TWO: the appropriate design decision and convincing validation evidence. (Select TWO.)
Explanation
Correct Answers
The intervention for the stated situation A team measures chain-of-thought length as its only reliability metric is: Use supported reasoning-oriented task decomposition when it improves measurable accuracy, without demanding hidden model reasoning or treating verbosity as proof. It directly mitigates: A verbose rationale can still be wrong and may increase cost or expose unnecessary detail.
A separate outcome check for the situation A team measures chain-of-thought length as its only reliability metric is: An evaluation measures answer correctness and compliance against a concise baseline across challenging problems. It measures the effect of the selected intervention rather than relying on the existence of a proposal.
Incorrect Answers
This choice addresses zero-shot prompting for clear tasks; its main associated risk is: A vague instruction can yield inconsistent output format and give a false impression that the model needs retraining. However, the situation A team measures chain-of-thought length as its only reliability metric is primarily about reasoning-oriented prompt techniques. The targeted decision is: Use supported reasoning-oriented task decomposition when it improves measurable accuracy, without demanding hidden model reasoning or treating verbosity as proof.
This choice addresses role prompting and bounded response style; its main associated risk is: A role instruction can shape language but cannot replace application permissions or professional qualifications. However, the situation A team measures chain-of-thought length as its only reliability metric is primarily about reasoning-oriented prompt techniques. The targeted decision is: Use supported reasoning-oriented task decomposition when it improves measurable accuracy, without demanding hidden model reasoning or treating verbosity as proof.
This choice addresses react and tool-mediated retrieval; its main associated risk is: Unbounded tool loops and trusting retrieved instructions can create repeated calls or unauthorized effects. However, the situation A team measures chain-of-thought length as its only reliability metric is primarily about reasoning-oriented prompt techniques. The targeted decision is: Use supported reasoning-oriented task decomposition when it improves measurable accuracy, without demanding hidden model reasoning or treating verbosity as proof.