Question 350
While evaluating AI productivity and governance, staff identify: A reporting workflow first asks a model to extract numbers from a document and then asks another model to write a financial narrative, but malformed extraction JSON propagates into fabricated totals. What ongoing safety or quality safeguard is most appropriate?
Explanation
Correct Answer
This safeguard addresses chained prompt stage propagates invalid intermediate output: Add contract tests between chained prompt stages and record which source fields supported each computed claim. The prevented failure mechanism is: A multi-stage prompt chain is only reliable when intermediate outputs satisfy explicit schemas and data validation before downstream stages use them. A control for an unrelated service cannot establish the required protection.
Incorrect Answers
Embedding credentials in prompts exposes them to inference processing, retention and logging paths independently of whether the model ever repeats them in its answer. “Run prompt and trace secret scanning whenever publishing shared prompt templates or examples for model-assisted tools” would remedy that alternative situation, but it would not correct the present issue: a multi-stage prompt chain is only reliable when intermediate outputs satisfy explicit schemas and data validation before downstream stages use them.
“Review few-shot examples for demographic and language balance rather than treating one small illustrative set as a full benchmark” is the supported response when a narrow few-shot example set can bias the task framing and misrepresent the range of legitimate user expression for the same underlying label. Here the decisive response is “Add contract tests between chained prompt stages and record which source fields supported each computed claim”, so that different intervention does not meet the stated requirement.
Image generation depends on clear modality-specific requirements; a vague request leaves composition, legibility and delivery constraints insufficiently defined. “Maintain visual prompt templates with measurable layout checks and reject outputs that do not meet required accessibility and brand constraints” applies to that other condition. The reported evidence is a reporting workflow first asks a model to extract numbers from a document and then asks another model to write a financial narrative, but malformed extraction JSON propagates into fabricated totals; this alternative would address the wrong dependency.