Question 50
A business team evaluating model-assisted work finds: A compliance assistant lists authoritative-looking page references in its answers, but auditors find that some page numbers were invented and not present in the retrieval response. What assurance check should be required for future changes?
Explanation
Correct Answer
This safeguard addresses rag generated citations do not match retrieved passages: Automate citation existence and evidence-match checks before publishing AI-generated compliance summaries. The prevented failure mechanism is: A model can produce plausible citation text without a reliable mapping to actual retrieved source identifiers, so generated reference claims require validation. A control for an unrelated service cannot establish the required protection.
Incorrect Answers
Approximate vector indexes can trade candidate recall for lower retrieval latency, so fast queries alone cannot establish acceptable semantic search quality. “Monitor retrieval recall and latency together as corpus size, embedding distribution and index settings change” would remedy that alternative situation, but it would not correct the present issue: a model can produce plausible citation text without a reliable mapping to actual retrieved source identifiers, so generated reference claims require validation.
“Keep adversarial cross-tenant retrieval fixtures and audit metadata authorization whenever changing RAG indexing or query pipelines” is the supported response when similarity rankings do not themselves authorize access, so cross-tenant filters must be applied in the trusted retrieval path before retrieved context reaches the model. Here the decisive response is “Automate citation existence and evidence-match checks before publishing AI-generated compliance summaries”, so that different intervention does not meet the stated requirement.
Refreshing a source document does not necessarily reprocess its chunks, embeddings or search index, so retrieved evidence may remain stale after an upstream update. “Monitor ingestion lag and index version against source document revisions as part of RAG content freshness objectives” applies to that other condition. The reported evidence is a compliance assistant lists authoritative-looking page references in its answers, but auditors find that some page numbers were invented and not present in the retrieval response; this alternative would address the wrong dependency.