Question 230
While evaluating AI productivity and governance, staff identify: A support knowledge search migrates from exact cosine comparisons to a highly constrained approximate nearest-neighbor index and repeatedly misses documents that are known matches. What ongoing safety or quality safeguard is most appropriate?
Explanation
Correct Answer
This safeguard addresses approximate vector search fails required recall threshold: Monitor retrieval recall and latency together as corpus size, embedding distribution and index settings change. The prevented failure mechanism is: Approximate vector indexes can trade candidate recall for lower retrieval latency, so fast queries alone cannot establish acceptable semantic search quality. A control for an unrelated service cannot establish the required protection.
Incorrect Answers
Vector databases and indexes expect vectors with compatible dimensionality and metric semantics; changing the embedding model can invalidate existing index assumptions. “Version the embedding model and vector schema as one deployable contract and validate dimension compatibility in integration tests” would remedy that alternative situation, but it would not correct the present issue: approximate vector indexes can trade candidate recall for lower retrieval latency, so fast queries alone cannot establish acceptable semantic search quality.
“Monitor ingestion lag and index version against source document revisions as part of RAG content freshness objectives” is the supported response when refreshing a source document does not necessarily reprocess its chunks, embeddings or search index, so retrieved evidence may remain stale after an upstream update. Here the decisive response is “Monitor retrieval recall and latency together as corpus size, embedding distribution and index settings change”, so that different intervention does not meet the stated requirement.
A model can produce plausible citation text without a reliable mapping to actual retrieved source identifiers, so generated reference claims require validation. “Automate citation existence and evidence-match checks before publishing AI-generated compliance summaries” applies to that other condition. The reported evidence is a support knowledge search migrates from exact cosine comparisons to a highly constrained approximate nearest-neighbor index and repeatedly misses documents that are known matches; this alternative would address the wrong dependency.