mcAfee Secure Website
23

Databricks Certified Generative AI Engineer Associate Bundle

Exam Code: Certified Generative AI Engineer Associate

Exam Name Certified Generative AI Engineer Associate

Certification Provider: Databricks

Corresponding Certification: Databricks Certified Generative AI Engineer Associate

Certified Generative AI Engineer Associate Training Materials $19.99

Reliable & Actual Study Materials for Certified Generative AI Engineer Associate Exam Success

The Latest Certified Generative AI Engineer Associate Exam Questions as Experienced in the Actual Test!

  • 24
    Questions & Answers

    Certified Generative AI Engineer Associate Questions & Answers

    123 Questions & Answers

    Includes questions types found on actual exam such as drag and drop, simulation, type in, and fill in the blank.

  • exam =30
    Study Guide

    Certified Generative AI Engineer Associate Study Guide

    230 PDF Pages

    Study Guide developed by industry experts who have written exams in the past. They are technology-specific IT certification researchers with at least a decade of experience at Fortune 500 companies.

exam =32

Certified Generative AI Engineer Associate Practice Tests

Guarantee

Satisfaction Guaranteed

Pass4sure has a remarkable Databricks Candidate Success record. We're confident of our products and provide no hassle product exchange. That's how confident we are!

99.3% Pass Rate
Total Cost: $154.98
Bundle Price: $134.99

Purchase Individually

  • exam =34
    Questions & Answers

    Questions & Answers

    123 Questions

    $124.99
    exam =35
  • exam =36
    Study Guide

    Study Guide

    230 PDF Pages

    $29.99

Databricks Certified Generative AI Engineer Associate Practice Test 50

Question 490

For a Databricks GenAI application, consider this situation: A fraud triage team needs a fixed risk category for each ticket, not a newly written customer letter. What should the engineer implement FIRST?

  1. Call a structured order-status tool for transaction fields and retrieve policy text before composing a grounded response.
  2. Use a evaluated classification model and return a bounded label with confidence/abstention handling.
  3. Configure a Knowledge Assistant over approved documents and validate source attribution and group permissions.
  4. Define the equipment identifiers, failure observations and inventory query as required inputs, with approved part IDs as outputs.

Explanation

Correct Answer

B:

Correct. Classification predicts a category whereas summarization compresses meaning; the desired output determines the appropriate task. In the given situation — A fraud triage team needs a fixed risk category for each ticket, not a newly written customer letter. — the targeted implement action is: Use a evaluated classification model and return a bounded label with confidence/abstention handling. This directly meets the stated workflow constraint instead of addressing an adjacent capability.

Incorrect Answers

A:

Not the strongest implement choice for this specific question. Call a structured order-status tool for transaction fields and retrieve policy text before composing a grounded response. This action primarily relates to Parallel retrieval and deterministic chain postprocessing: Combining structured lookup and semantic retrieval requires explicit routing, result joining, and downstream schema checks. However, the described case — A fraud triage team needs a fixed risk category for each ticket, not a newly written customer letter. — is testing Task choice: classification versus generative summarization. It does not directly establish the implement outcome or constraint that the question requires; it may still be useful in a different stage or incident.

C:

Not the strongest implement choice for this specific question. Configure a Knowledge Assistant over approved documents and validate source attribution and group permissions. This action primarily relates to Agent Bricks Knowledge Assistant suitability: A governed knowledge assistant grounds conversational responses in curated documents and access-controlled retrieval. However, the described case — A fraud triage team needs a fixed risk category for each ticket, not a newly written customer letter. — is testing Task choice: classification versus generative summarization. It does not directly establish the implement outcome or constraint that the question requires; it may still be useful in a different stage or incident.

D:

Not the strongest implement choice for this specific question. Define the equipment identifiers, failure observations and inventory query as required inputs, with approved part IDs as outputs. This action primarily relates to Translate use-case requirements into pipeline inputs and outputs: Business acceptance criteria must map to concrete source inputs, generated fields, correctness measures and permission constraints. However, the described case — A fraud triage team needs a fixed risk category for each ticket, not a newly written customer letter. — is testing Task choice: classification versus generative summarization. It does not directly establish the implement outcome or constraint that the question requires; it may still be useful in a different stage or incident.

Question 491 (Select TWO)

Select TWO: the immediate change and one ongoing control for this Databricks GenAI case. An internal parts bot misses exact serial number ZX-410 because embeddings match only conceptual part descriptions.

  1. Combine keyword matching and vector similarity with model/tenant filters and calibrated score fusion.
  2. Strip template boilerplate, repeated navigation and low-information text before embedding.
  3. Never assume embedding similarity alone is a security boundary or reliable exact identifier lookup.
  4. Use a frozen relevance dataset to prevent tuning to a single cherry-picked query.

Explanation

Correct Answers

A:

Correct (immediate corrective action). Combine keyword matching and vector similarity with model/tenant filters and calibrated score fusion. In this scenario, An internal parts bot misses exact serial number ZX-410 because embeddings match only conceptual part descriptions. The governing mechanism is: Hybrid search combines lexical exact-match and semantic similarity; metadata filtering narrows authorized relevant content. One selected option addresses the immediate workflow, while the other guards the same failure mode after deployment. Both satisfy the TWO-part requirement.

C:

Correct (continuing risk control). Never assume embedding similarity alone is a security boundary or reliable exact identifier lookup. In this scenario, An internal parts bot misses exact serial number ZX-410 because embeddings match only conceptual part descriptions. The governing mechanism is: Hybrid search combines lexical exact-match and semantic similarity; metadata filtering narrows authorized relevant content. One selected option addresses the immediate workflow, while the other guards the same failure mode after deployment. Both satisfy the TWO-part requirement.

Incorrect Answers

B:

Not the strongest safeguard choice for this specific question. Strip template boilerplate, repeated navigation and low-information text before embedding. This action primarily relates to Boilerplate and navigation filtering in source corpora: Duplicated headers, disclaimers and navigation menus contaminate embeddings and cause irrelevant hits. However, the described case — An internal parts bot misses exact serial number ZX-410 because embeddings match only conceptual part descriptions. — is testing Hybrid sparse and dense retrieval with filters. It does not directly establish the safeguard outcome or constraint that the question requires; it may still be useful in a different stage or incident.

D:

Not the strongest safeguard choice for this specific question. Use a frozen relevance dataset to prevent tuning to a single cherry-picked query. This action primarily relates to Retrieval recall precision and ranking diagnostics: Measure hit recall, precision, MRR or nDCG on labeled query-to-relevant-chunk pairs before tuning retrieval. However, the described case — An internal parts bot misses exact serial number ZX-410 because embeddings match only conceptual part descriptions. — is testing Hybrid sparse and dense retrieval with filters. It does not directly establish the safeguard outcome or constraint that the question requires; it may still be useful in a different stage or incident.

Question 492

For a Databricks GenAI application, consider this situation: A parts catalog stores component numbers as strings while retrieval loses manufacturer and model columns. What should the engineer implement FIRST?

  1. Choose coherent chunks large enough to keep cause and remedy together without exceeding embedding limits.
  2. Rerank a sufficiently broad candidate pool then pass a smaller high-relevance set to the LLM.
  3. Connect the authorized live shipment-tracking record keyed by order ID rather than guessing arrival from policy.
  4. Include part number and model metadata in each searchable row and filter by approved product line.

Explanation

Correct Answer

D:

Correct. Tabular rows need headers, units and column semantics preserved when transformed into retrieval documents. In the given situation — A parts catalog stores component numbers as strings while retrieval loses manufacturer and model columns. — the targeted implement action is: Include part number and model metadata in each searchable row and filter by approved product line. This directly meets the stated workflow constraint instead of addressing an adjacent capability.

Incorrect Answers

A:

Not the strongest implement choice for this specific question. Choose coherent chunks large enough to keep cause and remedy together without exceeding embedding limits. This action primarily relates to Chunk size and overlap tradeoffs: Chunk size determines the number of vectors and coherence; overlap reduces boundary loss but increases index size and cost. However, the described case — A parts catalog stores component numbers as strings while retrieval loses manufacturer and model columns. — is testing Table-aware chunking and metadata-rich retrieval. It does not directly establish the implement outcome or constraint that the question requires; it may still be useful in a different stage or incident.

B:

Not the strongest implement choice for this specific question. Rerank a sufficiently broad candidate pool then pass a smaller high-relevance set to the LLM. This action primarily relates to Cross-encoder reranking after candidate retrieval: A reranker scores query-document relevance over a candidate set; it improves ordering but does not add missing documents. However, the described case — A parts catalog stores component numbers as strings while retrieval loses manufacturer and model columns. — is testing Table-aware chunking and metadata-rich retrieval. It does not directly establish the implement outcome or constraint that the question requires; it may still be useful in a different stage or incident.

C:

Not the strongest implement choice for this specific question. Connect the authorized live shipment-tracking record keyed by order ID rather than guessing arrival from policy. This action primarily relates to Authoritative source coverage for factual answers: A RAG model cannot answer accurately if the required authoritative record is missing or stale in its index. However, the described case — A parts catalog stores component numbers as strings while retrieval loses manufacturer and model columns. — is testing Table-aware chunking and metadata-rich retrieval. It does not directly establish the implement outcome or constraint that the question requires; it may still be useful in a different stage or incident.

Question 493

After the immediate fix, what safeguard should remain in the release policy? A team declares a new assistant better but cannot identify which prompt or model version generated the winning score.

  1. Recheck license and data handling when replacing proprietary with open-weight models.
  2. Never compare metrics from non-equivalent data snapshots as if they were a paired model test.
  3. Never use persuasive phrasing or a citation marker as evidence that a generated statement is true.
  4. Keep component roles explicit so updates to a generation model do not silently alter retrieval vectors.

Explanation

Correct Answer

B:

Correct. MLflow experiments should retain prompt, model, dataset, parameters and evaluation outputs to support a defensible comparison. In the given situation — A team declares a new assistant better but cannot identify which prompt or model version generated the winning score. — the targeted safeguard action is: Never compare metrics from non-equivalent data snapshots as if they were a paired model test. It preserves an enduring engineering or governance boundary after the current issue is fixed.

Incorrect Answers

A:

Not the strongest safeguard choice for this specific question. Recheck license and data handling when replacing proprietary with open-weight models. This action primarily relates to Open model license versus managed endpoint obligations: Model availability on a hub does not itself confer commercial training, redistribution or hosting rights. However, the described case — A team declares a new assistant better but cannot identify which prompt or model version generated the winning score. — is testing Experiment tracking and version reproducibility. It does not directly establish the safeguard outcome or constraint that the question requires; it may still be useful in a different stage or incident.

C:

Not the strongest safeguard choice for this specific question. Never use persuasive phrasing or a citation marker as evidence that a generated statement is true. This action primarily relates to Hallucinated facts and unsupported citations: Fluent responses can invent facts and citations; faithfulness must be checked against supplied evidence, not writing style. However, the described case — A team declares a new assistant better but cannot identify which prompt or model version generated the winning score. — is testing Experiment tracking and version reproducibility. It does not directly establish the safeguard outcome or constraint that the question requires; it may still be useful in a different stage or incident.

D:

Not the strongest safeguard choice for this specific question. Keep component roles explicit so updates to a generation model do not silently alter retrieval vectors. This action primarily relates to Specialized model versus general LLM: Embedding, reranking, extraction and generative models solve different stages and should be evaluated for their actual role. However, the described case — A team declares a new assistant better but cannot identify which prompt or model version generated the winning score. — is testing Experiment tracking and version reproducibility. It does not directly establish the safeguard outcome or constraint that the question requires; it may still be useful in a different stage or incident.

Question 494 (Select TWO)

Select TWO: the immediate change and one ongoing control for this Databricks GenAI case. A product assistant must answer only for the model and country selected in the user form.

  1. Extract model/country fields and apply them as verified metadata filters to approved retrieval.
  2. Never trust an LLM-extracted customer identifier without server-side permission validation.
  3. Expire or segregate conversation memory by identity and purpose, especially for financial and personal records.
  4. Increase coherent chunk context or parent expansion, then compare answer coverage to the earlier chunking strategy.

Explanation

Correct Answers

A:

Correct (immediate corrective action). Extract model/country fields and apply them as verified metadata filters to approved retrieval. In this scenario, A product assistant must answer only for the model and country selected in the user form. The governing mechanism is: User intent and structured fields such as account_id should drive authorized SQL lookups or retrieval filters, not be ignored in free text. One selected option addresses the immediate workflow, while the other guards the same failure mode after deployment. Both satisfy the TWO-part requirement.

B:

Correct (continuing risk control). Never trust an LLM-extracted customer identifier without server-side permission validation. In this scenario, A product assistant must answer only for the model and country selected in the user form. The governing mechanism is: User intent and structured fields such as account_id should drive authorized SQL lookups or retrieval filters, not be ignored in free text. One selected option addresses the immediate workflow, while the other guards the same failure mode after deployment. Both satisfy the TWO-part requirement.

Incorrect Answers

C:

Not the strongest safeguard choice for this specific question. Expire or segregate conversation memory by identity and purpose, especially for financial and personal records. This action primarily relates to Conversation context and intent routing: Multi-turn assistants need explicit conversational state while routing each new request to the correct tool or topic. However, the described case — A product assistant must answer only for the model and country selected in the user form. — is testing Query-field driven prompt and retrieval filters. It does not directly establish the safeguard outcome or constraint that the question requires; it may still be useful in a different stage or incident.

D:

Not the strongest safeguard choice for this specific question. Increase coherent chunk context or parent expansion, then compare answer coverage to the earlier chunking strategy. This action primarily relates to Chunk quality evaluation and boundary splitting: Retrieval failure can arise from overly small chunks that omit needed context or overly large chunks that dilute relevance. However, the described case — A product assistant must answer only for the model and country selected in the user form. — is testing Query-field driven prompt and retrieval filters. It does not directly establish the safeguard outcome or constraint that the question requires; it may still be useful in a different stage or incident.

Question 495 (Select TWO)

Select TWO: the immediate change and one ongoing control for this Databricks GenAI case. An employee asks first about leave policy, then about their leave balance, and the chain keeps searching policy text only.

  1. Classify current turn intent and route balances to authorized structured lookup rather than policy-only search.
  2. Treat the page as untrusted evidence and enforce tool authorization and destination allowlists on the server.
  3. Expire or segregate conversation memory by identity and purpose, especially for financial and personal records.
  4. Retain a sampling and redaction policy for traces rather than logging raw secrets in production.

Explanation

Correct Answers

A:

Correct (immediate corrective action). Classify current turn intent and route balances to authorized structured lookup rather than policy-only search. In this scenario, An employee asks first about leave policy, then about their leave balance, and the chain keeps searching policy text only. The governing mechanism is: Multi-turn assistants need explicit conversational state while routing each new request to the correct tool or topic. One selected option addresses the immediate workflow, while the other guards the same failure mode after deployment. Both satisfy the TWO-part requirement.

C:

Correct (continuing risk control). Expire or segregate conversation memory by identity and purpose, especially for financial and personal records. In this scenario, An employee asks first about leave policy, then about their leave balance, and the chain keeps searching policy text only. The governing mechanism is: Multi-turn assistants need explicit conversational state while routing each new request to the correct tool or topic. One selected option addresses the immediate workflow, while the other guards the same failure mode after deployment. Both satisfy the TWO-part requirement.

Incorrect Answers

B:

Not the strongest safeguard choice for this specific question. Treat the page as untrusted evidence and enforce tool authorization and destination allowlists on the server. This action primarily relates to Prompt-injection defenses for retrieved context: Retrieved content is lower-trust data; embedded instructions must not trigger privileged tool calls or override assistant rules. However, the described case — An employee asks first about leave policy, then about their leave balance, and the chain keeps searching policy text only. — is testing Conversation context and intent routing. It does not directly establish the safeguard outcome or constraint that the question requires; it may still be useful in a different stage or incident.

D:

Not the strongest safeguard choice for this specific question. Retain a sampling and redaction policy for traces rather than logging raw secrets in production. This action primarily relates to MLflow tracing in an Agent Framework workflow: MLflow tracing records agent steps, tool calls and latency; integration must retain child spans and inputs without leaking secrets. However, the described case — An employee asks first about leave policy, then about their leave balance, and the chain keeps searching policy text only. — is testing Conversation context and intent routing. It does not directly establish the safeguard outcome or constraint that the question requires; it may still be useful in a different stage or incident.

Question 496

What information should the engineer inspect before choosing a remedy? An analyst must classify millions of rows overnight inside a governed Databricks SQL pipeline.

  1. Inspect query embedding provenance, index schema, similarity results and selected context window.
  2. Inspect warehouse type, runtime compatibility, endpoint status, SQL arguments and batch size.
  3. Inspect UC model names, signatures, version metadata, lineage and relevant ACLs.
  4. Inspect server type, endpoint URL, supported auth, tool declarations and available scopes.

Explanation

Correct Answer

B:

Correct. `ai_query()` invokes an available serving endpoint from SQL; suitability depends on supported runtimes, endpoint and workload. In the given situation — An analyst must classify millions of rows overnight inside a governed Databricks SQL pipeline. — the targeted diagnose action is: Inspect warehouse type, runtime compatibility, endpoint status, SQL arguments and batch size. It inspects the stage or constraint most likely to explain the observed failure before changing the system.

Incorrect Answers

A:

Not the strongest diagnose choice for this specific question. Inspect query embedding provenance, index schema, similarity results and selected context window. This action primarily relates to Vector Search retrieval workflow and query integration: Semantic retrieval uses an embedding model to query a compatible index, returns ranked passages and metadata for grounded generation. However, the described case — An analyst must classify millions of rows overnight inside a governed Databricks SQL pipeline. — is testing SQL ai_query for governed batch inference. It does not directly establish the diagnose outcome or constraint that the question requires; it may still be useful in a different stage or incident.

C:

Not the strongest diagnose choice for this specific question. Inspect UC model names, signatures, version metadata, lineage and relevant ACLs. This action primarily relates to Unity Catalog registered model version and privileges: MLflow-logged models can be registered in Unity Catalog, with governed names, permissions and traceable version lineage. However, the described case — An analyst must classify millions of rows overnight inside a governed Databricks SQL pipeline. — is testing SQL ai_query for governed batch inference. It does not directly establish the diagnose outcome or constraint that the question requires; it may still be useful in a different stage or incident.

D:

Not the strongest diagnose choice for this specific question. Inspect server type, endpoint URL, supported auth, tool declarations and available scopes. This action primarily relates to Managed versus external versus custom MCP server integration: MCP standardizes tool discovery; managed servers reduce hosting, external services need credentials and custom servers wrap bespoke actions. However, the described case — An analyst must classify millions of rows overnight inside a governed Databricks SQL pipeline. — is testing SQL ai_query for governed batch inference. It does not directly establish the diagnose outcome or constraint that the question requires; it may still be useful in a different stage or incident.

Question 497

A Databricks engineer is correcting the following workflow: A multilingual agent is proposed using a model card that reports poor performance on the target language. Which change best addresses the documented requirement?

  1. Design a precise instruction on evidence and uncertainty, then compare against baseline using the same evaluation set.
  2. Review model license and select an authorized commercial alternative before deployment.
  3. Build a compatible new index and re-embed the corpus, then test cutover against representative queries.
  4. Select a candidate with measured language coverage and document residual risk on target-language samples.

Explanation

Correct Answer

D:

Correct. A model card records intended uses, supported language/context, safety limitations and evaluation scope relevant to selection. In the given situation — A multilingual agent is proposed using a model card that reports poor performance on the target language. — the targeted implement action is: Select a candidate with measured language coverage and document residual risk on target-language samples. This directly meets the stated workflow constraint instead of addressing an adjacent capability.

Incorrect Answers

A:

Not the strongest implement choice for this specific question. Design a precise instruction on evidence and uncertainty, then compare against baseline using the same evaluation set. This action primarily relates to Prompt changes evaluated against baseline: A prompt improvement should be measured against a fixed baseline set, not accepted because a few outputs sound better. However, the described case — A multilingual agent is proposed using a model card that reports poor performance on the target language. — is testing Model cards and task-specific limitations. It does not directly establish the implement outcome or constraint that the question requires; it may still be useful in a different stage or incident.

B:

Not the strongest implement choice for this specific question. Review model license and select an authorized commercial alternative before deployment. This action primarily relates to Open model license versus managed endpoint obligations: Model availability on a hub does not itself confer commercial training, redistribution or hosting rights. However, the described case — A multilingual agent is proposed using a model card that reports poor performance on the target language. — is testing Model cards and task-specific limitations. It does not directly establish the implement outcome or constraint that the question requires; it may still be useful in a different stage or incident.

C:

Not the strongest implement choice for this specific question. Build a compatible new index and re-embed the corpus, then test cutover against representative queries. This action primarily relates to Embedding model swap and reindex compatibility: Changed embedding dimensions or model semantics typically require re-embedding and index consistency before comparing search quality. However, the described case — A multilingual agent is proposed using a model card that reports poor performance on the target language. — is testing Model cards and task-specific limitations. It does not directly establish the implement outcome or constraint that the question requires; it may still be useful in a different stage or incident.

Question 498

Which continuing engineering control best reduces recurrence of this issue? A policy assistant begins making incorrect claims after the source index updates, but no live records show which index answered.

  1. Do not treat request logging or gateway authentication as proof that underlying data access is authorized.
  2. Use usage monitoring and budgets to detect regressions when prompts, indexes or models change.
  3. Keep monitoring schemas and retention governance versioned across model deployment changes.
  4. Use risk-based alert thresholds and sample protected user segments, not a single global average.

Explanation

Correct Answer

C:

Correct. Inference tables and agent monitoring capture production request/response signals and traces for quality investigations. In the given situation — A policy assistant begins making incorrect claims after the source index updates, but no live records show which index answered. — the targeted safeguard action is: Keep monitoring schemas and retention governance versioned across model deployment changes. It preserves an enduring engineering or governance boundary after the current issue is fixed.

Incorrect Answers

A:

Not the strongest safeguard choice for this specific question. Do not treat request logging or gateway authentication as proof that underlying data access is authorized. This action primarily relates to AI Gateway rate limits, usage tables and inference telemetry: AI Gateway offers controlled access, supported usage tracking and rate limiting to protect shared endpoints and measure consumption. However, the described case — A policy assistant begins making incorrect claims after the source index updates, but no live records show which index answered. — is testing Inference tables and Agent Monitoring feedback loop. It does not directly establish the safeguard outcome or constraint that the question requires; it may still be useful in a different stage or incident.

B:

Not the strongest safeguard choice for this specific question. Use usage monitoring and budgets to detect regressions when prompts, indexes or models change. This action primarily relates to Databricks usage and token cost controls: Reduce LLM spend through token budgets, caching, smaller appropriate models and AI Gateway quotas while preserving acceptance quality. However, the described case — A policy assistant begins making incorrect claims after the source index updates, but no live records show which index answered. — is testing Inference tables and Agent Monitoring feedback loop. It does not directly establish the safeguard outcome or constraint that the question requires; it may still be useful in a different stage or incident.

D:

Not the strongest safeguard choice for this specific question. Use risk-based alert thresholds and sample protected user segments, not a single global average. This action primarily relates to Production performance KPIs and incident thresholds: Monitoring should include answer correctness, retrieval coverage, safety, latency, drift and per-user harm indicators, not just availability. However, the described case — A policy assistant begins making incorrect claims after the source index updates, but no live records show which index answered. — is testing Inference tables and Agent Monitoring feedback loop. It does not directly establish the safeguard outcome or constraint that the question requires; it may still be useful in a different stage or incident.

Question 499

A deployment approval is requested for this case: A search result includes fake 'system message' text requesting the assistant reveal private SQL results. Which acceptance test should reviewers require?

  1. Inject adversarial retrieved passages and verify they cannot cause unauthorized actions or data disclosure.
  2. A/B test chunk segmentation on frozen questions and verify evidence sufficiency and prompt-budget compliance.
  3. Reproduce a slow/error case and confirm each relevant stage is observable without sensitive tokens.
  4. Test mismatched user and account values and confirm zero unauthorized retrieval and correct contextual answers.

Explanation

Correct Answer

A:

Correct. Retrieved content is lower-trust data; embedded instructions must not trigger privileged tool calls or override assistant rules. In the given situation — A search result includes fake 'system message' text requesting the assistant reveal private SQL results. — the targeted verify action is: Inject adversarial retrieved passages and verify they cannot cause unauthorized actions or data disclosure. It tests an observable outcome using realistic inputs rather than relying on a working demo alone.

Incorrect Answers

B:

Not the strongest verify choice for this specific question. A/B test chunk segmentation on frozen questions and verify evidence sufficiency and prompt-budget compliance. This action primarily relates to Chunk quality evaluation and boundary splitting: Retrieval failure can arise from overly small chunks that omit needed context or overly large chunks that dilute relevance. However, the described case — A search result includes fake 'system message' text requesting the assistant reveal private SQL results. — is testing Prompt-injection defenses for retrieved context. It does not directly establish the verify outcome or constraint that the question requires; it may still be useful in a different stage or incident.

C:

Not the strongest verify choice for this specific question. Reproduce a slow/error case and confirm each relevant stage is observable without sensitive tokens. This action primarily relates to MLflow tracing in an Agent Framework workflow: MLflow tracing records agent steps, tool calls and latency; integration must retain child spans and inputs without leaking secrets. However, the described case — A search result includes fake 'system message' text requesting the assistant reveal private SQL results. — is testing Prompt-injection defenses for retrieved context. It does not directly establish the verify outcome or constraint that the question requires; it may still be useful in a different stage or incident.

D:

Not the strongest verify choice for this specific question. Test mismatched user and account values and confirm zero unauthorized retrieval and correct contextual answers. This action primarily relates to Query-field driven prompt and retrieval filters: User intent and structured fields such as account_id should drive authorized SQL lookups or retrieval filters, not be ignored in free text. However, the described case — A search result includes fake 'system message' text requesting the assistant reveal private SQL results. — is testing Prompt-injection defenses for retrieved context. It does not directly establish the verify outcome or constraint that the question requires; it may still be useful in a different stage or incident.

Question 500

The Generative AI team observes: A retrieved internal wiki page embeds a fake system instruction to grant an attacker access to all support tickets. Which implementation decision is MOST appropriate?

  1. Differentiate direct identifiers from permissible temporal fields and apply purpose-specific protection.
  2. Review license and reuse conditions and use authorized sources or link without copying protected text.
  3. Isolate source text in retrieval context and use backend authorization for ticket actions.
  4. Mask card numbers and nonessential identity fields before ingestion and keep approved case references separately.

Explanation

Correct Answer

C:

Correct. A document that says 'ignore your rules' is untrusted data; a robust agent must enforce instruction and tool boundaries independently. In the given situation — A retrieved internal wiki page embeds a fake system instruction to grant an attacker access to all support tickets. — the targeted implement action is: Isolate source text in retrieval context and use backend authorization for ticket actions. This directly meets the stated workflow constraint instead of addressing an adjacent capability.

Incorrect Answers

A:

Not the strongest implement choice for this specific question. Differentiate direct identifiers from permissible temporal fields and apply purpose-specific protection. This action primarily relates to Contextual masking versus destructive data removal: Masking must preserve information needed for the task, such as non-sensitive dates or amounts, and cannot replace access control. However, the described case — A retrieved internal wiki page embeds a fake system instruction to grant an attacker access to all support tickets. — is testing Input guardrails against prompt-injected source documents. It does not directly establish the implement outcome or constraint that the question requires; it may still be useful in a different stage or incident.

B:

Not the strongest implement choice for this specific question. Review license and reuse conditions and use authorized sources or link without copying protected text. This action primarily relates to Training and retrieval corpus license rights: Public accessibility does not automatically authorize copying, embedding or using content in commercial RAG services. However, the described case — A retrieved internal wiki page embeds a fake system instruction to grant an attacker access to all support tickets. — is testing Input guardrails against prompt-injected source documents. It does not directly establish the implement outcome or constraint that the question requires; it may still be useful in a different stage or incident.

D:

Not the strongest implement choice for this specific question. Mask card numbers and nonessential identity fields before ingestion and keep approved case references separately. This action primarily relates to Sensitive-field masking before embedding: Masking or tokenization can remove unnecessary PII from chunks before embedding and external model calls while retaining useful meaning. However, the described case — A retrieved internal wiki page embeds a fake system instruction to grant an attacker access to all support tickets. — is testing Input guardrails against prompt-injected source documents. It does not directly establish the implement outcome or constraint that the question requires; it may still be useful in a different stage or incident.