mcAfee Secure Website
23

Databricks Certified Generative AI Engineer Associate Bundle

Exam Code: Certified Generative AI Engineer Associate

Exam Name Certified Generative AI Engineer Associate

Certification Provider: Databricks

Corresponding Certification: Databricks Certified Generative AI Engineer Associate

Certified Generative AI Engineer Associate Training Materials $19.99

Reliable & Actual Study Materials for Certified Generative AI Engineer Associate Exam Success

The Latest Certified Generative AI Engineer Associate Exam Questions as Experienced in the Actual Test!

  • 24
    Questions & Answers

    Certified Generative AI Engineer Associate Questions & Answers

    123 Questions & Answers

    Includes questions types found on actual exam such as drag and drop, simulation, type in, and fill in the blank.

  • exam =30
    Study Guide

    Certified Generative AI Engineer Associate Study Guide

    230 PDF Pages

    Study Guide developed by industry experts who have written exams in the past. They are technology-specific IT certification researchers with at least a decade of experience at Fortune 500 companies.

exam =32

Certified Generative AI Engineer Associate Practice Tests

Guarantee

Satisfaction Guaranteed

Pass4sure has a remarkable Databricks Candidate Success record. We're confident of our products and provide no hassle product exchange. That's how confident we are!

99.3% Pass Rate
Total Cost: $154.98
Bundle Price: $134.99

Purchase Individually

  • exam =34
    Questions & Answers

    Questions & Answers

    123 Questions

    $124.99
    exam =35
  • exam =36
    Study Guide

    Study Guide

    230 PDF Pages

    $29.99

Databricks Certified Generative AI Engineer Associate Practice Test 54

Question 530

A Databricks RAG or agent workflow behaves unexpectedly: A support assistant reveals hidden instructions when users ask it to ignore the normal helpdesk policy. Which diagnostic check has the highest value?

  1. Inspect whether the task requires real external state, permitted action or just text transformation.
  2. Inspect decoding parameters, expected output variance, schema requirements and task acceptance criteria.
  3. Inspect parsed intent, extracted keys, authorization check and actual query filter predicates.
  4. Inspect adversarial prompt examples, tool permissions and whether refusals are enforced outside the model.

Explanation

Correct Answer

D:

Correct. User-provided instructions may attempt to bypass agent policies or cause data leakage; classification and tool boundaries need separate tests. In the given situation — A support assistant reveals hidden instructions when users ask it to ignore the normal helpdesk policy. — the targeted diagnose action is: Inspect adversarial prompt examples, tool permissions and whether refusals are enforced outside the model. It inspects the stage or constraint most likely to explain the observed failure before changing the system.

Incorrect Answers

A:

Not the strongest diagnose choice for this specific question. Inspect whether the task requires real external state, permitted action or just text transformation. This action primarily relates to Agent tool wrappers versus direct LLM responses: A tool-using agent needs explicit callable interfaces and typed tool results, whereas plain generation requires no action execution. However, the described case — A support assistant reveals hidden instructions when users ask it to ignore the normal helpdesk policy. — is testing Unsafe model output and jailbreak response diagnosis. It does not directly establish the diagnose outcome or constraint that the question requires; it may still be useful in a different stage or incident.

B:

Not the strongest diagnose choice for this specific question. Inspect decoding parameters, expected output variance, schema requirements and task acceptance criteria. This action primarily relates to Temperature and deterministic format tradeoffs: Decoding settings can affect variability and cost but cannot replace validation, grounding or application logic. However, the described case — A support assistant reveals hidden instructions when users ask it to ignore the normal helpdesk policy. — is testing Unsafe model output and jailbreak response diagnosis. It does not directly establish the diagnose outcome or constraint that the question requires; it may still be useful in a different stage or incident.

C:

Not the strongest diagnose choice for this specific question. Inspect parsed intent, extracted keys, authorization check and actual query filter predicates. This action primarily relates to Query-field driven prompt and retrieval filters: User intent and structured fields such as account_id should drive authorized SQL lookups or retrieval filters, not be ignored in free text. However, the described case — A support assistant reveals hidden instructions when users ask it to ignore the normal helpdesk policy. — is testing Unsafe model output and jailbreak response diagnosis. It does not directly establish the diagnose outcome or constraint that the question requires; it may still be useful in a different stage or incident.

Question 531

The Generative AI team observes: After an ingestion rerun, duplicate chunks multiply because the pipeline only appends without source identity. Which implementation decision is MOST appropriate?

  1. Turn each relevant table row into a header-aware text/metadata record with original page citation.
  2. Upsert chunk rows by stable document/version/chunk identifiers and delete stale rows under change control.
  3. Choose coherent chunks large enough to keep cause and remedy together without exceeding embedding limits.
  4. Use an OCR-capable extraction step, evaluate recognition quality and retain source page provenance.

Explanation

Correct Answer

B:

Correct. A governed retrieval corpus stores chunk text, IDs, source lineage and metadata in managed Delta/Unity Catalog tables before indexing. In the given situation — After an ingestion rerun, duplicate chunks multiply because the pipeline only appends without source identity. — the targeted implement action is: Upsert chunk rows by stable document/version/chunk identifiers and delete stale rows under change control. This directly meets the stated workflow constraint instead of addressing an adjacent capability.

Incorrect Answers

A:

Not the strongest implement choice for this specific question. Turn each relevant table row into a header-aware text/metadata record with original page citation. This action primarily relates to Table-aware chunking and metadata-rich retrieval: Tabular rows need headers, units and column semantics preserved when transformed into retrieval documents. However, the described case — After an ingestion rerun, duplicate chunks multiply because the pipeline only appends without source identity. — is testing Delta and Unity Catalog pipeline for chunk tables. It does not directly establish the implement outcome or constraint that the question requires; it may still be useful in a different stage or incident.

C:

Not the strongest implement choice for this specific question. Choose coherent chunks large enough to keep cause and remedy together without exceeding embedding limits. This action primarily relates to Chunk size and overlap tradeoffs: Chunk size determines the number of vectors and coherence; overlap reduces boundary loss but increases index size and cost. However, the described case — After an ingestion rerun, duplicate chunks multiply because the pipeline only appends without source identity. — is testing Delta and Unity Catalog pipeline for chunk tables. It does not directly establish the implement outcome or constraint that the question requires; it may still be useful in a different stage or incident.

D:

Not the strongest implement choice for this specific question. Use an OCR-capable extraction step, evaluate recognition quality and retain source page provenance. This action primarily relates to Format-specific document extraction and OCR needs: Extract text with a parser suited to source format; image-only scans require OCR rather than HTML or plain-text parsing. However, the described case — After an ingestion rerun, duplicate chunks multiply because the pipeline only appends without source identity. — is testing Delta and Unity Catalog pipeline for chunk tables. It does not directly establish the implement outcome or constraint that the question requires; it may still be useful in a different stage or incident.

Question 532

A Databricks RAG or agent workflow behaves unexpectedly: A benefits RAG assistant cites a real policy page but its claimed deadline does not appear in the cited passage. Which diagnostic check has the highest value?

  1. Inspect cited spans, source freshness, answer claims and missing-reference patterns.
  2. Inspect parsed intent, extracted keys, authorization check and actual query filter predicates.
  3. Inspect encoder token limits, chunk length percentiles, truncation counters and source suffix omissions.
  4. Inspect user conversation state, current intent, entity resolution and selected tool trace.

Explanation

Correct Answer

A:

Correct. Fluent responses can invent facts and citations; faithfulness must be checked against supplied evidence, not writing style. In the given situation — A benefits RAG assistant cites a real policy page but its claimed deadline does not appear in the cited passage. — the targeted diagnose action is: Inspect cited spans, source freshness, answer claims and missing-reference patterns. It inspects the stage or constraint most likely to explain the observed failure before changing the system.

Incorrect Answers

B:

Not the strongest diagnose choice for this specific question. Inspect parsed intent, extracted keys, authorization check and actual query filter predicates. This action primarily relates to Query-field driven prompt and retrieval filters: User intent and structured fields such as account_id should drive authorized SQL lookups or retrieval filters, not be ignored in free text. However, the described case — A benefits RAG assistant cites a real policy page but its claimed deadline does not appear in the cited passage. — is testing Hallucinated facts and unsupported citations. It does not directly establish the diagnose outcome or constraint that the question requires; it may still be useful in a different stage or incident.

C:

Not the strongest diagnose choice for this specific question. Inspect encoder token limits, chunk length percentiles, truncation counters and source suffix omissions. This action primarily relates to Embedding context window and chunk token distribution: The embedding encoder must accept the actual tokenized chunk length; silently truncating chunks can drop relevant suffix facts. However, the described case — A benefits RAG assistant cites a real policy page but its claimed deadline does not appear in the cited passage. — is testing Hallucinated facts and unsupported citations. It does not directly establish the diagnose outcome or constraint that the question requires; it may still be useful in a different stage or incident.

D:

Not the strongest diagnose choice for this specific question. Inspect user conversation state, current intent, entity resolution and selected tool trace. This action primarily relates to Conversation context and intent routing: Multi-turn assistants need explicit conversational state while routing each new request to the correct tool or topic. However, the described case — A benefits RAG assistant cites a real policy page but its claimed deadline does not appear in the cited passage. — is testing Hallucinated facts and unsupported citations. It does not directly establish the diagnose outcome or constraint that the question requires; it may still be useful in a different stage or incident.

Question 533 (Select TWO)

Choose TWO measures: one specific correction and one lasting safeguard. A troubleshooting guide's symptom and resolution are in separate sections when cut every 400 characters.

  1. Limit parent expansion to an appropriate token budget to avoid irrelevant context dilution.
  2. Increase suitable chunk length and reduce unnecessary overlap while checking passage-level answer recall.
  3. Use document-aware sections plus parent-child metadata to connect symptom to resolution.
  4. Retain source offsets and section IDs so citations remain traceable after rechunking.

Explanation

Correct Answers

C:

Correct (immediate corrective action). Use document-aware sections plus parent-child metadata to connect symptom to resolution. In this scenario, A troubleshooting guide's symptom and resolution are in separate sections when cut every 400 characters. The governing mechanism is: Headings, paragraphs and tables can require structure-aware splitting rather than arbitrary token windows. One selected option addresses the immediate workflow, while the other guards the same failure mode after deployment. Both satisfy the TWO-part requirement.

D:

Correct (continuing risk control). Retain source offsets and section IDs so citations remain traceable after rechunking. In this scenario, A troubleshooting guide's symptom and resolution are in separate sections when cut every 400 characters. The governing mechanism is: Headings, paragraphs and tables can require structure-aware splitting rather than arbitrary token windows. One selected option addresses the immediate workflow, while the other guards the same failure mode after deployment. Both satisfy the TWO-part requirement.

Incorrect Answers

A:

Not the strongest safeguard choice for this specific question. Limit parent expansion to an appropriate token budget to avoid irrelevant context dilution. This action primarily relates to Parent-child retrieval and hierarchical structure: Parent-child retrieval indexes targeted sections but expands to their broader parent context for generation. However, the described case — A troubleshooting guide's symptom and resolution are in separate sections when cut every 400 characters. — is testing Semantic boundaries versus fixed-window chunks. It does not directly establish the safeguard outcome or constraint that the question requires; it may still be useful in a different stage or incident.

B:

Not the strongest safeguard choice for this specific question. Increase suitable chunk length and reduce unnecessary overlap while checking passage-level answer recall. This action primarily relates to Chunk size and overlap tradeoffs: Chunk size determines the number of vectors and coherence; overlap reduces boundary loss but increases index size and cost. However, the described case — A troubleshooting guide's symptom and resolution are in separate sections when cut every 400 characters. — is testing Semantic boundaries versus fixed-window chunks. It does not directly establish the safeguard outcome or constraint that the question requires; it may still be useful in a different stage or incident.

Question 534

Which solution directly addresses this application requirement? A team promotes a new prompt without rerunning citation accuracy or tool-permission regression cases.

  1. Use access-controlled persistent storage with retention and sensitive-field minimization.
  2. Bundle compatible index/embedding identifiers and validate query-embedding compatibility at initialization.
  3. Run the supported index update/sync process and verify the indexed source identifiers reflect current Delta records.
  4. Build a CI gate for prompt schema, retrieval relevance, agent tools and controlled promotion across environments.

Explanation

Correct Answer

D:

Correct. Production promotions should test source index, prompt, model packaging and tool behavior independently before release. In the given situation — A team promotes a new prompt without rerunning citation accuracy or tool-permission regression cases. — the targeted implement action is: Build a CI gate for prompt schema, retrieval relevance, agent tools and controlled promotion across environments. This directly meets the stated workflow constraint instead of addressing an adjacent capability.

Incorrect Answers

A:

Not the strongest implement choice for this specific question. Use access-controlled persistent storage with retention and sensitive-field minimization. This action primarily relates to Persistent conversation memory with authorized datastore: Transient prompt context differs from persistent user state; durable memory needs explicit storage, identity scope and retention. However, the described case — A team promotes a new prompt without rerunning citation accuracy or tool-permission regression cases. — is testing CI/CD pipelines for retrieval and agent components. It does not directly establish the implement outcome or constraint that the question requires; it may still be useful in a different stage or incident.

B:

Not the strongest implement choice for this specific question. Bundle compatible index/embedding identifiers and validate query-embedding compatibility at initialization. This action primarily relates to RAG production bundle metadata and dependencies: A deployable RAG application needs tracked model code, retriever config, embedding model, dependency versions, signature and example input. However, the described case — A team promotes a new prompt without rerunning citation accuracy or tool-permission regression cases. — is testing CI/CD pipelines for retrieval and agent components. It does not directly establish the implement outcome or constraint that the question requires; it may still be useful in a different stage or incident.

C:

Not the strongest implement choice for this specific question. Run the supported index update/sync process and verify the indexed source identifiers reflect current Delta records. This action primarily relates to Databricks Vector Search index from governed Delta data: A vector index serves embeddings of chunked records maintained in a Unity Catalog governed Delta source table. However, the described case — A team promotes a new prompt without rerunning citation accuracy or tool-permission regression cases. — is testing CI/CD pipelines for retrieval and agent components. It does not directly establish the implement outcome or constraint that the question requires; it may still be useful in a different stage or incident.

Question 535

Before changing the GenAI pipeline, which investigation is MOST useful? An HR help desk says it wants 'AI answers' without specifying which employee documents users may see.

  1. Inspect each source connector's contract, join keys, runtime error handling and the final prompt inputs.
  2. Inspect the business decision, data owners, actor permissions, known inputs and success criteria.
  3. Identify whether the output is a category, extractive field, free-form summary or grounded answer.
  4. Inspect the prompt hierarchy, few-shot coverage, untrusted-data delimiters and observed format deviations.

Explanation

Correct Answer

B:

Correct. Business acceptance criteria must map to concrete source inputs, generated fields, correctness measures and permission constraints. In the given situation — An HR help desk says it wants 'AI answers' without specifying which employee documents users may see. — the targeted diagnose action is: Inspect the business decision, data owners, actor permissions, known inputs and success criteria. It inspects the stage or constraint most likely to explain the observed failure before changing the system.

Incorrect Answers

A:

Not the strongest diagnose choice for this specific question. Inspect each source connector's contract, join keys, runtime error handling and the final prompt inputs. This action primarily relates to Parallel retrieval and deterministic chain postprocessing: Combining structured lookup and semantic retrieval requires explicit routing, result joining, and downstream schema checks. However, the described case — An HR help desk says it wants 'AI answers' without specifying which employee documents users may see. — is testing Translate use-case requirements into pipeline inputs and outputs. It does not directly establish the diagnose outcome or constraint that the question requires; it may still be useful in a different stage or incident.

C:

Not the strongest diagnose choice for this specific question. Identify whether the output is a category, extractive field, free-form summary or grounded answer. This action primarily relates to Task choice: classification versus generative summarization: Classification predicts a category whereas summarization compresses meaning; the desired output determines the appropriate task. However, the described case — An HR help desk says it wants 'AI answers' without specifying which employee documents users may see. — is testing Translate use-case requirements into pipeline inputs and outputs. It does not directly establish the diagnose outcome or constraint that the question requires; it may still be useful in a different stage or incident.

D:

Not the strongest diagnose choice for this specific question. Inspect the prompt hierarchy, few-shot coverage, untrusted-data delimiters and observed format deviations. This action primarily relates to Instruction hierarchy and bounded prompt examples: Few-shot examples and explicit boundaries can clarify expected outputs, but embedded source documents should not become new system instructions. However, the described case — An HR help desk says it wants 'AI answers' without specifying which employee documents users may see. — is testing Translate use-case requirements into pipeline inputs and outputs. It does not directly establish the diagnose outcome or constraint that the question requires; it may still be useful in a different stage or incident.

Question 536 (Select TWO)

Choose TWO measures: one specific correction and one lasting safeguard. An agent needs governed Genie metrics plus a company-only ticket system exposed through a custom API.

  1. Register the MLflow model as a named Unity Catalog model version and grant only approved use/manage rights.
  2. Use the managed Genie connector alongside a narrowly scoped custom MCP server for ticket actions.
  3. Never place MCP API keys in prompts or browser code, and review third-party tool trust boundaries.
  4. Do not store sensitive chat traces indefinitely merely because longer memory improves convenience.

Explanation

Correct Answers

B:

Correct (immediate corrective action). Use the managed Genie connector alongside a narrowly scoped custom MCP server for ticket actions. In this scenario, An agent needs governed Genie metrics plus a company-only ticket system exposed through a custom API. The governing mechanism is: MCP standardizes tool discovery; managed servers reduce hosting, external services need credentials and custom servers wrap bespoke actions. One selected option addresses the immediate workflow, while the other guards the same failure mode after deployment. Both satisfy the TWO-part requirement.

C:

Correct (continuing risk control). Never place MCP API keys in prompts or browser code, and review third-party tool trust boundaries. In this scenario, An agent needs governed Genie metrics plus a company-only ticket system exposed through a custom API. The governing mechanism is: MCP standardizes tool discovery; managed servers reduce hosting, external services need credentials and custom servers wrap bespoke actions. One selected option addresses the immediate workflow, while the other guards the same failure mode after deployment. Both satisfy the TWO-part requirement.

Incorrect Answers

A:

Not the strongest safeguard choice for this specific question. Register the MLflow model as a named Unity Catalog model version and grant only approved use/manage rights. This action primarily relates to Unity Catalog registered model version and privileges: MLflow-logged models can be registered in Unity Catalog, with governed names, permissions and traceable version lineage. However, the described case — An agent needs governed Genie metrics plus a company-only ticket system exposed through a custom API. — is testing Managed versus external versus custom MCP server integration. It does not directly establish the safeguard outcome or constraint that the question requires; it may still be useful in a different stage or incident.

D:

Not the strongest safeguard choice for this specific question. Do not store sensitive chat traces indefinitely merely because longer memory improves convenience. This action primarily relates to Persistent conversation memory with authorized datastore: Transient prompt context differs from persistent user state; durable memory needs explicit storage, identity scope and retention. However, the described case — An agent needs governed Genie metrics plus a company-only ticket system exposed through a custom API. — is testing Managed versus external versus custom MCP server integration. It does not directly establish the safeguard outcome or constraint that the question requires; it may still be useful in a different stage or incident.

Question 537

Which solution directly addresses this application requirement? A claims assistant answers in different tones because the prompt has no consistent example or response constraints.

  1. Configure a Knowledge Assistant over approved documents and validate source attribution and group permissions.
  2. Add concise role instructions and representative input/output examples while keeping untrusted claim text in a delimited data section.
  3. Define the equipment identifiers, failure observations and inventory query as required inputs, with approved part IDs as outputs.
  4. Evaluate a summarization model against faithful concise summaries with source references.

Explanation

Correct Answer

B:

Correct. Few-shot examples and explicit boundaries can clarify expected outputs, but embedded source documents should not become new system instructions. In the given situation — A claims assistant answers in different tones because the prompt has no consistent example or response constraints. — the targeted implement action is: Add concise role instructions and representative input/output examples while keeping untrusted claim text in a delimited data section. This directly meets the stated workflow constraint instead of addressing an adjacent capability.

Incorrect Answers

A:

Not the strongest implement choice for this specific question. Configure a Knowledge Assistant over approved documents and validate source attribution and group permissions. This action primarily relates to Agent Bricks Knowledge Assistant suitability: A governed knowledge assistant grounds conversational responses in curated documents and access-controlled retrieval. However, the described case — A claims assistant answers in different tones because the prompt has no consistent example or response constraints. — is testing Instruction hierarchy and bounded prompt examples. It does not directly establish the implement outcome or constraint that the question requires; it may still be useful in a different stage or incident.

C:

Not the strongest implement choice for this specific question. Define the equipment identifiers, failure observations and inventory query as required inputs, with approved part IDs as outputs. This action primarily relates to Translate use-case requirements into pipeline inputs and outputs: Business acceptance criteria must map to concrete source inputs, generated fields, correctness measures and permission constraints. However, the described case — A claims assistant answers in different tones because the prompt has no consistent example or response constraints. — is testing Instruction hierarchy and bounded prompt examples. It does not directly establish the implement outcome or constraint that the question requires; it may still be useful in a different stage or incident.

D:

Not the strongest implement choice for this specific question. Evaluate a summarization model against faithful concise summaries with source references. This action primarily relates to Task choice: classification versus generative summarization: Classification predicts a category whereas summarization compresses meaning; the desired output determines the appropriate task. However, the described case — A claims assistant answers in different tones because the prompt has no consistent example or response constraints. — is testing Instruction hierarchy and bounded prompt examples. It does not directly establish the implement outcome or constraint that the question requires; it may still be useful in a different stage or incident.

Question 538

What validation would most convincingly show the correction works? A public review feed contains slurs and adversarial instructions that surface in a brand-support assistant.

  1. Inject the hostile PDF and verify no secret leaves the backend and no unauthorized tool is invoked.
  2. Test harmful queries and verify contaminated passages are blocked without discarding legitimate safety instructions.
  3. Sample indexed chunks against a rights manifest and confirm prohibited sources are excluded.
  4. Compare usefulness and privacy leakage metrics on held-out documents before and after selective masking.

Explanation

Correct Answer

B:

Correct. Unreliable source text can teach unsafe behavior through retrieval; quarantine and source review matter before embeddings. In the given situation — A public review feed contains slurs and adversarial instructions that surface in a brand-support assistant. — the targeted verify action is: Test harmful queries and verify contaminated passages are blocked without discarding legitimate safety instructions. It tests an observable outcome using realistic inputs rather than relying on a working demo alone.

Incorrect Answers

A:

Not the strongest verify choice for this specific question. Inject the hostile PDF and verify no secret leaves the backend and no unauthorized tool is invoked. This action primarily relates to Input guardrails against prompt-injected source documents: A document that says 'ignore your rules' is untrusted data; a robust agent must enforce instruction and tool boundaries independently. However, the described case — A public review feed contains slurs and adversarial instructions that surface in a brand-support assistant. — is testing Toxic, inaccurate and adversarial corpus cleaning. It does not directly establish the verify outcome or constraint that the question requires; it may still be useful in a different stage or incident.

C:

Not the strongest verify choice for this specific question. Sample indexed chunks against a rights manifest and confirm prohibited sources are excluded. This action primarily relates to Training and retrieval corpus license rights: Public accessibility does not automatically authorize copying, embedding or using content in commercial RAG services. However, the described case — A public review feed contains slurs and adversarial instructions that surface in a brand-support assistant. — is testing Toxic, inaccurate and adversarial corpus cleaning. It does not directly establish the verify outcome or constraint that the question requires; it may still be useful in a different stage or incident.

D:

Not the strongest verify choice for this specific question. Compare usefulness and privacy leakage metrics on held-out documents before and after selective masking. This action primarily relates to Contextual masking versus destructive data removal: Masking must preserve information needed for the task, such as non-sensitive dates or amounts, and cannot replace access control. However, the described case — A public review feed contains slurs and adversarial instructions that surface in a brand-support assistant. — is testing Toxic, inaccurate and adversarial corpus cleaning. It does not directly establish the verify outcome or constraint that the question requires; it may still be useful in a different stage or incident.

Question 539

What information should the engineer inspect before choosing a remedy? A ledger explanation app needs repeatable short outputs, but developers increase temperature to make wording more creative.

  1. Inspect training/licensing terms, model-card task benchmarks, input limits and restrictions.
  2. Inspect decoding parameters, expected output variance, schema requirements and task acceptance criteria.
  3. Inspect task difficulty, expected concurrency, context size, throughput and model benchmark evidence.
  4. Inspect experiment runs, source versions, parameter drift and metric definitions.

Explanation

Correct Answer

B:

Correct. Decoding settings can affect variability and cost but cannot replace validation, grounding or application logic. In the given situation — A ledger explanation app needs repeatable short outputs, but developers increase temperature to make wording more creative. — the targeted diagnose action is: Inspect decoding parameters, expected output variance, schema requirements and task acceptance criteria. It inspects the stage or constraint most likely to explain the observed failure before changing the system.

Incorrect Answers

A:

Not the strongest diagnose choice for this specific question. Inspect training/licensing terms, model-card task benchmarks, input limits and restrictions. This action primarily relates to Model cards and task-specific limitations: A model card records intended uses, supported language/context, safety limitations and evaluation scope relevant to selection. However, the described case — A ledger explanation app needs repeatable short outputs, but developers increase temperature to make wording more creative. — is testing Temperature and deterministic format tradeoffs. It does not directly establish the diagnose outcome or constraint that the question requires; it may still be useful in a different stage or incident.

C:

Not the strongest diagnose choice for this specific question. Inspect task difficulty, expected concurrency, context size, throughput and model benchmark evidence. This action primarily relates to Model selection by quality latency and budget: Select the smallest suitable model that meets a task's accuracy and latency constraints under realistic workload, not marketing rank. However, the described case — A ledger explanation app needs repeatable short outputs, but developers increase temperature to make wording more creative. — is testing Temperature and deterministic format tradeoffs. It does not directly establish the diagnose outcome or constraint that the question requires; it may still be useful in a different stage or incident.

D:

Not the strongest diagnose choice for this specific question. Inspect experiment runs, source versions, parameter drift and metric definitions. This action primarily relates to Experiment tracking and version reproducibility: MLflow experiments should retain prompt, model, dataset, parameters and evaluation outputs to support a defensible comparison. However, the described case — A ledger explanation app needs repeatable short outputs, but developers increase temperature to make wording more creative. — is testing Temperature and deterministic format tradeoffs. It does not directly establish the diagnose outcome or constraint that the question requires; it may still be useful in a different stage or incident.

Question 540

Before changing the GenAI pipeline, which investigation is MOST useful? A deploy pipeline overwrites the production prompt text each release and cannot restore yesterday's known-good response.

  1. Inspect logged model artifacts, environment requirements, signature and source index identifiers.
  2. Inspect runtime invocation order, prompt input names, stage outputs and errors.
  3. Inspect prompt names, version history, aliases, tests and active referenced URI.
  4. Inspect package lockfile, model signature, serving logs and API contract differences.

Explanation

Correct Answer

C:

Correct. Prompt Registry tracks immutable prompt versions with mutable aliases for staging and production, enabling change control and rollback. In the given situation — A deploy pipeline overwrites the production prompt text each release and cannot restore yesterday's known-good response. — the targeted diagnose action is: Inspect prompt names, version history, aliases, tests and active referenced URI. It inspects the stage or constraint most likely to explain the observed failure before changing the system.

Incorrect Answers

A:

Not the strongest diagnose choice for this specific question. Inspect logged model artifacts, environment requirements, signature and source index identifiers. This action primarily relates to RAG production bundle metadata and dependencies: A deployable RAG application needs tracked model code, retriever config, embedding model, dependency versions, signature and example input. However, the described case — A deploy pipeline overwrites the production prompt text each release and cannot restore yesterday's known-good response. — is testing MLflow Prompt Registry version aliases and promotion. It does not directly establish the diagnose outcome or constraint that the question requires; it may still be useful in a different stage or incident.

B:

Not the strongest diagnose choice for this specific question. Inspect runtime invocation order, prompt input names, stage outputs and errors. This action primarily relates to Simple prompt-retrieval-generation chain assembly: A minimal chain composes a retriever, prompt, LLM and output parser, preserving required variables and failure states. However, the described case — A deploy pipeline overwrites the production prompt text each release and cannot restore yesterday's known-good response. — is testing MLflow Prompt Registry version aliases and promotion. It does not directly establish the diagnose outcome or constraint that the question requires; it may still be useful in a different stage or incident.

D:

Not the strongest diagnose choice for this specific question. Inspect package lockfile, model signature, serving logs and API contract differences. This action primarily relates to Deployed model dependency drift and environment compatibility: Models logged in experiments can fail in serving if Python dependencies or inference signatures differ between build and target. However, the described case — A deploy pipeline overwrites the production prompt text each release and cannot restore yesterday's known-good response. — is testing MLflow Prompt Registry version aliases and promotion. It does not directly establish the diagnose outcome or constraint that the question requires; it may still be useful in a different stage or incident.