Question 490
An enterprise AI architect is reviewing a proposed design: An airport agent must reconcile staffing demand and summarize security-procedure documents before recommending an action. What evidence would most reliably confirm production readiness for this requirement?
Explanation
Correct Answer
“Per-tool routing accuracy plus end-to-end answer correctness on questions requiring both numerical and policy evidence” is supported by this requirement: An airport agent must reconcile staffing demand and summarize security-procedure documents before recommending an action. Composite workflows need correct planning across tools and least-privilege execution. Verify it using per-tool routing accuracy plus end-to-end answer correctness on questions requiring both numerical and policy evidence.
Incorrect Answers
“Only document recall, without validating cross-tool calculations” would not meet the requirement that an airport agent must reconcile staffing demand and summarize security-procedure documents before recommending an action. Composite workflows need correct planning across tools and least-privilege execution. The more reliable approach is to use an orchestrated agent with separate authorized structured-query and text-retrieval tools and explicit tool routing.
“Only database query success, without measuring narrative evidence selection” would not meet the requirement that an airport agent must reconcile staffing demand and summarize security-procedure documents before recommending an action. Composite workflows need correct planning across tools and least-privilege execution. The more reliable approach is to use an orchestrated agent with separate authorized structured-query and text-retrieval tools and explicit tool routing.
“High agent tool-call count regardless of user-task resolution” would not meet the requirement that an airport agent must reconcile staffing demand and summarize security-procedure documents before recommending an action. Composite workflows need correct planning across tools and least-privilege execution. The more reliable approach is to use an orchestrated agent with separate authorized structured-query and text-retrieval tools and explicit tool routing.