Question 730
At an airline operations unit, engineers need to restrict retrieval to documents belonging to the requesting tenant. The implementation must remain maintainable across model upgrades. A recent review found that the current design has no reliable safeguard for this case. What is the most appropriate production approach?
- Index all tenants without an authorization boundary
- Attach tenant metadata and enforce server-side authorization filters at retrieval time
- Filter citations only after unauthorized content is sent to the model
- Rely solely on a prompt saying do not reveal other tenants
Explanation
Correct Answer
B:Authorization must constrain retrieved context before it reaches the generation request. In an airline operations unit, the engineering team should verify this design against its stated objective to restrict retrieval to documents belonging to the requesting tenant, including the requirement that the implementation must remain maintainable across model upgrades.
Incorrect Answers
A:The suggested action—index all tenants without an authorization boundary—does not establish the required control for an airline operations unit to restrict retrieval to documents belonging to the requesting tenant. It replaces a verifiable engineering control with an untested shortcut in the an airline operations unit deployment. In this deployment, engineers should verify the missing mechanism rather than assume the proposed step satisfies the acceptance conditions.
C:The suggested action—filter citations only after unauthorized content is sent to the model—does not establish the required control for an airline operations unit to restrict retrieval to documents belonging to the requesting tenant. No demonstrated capability in this scenario guarantees that this step resolves the concern raised by an airline operations unit. In this deployment, engineers should verify the missing mechanism rather than assume the proposed step satisfies the acceptance conditions.
D:The suggested action—rely solely on a prompt saying do not reveal other tenants—does not establish the required control for an airline operations unit to restrict retrieval to documents belonging to the requesting tenant. It replaces a verifiable engineering control with an untested shortcut in the an airline operations unit deployment. In this deployment, engineers should verify the missing mechanism rather than assume the proposed step satisfies the acceptance conditions.
Question 731
At a security incident response team, engineers need to compare two FM candidates for grounded customer support responses. The next release must be evaluated against the previous baseline. The initial assessment isolates this issue from unrelated infrastructure changes. Which implementation most directly satisfies the requirement?
- Evaluate both on a representative labeled dataset for factuality, quality, latency and price
- Compare only marketing claims about parameter count
- Use one cherry-picked successful conversation as the entire evaluation
- Choose the fastest model without measuring answer usefulness
Explanation
Correct Answer
A:Representative evaluation measures the actual tradeoff required by the business task. In a security incident response team, the engineering team should verify this design against its stated objective to compare two FM candidates for grounded customer support responses, including the requirement that the next release must be evaluated against the previous baseline.
Incorrect Answers
B:The suggested action—compare only marketing claims about parameter count—does not establish the required control for a security incident response team to compare two FM candidates for grounded customer support responses. It replaces a verifiable engineering control with an untested shortcut in the a security incident response team deployment. In this deployment, engineers should verify the missing mechanism rather than assume the proposed step satisfies the acceptance conditions.
C:The suggested action—use one cherry-picked successful conversation as the entire evaluation—does not establish the required control for a security incident response team to compare two FM candidates for grounded customer support responses. The change is applied outside the component responsible for the requirement identified by a security incident response team. In this deployment, engineers should verify the missing mechanism rather than assume the proposed step satisfies the acceptance conditions.
D:The suggested action—choose the fastest model without measuring answer usefulness—does not establish the required control for a security incident response team to compare two FM candidates for grounded customer support responses. No demonstrated capability in this scenario guarantees that this step resolves the concern raised by a security incident response team. In this deployment, engineers should verify the missing mechanism rather than assume the proposed step satisfies the acceptance conditions.
Question 732
At a multilingual contact center, engineers need to reduce unsupported claims in a policy-answering assistant. The current deployment processes customer-specific information. A recent review found that the current design has no reliable safeguard for this case. Which change should the team prioritize?
- Remove citations and ask the model to infer facts
- Store policies only as hidden system-prompt text with no updates
- Ground responses in retrieved approved sources and evaluate citation support
- Raise temperature to make responses sound confident
Explanation
Correct Answer
C:Grounding and faithfulness tests make assertions verifiable against source context. In a multilingual contact center, the engineering team should verify this design against its stated objective to reduce unsupported claims in a policy-answering assistant, including the requirement that the current deployment processes customer-specific information.
Incorrect Answers
A:The suggested action—remove citations and ask the model to infer facts—does not establish the required control for a multilingual contact center to reduce unsupported claims in a policy-answering assistant. It replaces a verifiable engineering control with an untested shortcut in the a multilingual contact center deployment. In this deployment, engineers should verify the missing mechanism rather than assume the proposed step satisfies the acceptance conditions.
B:The suggested action—store policies only as hidden system-prompt text with no updates—does not establish the required control for a multilingual contact center to reduce unsupported claims in a policy-answering assistant. The change is applied outside the component responsible for the requirement identified by a multilingual contact center. In this deployment, engineers should verify the missing mechanism rather than assume the proposed step satisfies the acceptance conditions.
D:The suggested action—raise temperature to make responses sound confident—does not establish the required control for a multilingual contact center to reduce unsupported claims in a policy-answering assistant. It replaces a verifiable engineering control with an untested shortcut in the a multilingual contact center deployment. In this deployment, engineers should verify the missing mechanism rather than assume the proposed step satisfies the acceptance conditions.
Question 733
At a legal case-management provider, engineers need to evaluate whether the generated answer is faithful to retrieved evidence. The implementation must remain maintainable across model upgrades. A recent review found that the current design has no reliable safeguard for this case. Which implementation most directly satisfies the requirement?
- Assume a citation exists therefore every statement is supported
- Measure string length as factual accuracy
- Use groundedness or faithfulness scoring with human-checked evaluation examples
- Score only whether the response sounds articulate
Explanation
Correct Answer
C:Faithfulness checks whether claims are entailed by the provided evidence. In a legal case-management provider, the engineering team should verify this design against its stated objective to evaluate whether the generated answer is faithful to retrieved evidence, including the requirement that the implementation must remain maintainable across model upgrades.
Incorrect Answers
A:The suggested action—assume a citation exists therefore every statement is supported—does not establish the required control for a legal case-management provider to evaluate whether the generated answer is faithful to retrieved evidence. It replaces a verifiable engineering control with an untested shortcut in the a legal case-management provider deployment. In this deployment, engineers should verify the missing mechanism rather than assume the proposed step satisfies the acceptance conditions.
B:The suggested action—measure string length as factual accuracy—does not establish the required control for a legal case-management provider to evaluate whether the generated answer is faithful to retrieved evidence. The change is applied outside the component responsible for the requirement identified by a legal case-management provider. In this deployment, engineers should verify the missing mechanism rather than assume the proposed step satisfies the acceptance conditions.
D:The suggested action—score only whether the response sounds articulate—does not establish the required control for a legal case-management provider to evaluate whether the generated answer is faithful to retrieved evidence. It replaces a verifiable engineering control with an untested shortcut in the a legal case-management provider deployment. In this deployment, engineers should verify the missing mechanism rather than assume the proposed step satisfies the acceptance conditions.
Question 734
At a nonprofit grant portal, engineers need to investigate sudden changes in output format after a prompt release. The next release must be evaluated against the previous baseline. The initial assessment isolates this issue from unrelated infrastructure changes. Which design decision addresses the underlying issue?
- Use billing totals as the sole prompt diagnostic
- Assume every model response must be byte-identical
- Diff prompt versions and test schema compliance on stable regression cases
- Immediately rebuild all AWS networking infrastructure
Explanation
Correct Answer
C:Prompt regressions need version-aware tests and structured output analysis. In a nonprofit grant portal, the engineering team should verify this design against its stated objective to investigate sudden changes in output format after a prompt release, including the requirement that the next release must be evaluated against the previous baseline.
Incorrect Answers
A:The suggested action—use billing totals as the sole prompt diagnostic—does not establish the required control for a nonprofit grant portal to investigate sudden changes in output format after a prompt release. It replaces a verifiable engineering control with an untested shortcut in the a nonprofit grant portal deployment. In this deployment, engineers should verify the missing mechanism rather than assume the proposed step satisfies the acceptance conditions.
B:The suggested action—assume every model response must be byte-identical—does not establish the required control for a nonprofit grant portal to investigate sudden changes in output format after a prompt release. The change is applied outside the component responsible for the requirement identified by a nonprofit grant portal. In this deployment, engineers should verify the missing mechanism rather than assume the proposed step satisfies the acceptance conditions.
D:The suggested action—immediately rebuild all AWS networking infrastructure—does not establish the required control for a nonprofit grant portal to investigate sudden changes in output format after a prompt release. It replaces a verifiable engineering control with an untested shortcut in the a nonprofit grant portal deployment. In this deployment, engineers should verify the missing mechanism rather than assume the proposed step satisfies the acceptance conditions.
Question 735
At a retail bank, engineers need to require machine-readable responses for downstream schema validation. The architecture must minimize avoidable data exposure. The team wants a solution that can be validated through targeted test cases. What should the lead engineer recommend?
- Increase response randomness to guarantee deterministic fields
- Specify an output schema and validate the parsed response before downstream actions
- Assume all natural-language answers are already valid JSON
- Skip validation because the prompt requests JSON
Explanation
Correct Answer
B:Structured generation still needs explicit schema enforcement at integration boundaries. In a retail bank, the engineering team should verify this design against its stated objective to require machine-readable responses for downstream schema validation, including the requirement that the architecture must minimize avoidable data exposure.
Incorrect Answers
A:The suggested action—increase response randomness to guarantee deterministic fields—does not establish the required control for a retail bank to require machine-readable responses for downstream schema validation. No demonstrated capability in this scenario guarantees that this step resolves the concern raised by a retail bank. In this deployment, engineers should verify the missing mechanism rather than assume the proposed step satisfies the acceptance conditions.
C:The suggested action—assume all natural-language answers are already valid JSON—does not establish the required control for a retail bank to require machine-readable responses for downstream schema validation. The change is applied outside the component responsible for the requirement identified by a retail bank. In this deployment, engineers should verify the missing mechanism rather than assume the proposed step satisfies the acceptance conditions.
D:The suggested action—skip validation because the prompt requests JSON—does not establish the required control for a retail bank to require machine-readable responses for downstream schema validation. No demonstrated capability in this scenario guarantees that this step resolves the concern raised by a retail bank. In this deployment, engineers should verify the missing mechanism rather than assume the proposed step satisfies the acceptance conditions.
Question 736
At a municipal services portal, engineers need to process long-running jobs without forcing a synchronous connection to stay open. A controlled rollout is required before broad user exposure. An architecture review has rejected fixes that only conceal the symptoms. What should be implemented before scaling this workflow?
- Queue requests and report job status via an asynchronous workflow
- Keep a user HTTP connection open indefinitely
- Put a batch job identifier in the model temperature field
- Retry the same job without an idempotency strategy
Explanation
Correct Answer
A:Asynchronous orchestration handles long tasks independently of a browser connection. In a municipal services portal, the engineering team should verify this design against its stated objective to process long-running jobs without forcing a synchronous connection to stay open, including the requirement that a controlled rollout is required before broad user exposure.
Incorrect Answers
B:The suggested action—keep a user HTTP connection open indefinitely—does not establish the required control for a municipal services portal to process long-running jobs without forcing a synchronous connection to stay open. It replaces a verifiable engineering control with an untested shortcut in the a municipal services portal deployment. In this deployment, engineers should verify the missing mechanism rather than assume the proposed step satisfies the acceptance conditions.
C:The suggested action—put a batch job identifier in the model temperature field—does not establish the required control for a municipal services portal to process long-running jobs without forcing a synchronous connection to stay open. The change is applied outside the component responsible for the requirement identified by a municipal services portal. In this deployment, engineers should verify the missing mechanism rather than assume the proposed step satisfies the acceptance conditions.
D:The suggested action—retry the same job without an idempotency strategy—does not establish the required control for a municipal services portal to process long-running jobs without forcing a synchronous connection to stay open. No demonstrated capability in this scenario guarantees that this step resolves the concern raised by a municipal services portal. In this deployment, engineers should verify the missing mechanism rather than assume the proposed step satisfies the acceptance conditions.
Question 737
At a public-sector document office, engineers need to debug malformed tool arguments emitted by a model. Monitoring should isolate failures to the responsible component. A recent review found that the current design has no reliable safeguard for this case. What should the lead engineer recommend?
- Execute malformed payloads with administrator rights
- Increase vector search shards without inspecting API errors
- Ignore schema failures until the model guesses the right shape
- Validate against the tool schema, inspect failed payloads and refine tool definitions
Explanation
Correct Answer
D:Tool-call diagnosis examines model outputs against executable interface contracts. In a public-sector document office, the engineering team should verify this design against its stated objective to debug malformed tool arguments emitted by a model, including the requirement that monitoring should isolate failures to the responsible component.
Incorrect Answers
A:The suggested action—execute malformed payloads with administrator rights—does not establish the required control for a public-sector document office to debug malformed tool arguments emitted by a model. The change is applied outside the component responsible for the requirement identified by a public-sector document office. In this deployment, engineers should verify the missing mechanism rather than assume the proposed step satisfies the acceptance conditions.
B:The suggested action—increase vector search shards without inspecting API errors—does not establish the required control for a public-sector document office to debug malformed tool arguments emitted by a model. No demonstrated capability in this scenario guarantees that this step resolves the concern raised by a public-sector document office. In this deployment, engineers should verify the missing mechanism rather than assume the proposed step satisfies the acceptance conditions.
C:The suggested action—ignore schema failures until the model guesses the right shape—does not establish the required control for a public-sector document office to debug malformed tool arguments emitted by a model. It replaces a verifiable engineering control with an untested shortcut in the a public-sector document office deployment. In this deployment, engineers should verify the missing mechanism rather than assume the proposed step satisfies the acceptance conditions.
Question 738
At a commercial property platform, engineers need to provide a lightweight stateless capability to a remote agent. The architecture must avoid unnecessary coupling between components. The initial assessment isolates this issue from unrelated infrastructure changes. Which implementation most directly satisfies the requirement?
- Expose an authenticated MCP-compatible tool endpoint backed by Lambda where appropriate
- Grant the agent a blanket administrative session
- Build a separate foundation model for each tool
- Store persistent state only in a Lambda process global
Explanation
Correct Answer
A:MCP describes interoperable tool access; runtime deployment still requires secure authentication and suitable state handling. In a commercial property platform, the engineering team should verify this design against its stated objective to provide a lightweight stateless capability to a remote agent, including the requirement that the architecture must avoid unnecessary coupling between components.
Incorrect Answers
B:The suggested action—grant the agent a blanket administrative session—does not establish the required control for a commercial property platform to provide a lightweight stateless capability to a remote agent. The change is applied outside the component responsible for the requirement identified by a commercial property platform. In this deployment, engineers should verify the missing mechanism rather than assume the proposed step satisfies the acceptance conditions.
C:The suggested action—build a separate foundation model for each tool—does not establish the required control for a commercial property platform to provide a lightweight stateless capability to a remote agent. No demonstrated capability in this scenario guarantees that this step resolves the concern raised by a commercial property platform. In this deployment, engineers should verify the missing mechanism rather than assume the proposed step satisfies the acceptance conditions.
D:The suggested action—store persistent state only in a Lambda process global—does not establish the required control for a commercial property platform to provide a lightweight stateless capability to a remote agent. It replaces a verifiable engineering control with an untested shortcut in the a commercial property platform deployment. In this deployment, engineers should verify the missing mechanism rather than assume the proposed step satisfies the acceptance conditions.
Question 739
At a payment operations team, engineers need to roll out organizational safety policy consistently to multiple AI products. The solution must tolerate transient dependency failures. An architecture review has rejected fixes that only conceal the symptoms. What should be implemented before scaling this workflow?
- Version approved guardrail policies and validate each integration against the standard
- Allow teams to silently disable moderation for speed
- Use one hard-coded forbidden word as the entire policy
- Delegate security policy approval to unaudited user prompts
Explanation
Correct Answer
A:Centralized governance needs enforceable policy versions and deployment verification. In a payment operations team, the engineering team should verify this design against its stated objective to roll out organizational safety policy consistently to multiple AI products, including the requirement that the solution must tolerate transient dependency failures.
Incorrect Answers
B:The suggested action—allow teams to silently disable moderation for speed—does not establish the required control for a payment operations team to roll out organizational safety policy consistently to multiple AI products. It replaces a verifiable engineering control with an untested shortcut in the a payment operations team deployment. In this deployment, engineers should verify the missing mechanism rather than assume the proposed step satisfies the acceptance conditions.
C:The suggested action—use one hard-coded forbidden word as the entire policy—does not establish the required control for a payment operations team to roll out organizational safety policy consistently to multiple AI products. The change is applied outside the component responsible for the requirement identified by a payment operations team. In this deployment, engineers should verify the missing mechanism rather than assume the proposed step satisfies the acceptance conditions.
D:The suggested action—delegate security policy approval to unaudited user prompts—does not establish the required control for a payment operations team to roll out organizational safety policy consistently to multiple AI products. No demonstrated capability in this scenario guarantees that this step resolves the concern raised by a payment operations team. In this deployment, engineers should verify the missing mechanism rather than assume the proposed step satisfies the acceptance conditions.
Question 740
At an airline operations unit, engineers need to coordinate agents performing specialized research and verification tasks. The team must preserve existing identity and authorization boundaries. The team wants a solution that can be validated through targeted test cases. What is the most appropriate production approach?
- Let agents recursively call one another without a coordination policy
- Assume every agent has access to every private data source
- Concatenate outputs without conflict resolution
- Use a controlled supervisor workflow with bounded handoffs and combined results
Explanation
Correct Answer
D:Multi-agent orchestration needs roles, shared state contracts and controlled delegation. In an airline operations unit, the engineering team should verify this design against its stated objective to coordinate agents performing specialized research and verification tasks, including the requirement that the team must preserve existing identity and authorization boundaries.
Incorrect Answers
A:The suggested action—let agents recursively call one another without a coordination policy—does not establish the required control for an airline operations unit to coordinate agents performing specialized research and verification tasks. It replaces a verifiable engineering control with an untested shortcut in the an airline operations unit deployment. In this deployment, engineers should verify the missing mechanism rather than assume the proposed step satisfies the acceptance conditions.
B:The suggested action—assume every agent has access to every private data source—does not establish the required control for an airline operations unit to coordinate agents performing specialized research and verification tasks. The change is applied outside the component responsible for the requirement identified by an airline operations unit. In this deployment, engineers should verify the missing mechanism rather than assume the proposed step satisfies the acceptance conditions.
C:The suggested action—concatenate outputs without conflict resolution—does not establish the required control for an airline operations unit to coordinate agents performing specialized research and verification tasks. No demonstrated capability in this scenario guarantees that this step resolves the concern raised by an airline operations unit. In this deployment, engineers should verify the missing mechanism rather than assume the proposed step satisfies the acceptance conditions.