Question 1060
At a travel services company, engineers need to assess agent workflows that must call external tools accurately. The architecture must minimize avoidable data exposure. The team wants a solution that can be validated through targeted test cases. What should be implemented before scaling this workflow?
- Check only the model's prose fluency
- Ignore side effects and consider any final answer a success
- Measure task success, tool-choice correctness, authorization failures and excessive steps
- Count total tool calls and assume more is better
Explanation
Correct Answer
C:Agent evaluation must include execution behavior and real task outcomes. In a travel services company, the engineering team should verify this design against its stated objective to assess agent workflows that must call external tools accurately, including the requirement that the architecture must minimize avoidable data exposure.
Incorrect Answers
A:The suggested action—check only the model's prose fluency—does not establish the required control for a travel services company to assess agent workflows that must call external tools accurately. It replaces a verifiable engineering control with an untested shortcut in the a travel services company deployment. In this deployment, engineers should verify the missing mechanism rather than assume the proposed step satisfies the acceptance conditions.
B:The suggested action—ignore side effects and consider any final answer a success—does not establish the required control for a travel services company to assess agent workflows that must call external tools accurately. The change is applied outside the component responsible for the requirement identified by a travel services company. In this deployment, engineers should verify the missing mechanism rather than assume the proposed step satisfies the acceptance conditions.
D:The suggested action—count total tool calls and assume more is better—does not establish the required control for a travel services company to assess agent workflows that must call external tools accurately. It replaces a verifiable engineering control with an untested shortcut in the a travel services company deployment. In this deployment, engineers should verify the missing mechanism rather than assume the proposed step satisfies the acceptance conditions.
Question 1061
At a municipal services portal, engineers need to reduce cost for simple classifications while retaining advanced reasoning for exceptions. The organization needs repeatable automated validation. The team wants a solution that can be validated through targeted test cases. Which design decision addresses the underlying issue?
- Lower every response quality threshold to minimize invocation counts
- Change the vector index instead of the inference policy
- Cascade from a smaller capable model to a stronger model when confidence or policy requires
- Invoke the most expensive model for every trivial request
Explanation
Correct Answer
C:Model cascading makes expensive inference conditional on measured task difficulty. In a municipal services portal, the engineering team should verify this design against its stated objective to reduce cost for simple classifications while retaining advanced reasoning for exceptions, including the requirement that the organization needs repeatable automated validation.
Incorrect Answers
A:The suggested action—lower every response quality threshold to minimize invocation counts—does not establish the required control for a municipal services portal to reduce cost for simple classifications while retaining advanced reasoning for exceptions. No demonstrated capability in this scenario guarantees that this step resolves the concern raised by a municipal services portal. In this deployment, engineers should verify the missing mechanism rather than assume the proposed step satisfies the acceptance conditions.
B:The suggested action—change the vector index instead of the inference policy—does not establish the required control for a municipal services portal to reduce cost for simple classifications while retaining advanced reasoning for exceptions. It replaces a verifiable engineering control with an untested shortcut in the a municipal services portal deployment. In this deployment, engineers should verify the missing mechanism rather than assume the proposed step satisfies the acceptance conditions.
D:The suggested action—invoke the most expensive model for every trivial request—does not establish the required control for a municipal services portal to reduce cost for simple classifications while retaining advanced reasoning for exceptions. No demonstrated capability in this scenario guarantees that this step resolves the concern raised by a municipal services portal. In this deployment, engineers should verify the missing mechanism rather than assume the proposed step satisfies the acceptance conditions.
Question 1062
At a legal case-management provider, engineers need to maintain service during a model-specific regional disruption. The next release must be evaluated against the previous baseline. The team wants a solution that can be validated through targeted test cases. Which change should the team prioritize?
- Evaluate eligible cross-Region inference profiles and compliance requirements
- Assume any model can be invoked in every destination Region
- Disable data residency checks when invoking fallback Regions
- Move all customer records to a public web endpoint
Explanation
Correct Answer
A:Cross-Region choices depend on supported model profiles and allowed processing Regions. In a legal case-management provider, the engineering team should verify this design against its stated objective to maintain service during a model-specific regional disruption, including the requirement that the next release must be evaluated against the previous baseline.
Incorrect Answers
B:The suggested action—assume any model can be invoked in every destination Region—does not establish the required control for a legal case-management provider to maintain service during a model-specific regional disruption. The change is applied outside the component responsible for the requirement identified by a legal case-management provider. In this deployment, engineers should verify the missing mechanism rather than assume the proposed step satisfies the acceptance conditions.
C:The suggested action—disable data residency checks when invoking fallback Regions—does not establish the required control for a legal case-management provider to maintain service during a model-specific regional disruption. No demonstrated capability in this scenario guarantees that this step resolves the concern raised by a legal case-management provider. In this deployment, engineers should verify the missing mechanism rather than assume the proposed step satisfies the acceptance conditions.
D:The suggested action—move all customer records to a public web endpoint—does not establish the required control for a legal case-management provider to maintain service during a model-specific regional disruption. It replaces a verifiable engineering control with an untested shortcut in the a legal case-management provider deployment. In this deployment, engineers should verify the missing mechanism rather than assume the proposed step satisfies the acceptance conditions.
Question 1063
At a travel services company, engineers need to process long-running jobs without forcing a synchronous connection to stay open. The organization needs repeatable automated validation. An architecture review has rejected fixes that only conceal the symptoms. What should be implemented before scaling this workflow?
- Queue requests and report job status via an asynchronous workflow
- Keep a user HTTP connection open indefinitely
- Put a batch job identifier in the model temperature field
- Retry the same job without an idempotency strategy
Explanation
Correct Answer
A:Asynchronous orchestration handles long tasks independently of a browser connection. In a travel services company, the engineering team should verify this design against its stated objective to process long-running jobs without forcing a synchronous connection to stay open, including the requirement that the organization needs repeatable automated validation.
Incorrect Answers
B:The suggested action—keep a user HTTP connection open indefinitely—does not establish the required control for a travel services company to process long-running jobs without forcing a synchronous connection to stay open. The change is applied outside the component responsible for the requirement identified by a travel services company. In this deployment, engineers should verify the missing mechanism rather than assume the proposed step satisfies the acceptance conditions.
C:The suggested action—put a batch job identifier in the model temperature field—does not establish the required control for a travel services company to process long-running jobs without forcing a synchronous connection to stay open. No demonstrated capability in this scenario guarantees that this step resolves the concern raised by a travel services company. In this deployment, engineers should verify the missing mechanism rather than assume the proposed step satisfies the acceptance conditions.
D:The suggested action—retry the same job without an idempotency strategy—does not establish the required control for a travel services company to process long-running jobs without forcing a synchronous connection to stay open. It replaces a verifiable engineering control with an untested shortcut in the a travel services company deployment. In this deployment, engineers should verify the missing mechanism rather than assume the proposed step satisfies the acceptance conditions.
Question 1064
At an airline operations unit, engineers need to meet a strict data residency requirement during GenAI design. The implementation must remain maintainable across model upgrades. An architecture review has rejected fixes that only conceal the symptoms. What is the most appropriate production approach?
- Store all source documents in an unrestricted global repository
- Verify model and retrieval service Region support, data flows and jurisdictional constraints
- Assume every Bedrock model is available in every AWS Region
- Rely on a client-side warning instead of controlling data movement
Explanation
Correct Answer
B:Region-aware design must account for inference, storage and supporting integration paths. In an airline operations unit, the engineering team should verify this design against its stated objective to meet a strict data residency requirement during GenAI design, including the requirement that the implementation must remain maintainable across model upgrades.
Incorrect Answers
A:The suggested action—store all source documents in an unrestricted global repository—does not establish the required control for an airline operations unit to meet a strict data residency requirement during GenAI design. No demonstrated capability in this scenario guarantees that this step resolves the concern raised by an airline operations unit. In this deployment, engineers should verify the missing mechanism rather than assume the proposed step satisfies the acceptance conditions.
C:The suggested action—assume every Bedrock model is available in every AWS Region—does not establish the required control for an airline operations unit to meet a strict data residency requirement during GenAI design. The change is applied outside the component responsible for the requirement identified by an airline operations unit. In this deployment, engineers should verify the missing mechanism rather than assume the proposed step satisfies the acceptance conditions.
D:The suggested action—rely on a client-side warning instead of controlling data movement—does not establish the required control for an airline operations unit to meet a strict data residency requirement during GenAI design. No demonstrated capability in this scenario guarantees that this step resolves the concern raised by an airline operations unit. In this deployment, engineers should verify the missing mechanism rather than assume the proposed step satisfies the acceptance conditions.
Question 1065
At an airline operations unit, engineers need to assess agent workflows that must call external tools accurately. The next release must be evaluated against the previous baseline. An architecture review has rejected fixes that only conceal the symptoms. What is the most appropriate production approach?
- Ignore side effects and consider any final answer a success
- Measure task success, tool-choice correctness, authorization failures and excessive steps
- Count total tool calls and assume more is better
- Check only the model's prose fluency
Explanation
Correct Answer
B:Agent evaluation must include execution behavior and real task outcomes. In an airline operations unit, the engineering team should verify this design against its stated objective to assess agent workflows that must call external tools accurately, including the requirement that the next release must be evaluated against the previous baseline.
Incorrect Answers
A:The suggested action—ignore side effects and consider any final answer a success—does not establish the required control for an airline operations unit to assess agent workflows that must call external tools accurately. The change is applied outside the component responsible for the requirement identified by an airline operations unit. In this deployment, engineers should verify the missing mechanism rather than assume the proposed step satisfies the acceptance conditions.
C:The suggested action—count total tool calls and assume more is better—does not establish the required control for an airline operations unit to assess agent workflows that must call external tools accurately. It replaces a verifiable engineering control with an untested shortcut in the an airline operations unit deployment. In this deployment, engineers should verify the missing mechanism rather than assume the proposed step satisfies the acceptance conditions.
D:The suggested action—check only the model's prose fluency—does not establish the required control for an airline operations unit to assess agent workflows that must call external tools accurately. The change is applied outside the component responsible for the requirement identified by an airline operations unit. In this deployment, engineers should verify the missing mechanism rather than assume the proposed step satisfies the acceptance conditions.
Question 1066
At a pharmaceutical documentation team, engineers need to validate a risky new model version before sending all production traffic. The implementation must remain maintainable across model upgrades. The initial assessment isolates this issue from unrelated infrastructure changes. What should the lead engineer recommend?
- Disable monitoring until the new model stabilizes
- Deploy a measured canary with rollback thresholds and human review as required
- Replace every production route at once without evaluation
- Assume offline model benchmarks guarantee production behavior
Explanation
Correct Answer
B:Canary evaluation detects live regressions under limited exposure. In a pharmaceutical documentation team, the engineering team should verify this design against its stated objective to validate a risky new model version before sending all production traffic, including the requirement that the implementation must remain maintainable across model upgrades.
Incorrect Answers
A:The suggested action—disable monitoring until the new model stabilizes—does not establish the required control for a pharmaceutical documentation team to validate a risky new model version before sending all production traffic. It replaces a verifiable engineering control with an untested shortcut in the a pharmaceutical documentation team deployment. In this deployment, engineers should verify the missing mechanism rather than assume the proposed step satisfies the acceptance conditions.
C:The suggested action—replace every production route at once without evaluation—does not establish the required control for a pharmaceutical documentation team to validate a risky new model version before sending all production traffic. No demonstrated capability in this scenario guarantees that this step resolves the concern raised by a pharmaceutical documentation team. In this deployment, engineers should verify the missing mechanism rather than assume the proposed step satisfies the acceptance conditions.
D:The suggested action—assume offline model benchmarks guarantee production behavior—does not establish the required control for a pharmaceutical documentation team to validate a risky new model version before sending all production traffic. It replaces a verifiable engineering control with an untested shortcut in the a pharmaceutical documentation team deployment. In this deployment, engineers should verify the missing mechanism rather than assume the proposed step satisfies the acceptance conditions.
Question 1067
At a clinical scheduling platform, engineers need to select an embedding model for a multilingual document repository. Operators need measurable acceptance criteria before rollout. The team wants a solution that can be validated through targeted test cases. Which design decision addresses the underlying issue?
- Assume one embedding vector can be compared directly across unrelated embedding spaces
- Use text-generation temperature as a vector similarity metric
- Benchmark candidate multilingual embeddings with representative relevance queries
- Choose the lowest embedding dimension without testing retrieval quality
Explanation
Correct Answer
C:Embedding choice must fit language coverage and be consistent between queries and indexed content. In a clinical scheduling platform, the engineering team should verify this design against its stated objective to select an embedding model for a multilingual document repository, including the requirement that operators need measurable acceptance criteria before rollout.
Incorrect Answers
A:The suggested action—assume one embedding vector can be compared directly across unrelated embedding spaces—does not establish the required control for a clinical scheduling platform to select an embedding model for a multilingual document repository. No demonstrated capability in this scenario guarantees that this step resolves the concern raised by a clinical scheduling platform. In this deployment, engineers should verify the missing mechanism rather than assume the proposed step satisfies the acceptance conditions.
B:The suggested action—use text-generation temperature as a vector similarity metric—does not establish the required control for a clinical scheduling platform to select an embedding model for a multilingual document repository. It replaces a verifiable engineering control with an untested shortcut in the a clinical scheduling platform deployment. In this deployment, engineers should verify the missing mechanism rather than assume the proposed step satisfies the acceptance conditions.
D:The suggested action—choose the lowest embedding dimension without testing retrieval quality—does not establish the required control for a clinical scheduling platform to select an embedding model for a multilingual document repository. No demonstrated capability in this scenario guarantees that this step resolves the concern raised by a clinical scheduling platform. In this deployment, engineers should verify the missing mechanism rather than assume the proposed step satisfies the acceptance conditions.
Question 1068
At a logistics marketplace, engineers need to add an auditable text-generation endpoint to a legacy application. The team must preserve existing identity and authorization boundaries. The initial assessment isolates this issue from unrelated infrastructure changes. Which remediation addresses the root problem?
- Give the legacy client direct unrestricted model credentials
- Send all requests through an unauthenticated public Lambda URL
- Replace the legacy database with prompt output
- Expose a validated API contract via API Gateway and a secured integration backend
Explanation
Correct Answer
D:An API facade enables authorization, throttling, versioning and consistent integration. In a logistics marketplace, the engineering team should verify this design against its stated objective to add an auditable text-generation endpoint to a legacy application, including the requirement that the team must preserve existing identity and authorization boundaries.
Incorrect Answers
A:The suggested action—give the legacy client direct unrestricted model credentials—does not establish the required control for a logistics marketplace to add an auditable text-generation endpoint to a legacy application. No demonstrated capability in this scenario guarantees that this step resolves the concern raised by a logistics marketplace. In this deployment, engineers should verify the missing mechanism rather than assume the proposed step satisfies the acceptance conditions.
B:The suggested action—send all requests through an unauthenticated public Lambda URL—does not establish the required control for a logistics marketplace to add an auditable text-generation endpoint to a legacy application. It replaces a verifiable engineering control with an untested shortcut in the a logistics marketplace deployment. In this deployment, engineers should verify the missing mechanism rather than assume the proposed step satisfies the acceptance conditions.
C:The suggested action—replace the legacy database with prompt output—does not establish the required control for a logistics marketplace to add an auditable text-generation endpoint to a legacy application. The change is applied outside the component responsible for the requirement identified by a logistics marketplace. In this deployment, engineers should verify the missing mechanism rather than assume the proposed step satisfies the acceptance conditions.
Question 1069
At a regional insurer, engineers need to obtain human approval before an agent executes a financial adjustment. The team must preserve existing identity and authorization boundaries. The team wants a solution that can be validated through targeted test cases. Which implementation most directly satisfies the requirement?
- Suspend the workflow for an explicit approval decision before the write action
- Let the model infer user consent from tone
- Complete the adjustment first and request approval later
- Store an unverified approval in the prompt
Explanation
Correct Answer
A:Human-in-the-loop checkpoints should gate consequential actions before execution. In a regional insurer, the engineering team should verify this design against its stated objective to obtain human approval before an agent executes a financial adjustment, including the requirement that the team must preserve existing identity and authorization boundaries.
Incorrect Answers
B:The suggested action—let the model infer user consent from tone—does not establish the required control for a regional insurer to obtain human approval before an agent executes a financial adjustment. The change is applied outside the component responsible for the requirement identified by a regional insurer. In this deployment, engineers should verify the missing mechanism rather than assume the proposed step satisfies the acceptance conditions.
C:The suggested action—complete the adjustment first and request approval later—does not establish the required control for a regional insurer to obtain human approval before an agent executes a financial adjustment. No demonstrated capability in this scenario guarantees that this step resolves the concern raised by a regional insurer. In this deployment, engineers should verify the missing mechanism rather than assume the proposed step satisfies the acceptance conditions.
D:The suggested action—store an unverified approval in the prompt—does not establish the required control for a regional insurer to obtain human approval before an agent executes a financial adjustment. It replaces a verifiable engineering control with an untested shortcut in the a regional insurer deployment. In this deployment, engineers should verify the missing mechanism rather than assume the proposed step satisfies the acceptance conditions.
Question 1070
At a security incident response team, engineers need to deploy AI application changes with automated safety regression gates. The service must continue to support multiple independent tenants. The initial assessment isolates this issue from unrelated infrastructure changes. Which change should the team prioritize?
- Use a CI/CD pipeline with quality tests, approvals and reversible deployments
- Push a changed prompt directly to every production client
- Omit rollback because models are probabilistic
- Test only whether the web server responds with HTTP 200
Explanation
Correct Answer
A:AI-specific release gates examine output behavior as well as software build success. In a security incident response team, the engineering team should verify this design against its stated objective to deploy AI application changes with automated safety regression gates, including the requirement that the service must continue to support multiple independent tenants.
Incorrect Answers
B:The suggested action—push a changed prompt directly to every production client—does not establish the required control for a security incident response team to deploy AI application changes with automated safety regression gates. The change is applied outside the component responsible for the requirement identified by a security incident response team. In this deployment, engineers should verify the missing mechanism rather than assume the proposed step satisfies the acceptance conditions.
C:The suggested action—omit rollback because models are probabilistic—does not establish the required control for a security incident response team to deploy AI application changes with automated safety regression gates. No demonstrated capability in this scenario guarantees that this step resolves the concern raised by a security incident response team. In this deployment, engineers should verify the missing mechanism rather than assume the proposed step satisfies the acceptance conditions.
D:The suggested action—test only whether the web server responds with HTTP 200—does not establish the required control for a security incident response team to deploy AI application changes with automated safety regression gates. It replaces a verifiable engineering control with an untested shortcut in the a security incident response team deployment. In this deployment, engineers should verify the missing mechanism rather than assume the proposed step satisfies the acceptance conditions.