Question 1110
At a commercial property platform, engineers need to retrieve answers that require exact product codes and semantic similarity. Monitoring should isolate failures to the responsible component. The initial assessment isolates this issue from unrelated infrastructure changes. Which change should the team prioritize?
- Combine keyword and vector retrieval with relevance evaluation
- Use only random document sampling
- Replace retrieval with a high-temperature model guess
- Remove product identifiers during preprocessing
Explanation
Correct Answer
A:Hybrid retrieval combines lexical matches with embedding-based semantic matches. In a commercial property platform, the engineering team should verify this design against its stated objective to retrieve answers that require exact product codes and semantic similarity, including the requirement that monitoring should isolate failures to the responsible component.
Incorrect Answers
B:The suggested action—use only random document sampling—does not establish the required control for a commercial property platform to retrieve answers that require exact product codes and semantic similarity. No demonstrated capability in this scenario guarantees that this step resolves the concern raised by a commercial property platform. In this deployment, engineers should verify the missing mechanism rather than assume the proposed step satisfies the acceptance conditions.
C:The suggested action—replace retrieval with a high-temperature model guess—does not establish the required control for a commercial property platform to retrieve answers that require exact product codes and semantic similarity. It replaces a verifiable engineering control with an untested shortcut in the a commercial property platform deployment. In this deployment, engineers should verify the missing mechanism rather than assume the proposed step satisfies the acceptance conditions.
D:The suggested action—remove product identifiers during preprocessing—does not establish the required control for a commercial property platform to retrieve answers that require exact product codes and semantic similarity. The change is applied outside the component responsible for the requirement identified by a commercial property platform. In this deployment, engineers should verify the missing mechanism rather than assume the proposed step satisfies the acceptance conditions.
Question 1111
At an airline operations unit, engineers need to version and safely replace an adapted domain model. The implementation must remain maintainable across model upgrades. The initial assessment isolates this issue from unrelated infrastructure changes. Which remediation addresses the root problem?
- Overwrite the only production model artifact
- Deploy an adapted model without performance evaluation
- Treat prompts as a substitute for a failed model rollout
- Register model artifacts, validate a candidate deployment and retain rollback capability
Explanation
Correct Answer
D:A controlled model lifecycle distinguishes approved versions and reversible deployment decisions. In an airline operations unit, the engineering team should verify this design against its stated objective to version and safely replace an adapted domain model, including the requirement that the implementation must remain maintainable across model upgrades.
Incorrect Answers
A:The suggested action—overwrite the only production model artifact—does not establish the required control for an airline operations unit to version and safely replace an adapted domain model. The change is applied outside the component responsible for the requirement identified by an airline operations unit. In this deployment, engineers should verify the missing mechanism rather than assume the proposed step satisfies the acceptance conditions.
B:The suggested action—deploy an adapted model without performance evaluation—does not establish the required control for an airline operations unit to version and safely replace an adapted domain model. No demonstrated capability in this scenario guarantees that this step resolves the concern raised by an airline operations unit. In this deployment, engineers should verify the missing mechanism rather than assume the proposed step satisfies the acceptance conditions.
C:The suggested action—treat prompts as a substitute for a failed model rollout—does not establish the required control for an airline operations unit to version and safely replace an adapted domain model. It replaces a verifiable engineering control with an untested shortcut in the an airline operations unit deployment. In this deployment, engineers should verify the missing mechanism rather than assume the proposed step satisfies the acceptance conditions.
Question 1112
At a logistics marketplace, engineers need to measure whether a RAG system retrieves the right supporting passages. Operators need measurable acceptance criteria before rollout. A recent review found that the current design has no reliable safeguard for this case. Which remediation addresses the root problem?
- Remove labeled documents from the test set
- Evaluate retrieval recall or precision against annotated query-document pairs
- Grade only fluency of final text
- Measure GPU utilization and infer document relevance
Explanation
Correct Answer
B:Retrieval-stage metrics isolate evidence selection from answer generation. In a logistics marketplace, the engineering team should verify this design against its stated objective to measure whether a RAG system retrieves the right supporting passages, including the requirement that operators need measurable acceptance criteria before rollout.
Incorrect Answers
A:The suggested action—remove labeled documents from the test set—does not establish the required control for a logistics marketplace to measure whether a RAG system retrieves the right supporting passages. It replaces a verifiable engineering control with an untested shortcut in the a logistics marketplace deployment. In this deployment, engineers should verify the missing mechanism rather than assume the proposed step satisfies the acceptance conditions.
C:The suggested action—grade only fluency of final text—does not establish the required control for a logistics marketplace to measure whether a RAG system retrieves the right supporting passages. No demonstrated capability in this scenario guarantees that this step resolves the concern raised by a logistics marketplace. In this deployment, engineers should verify the missing mechanism rather than assume the proposed step satisfies the acceptance conditions.
D:The suggested action—measure GPU utilization and infer document relevance—does not establish the required control for a logistics marketplace to measure whether a RAG system retrieves the right supporting passages. It replaces a verifiable engineering control with an untested shortcut in the a logistics marketplace deployment. In this deployment, engineers should verify the missing mechanism rather than assume the proposed step satisfies the acceptance conditions.
Question 1113
At a commercial property platform, engineers need to validate a risky new model version before sending all production traffic. The architecture must minimize avoidable data exposure. An architecture review has rejected fixes that only conceal the symptoms. Which implementation most directly satisfies the requirement?
- Assume offline model benchmarks guarantee production behavior
- Disable monitoring until the new model stabilizes
- Deploy a measured canary with rollback thresholds and human review as required
- Replace every production route at once without evaluation
Explanation
Correct Answer
C:Canary evaluation detects live regressions under limited exposure. In a commercial property platform, the engineering team should verify this design against its stated objective to validate a risky new model version before sending all production traffic, including the requirement that the architecture must minimize avoidable data exposure.
Incorrect Answers
A:The suggested action—assume offline model benchmarks guarantee production behavior—does not establish the required control for a commercial property platform to validate a risky new model version before sending all production traffic. It replaces a verifiable engineering control with an untested shortcut in the a commercial property platform deployment. In this deployment, engineers should verify the missing mechanism rather than assume the proposed step satisfies the acceptance conditions.
B:The suggested action—disable monitoring until the new model stabilizes—does not establish the required control for a commercial property platform to validate a risky new model version before sending all production traffic. The change is applied outside the component responsible for the requirement identified by a commercial property platform. In this deployment, engineers should verify the missing mechanism rather than assume the proposed step satisfies the acceptance conditions.
D:The suggested action—replace every production route at once without evaluation—does not establish the required control for a commercial property platform to validate a risky new model version before sending all production traffic. It replaces a verifiable engineering control with an untested shortcut in the a commercial property platform deployment. In this deployment, engineers should verify the missing mechanism rather than assume the proposed step satisfies the acceptance conditions.
Question 1114
At a payment operations team, engineers need to recover from a temporary model throttle during API invocation. The service must continue to support multiple independent tenants. A recent review found that the current design has no reliable safeguard for this case. Which design decision addresses the underlying issue?
- Apply capped exponential backoff with jitter and respect quotas
- Retry in a tight infinite loop
- Increase all request payloads to improve quota allocation
- Treat throttling as proof that the model's factual answer is wrong
Explanation
Correct Answer
A:Rate-limit recovery needs paced retries and a strategy for sustained overload. In a payment operations team, the engineering team should verify this design against its stated objective to recover from a temporary model throttle during API invocation, including the requirement that the service must continue to support multiple independent tenants.
Incorrect Answers
B:The suggested action—retry in a tight infinite loop—does not establish the required control for a payment operations team to recover from a temporary model throttle during API invocation. No demonstrated capability in this scenario guarantees that this step resolves the concern raised by a payment operations team. In this deployment, engineers should verify the missing mechanism rather than assume the proposed step satisfies the acceptance conditions.
C:The suggested action—increase all request payloads to improve quota allocation—does not establish the required control for a payment operations team to recover from a temporary model throttle during API invocation. It replaces a verifiable engineering control with an untested shortcut in the a payment operations team deployment. In this deployment, engineers should verify the missing mechanism rather than assume the proposed step satisfies the acceptance conditions.
D:The suggested action—treat throttling as proof that the model's factual answer is wrong—does not establish the required control for a payment operations team to recover from a temporary model throttle during API invocation. The change is applied outside the component responsible for the requirement identified by a payment operations team. In this deployment, engineers should verify the missing mechanism rather than assume the proposed step satisfies the acceptance conditions.
Question 1115
At a SaaS procurement platform, engineers need to share approved GenAI reference architectures among teams. Operators need measurable acceptance criteria before rollout. The team wants a solution that can be validated through targeted test cases. Which remediation addresses the root problem?
- Let each team implement security and observability independently
- Require identical models for every team regardless of use case
- Skip nonfunctional requirements until deployment
- Define reusable infrastructure patterns and apply the AWS Well-Architected Generative AI Lens
Explanation
Correct Answer
D:Reusable patterns standardize cross-cutting controls while preserving workload choices. In a SaaS procurement platform, the engineering team should verify this design against its stated objective to share approved GenAI reference architectures among teams, including the requirement that operators need measurable acceptance criteria before rollout.
Incorrect Answers
A:The suggested action—let each team implement security and observability independently—does not establish the required control for a SaaS procurement platform to share approved GenAI reference architectures among teams. The change is applied outside the component responsible for the requirement identified by a SaaS procurement platform. In this deployment, engineers should verify the missing mechanism rather than assume the proposed step satisfies the acceptance conditions.
B:The suggested action—require identical models for every team regardless of use case—does not establish the required control for a SaaS procurement platform to share approved GenAI reference architectures among teams. No demonstrated capability in this scenario guarantees that this step resolves the concern raised by a SaaS procurement platform. In this deployment, engineers should verify the missing mechanism rather than assume the proposed step satisfies the acceptance conditions.
C:The suggested action—skip nonfunctional requirements until deployment—does not establish the required control for a SaaS procurement platform to share approved GenAI reference architectures among teams. It replaces a verifiable engineering control with an untested shortcut in the a SaaS procurement platform deployment. In this deployment, engineers should verify the missing mechanism rather than assume the proposed step satisfies the acceptance conditions.
Question 1116
At a shipping brokerage, engineers need to combine content filters with custom domain-specific safety policy. The design must distinguish inference behavior from upstream data quality. A recent review found that the current design has no reliable safeguard for this case. What should the lead engineer recommend?
- Assume one generic keyword list covers every threat class
- Disable tool authorization after adding content filtering
- Accept all outputs that pass JSON parsing regardless of policy
- Layer model guardrails with application validation and post-processing checks
Explanation
Correct Answer
D:Defense in depth covers different failure modes at independent enforcement points. In a shipping brokerage, the engineering team should verify this design against its stated objective to combine content filters with custom domain-specific safety policy, including the requirement that the design must distinguish inference behavior from upstream data quality.
Incorrect Answers
A:The suggested action—assume one generic keyword list covers every threat class—does not establish the required control for a shipping brokerage to combine content filters with custom domain-specific safety policy. It replaces a verifiable engineering control with an untested shortcut in the a shipping brokerage deployment. In this deployment, engineers should verify the missing mechanism rather than assume the proposed step satisfies the acceptance conditions.
B:The suggested action—disable tool authorization after adding content filtering—does not establish the required control for a shipping brokerage to combine content filters with custom domain-specific safety policy. The change is applied outside the component responsible for the requirement identified by a shipping brokerage. In this deployment, engineers should verify the missing mechanism rather than assume the proposed step satisfies the acceptance conditions.
C:The suggested action—accept all outputs that pass JSON parsing regardless of policy—does not establish the required control for a shipping brokerage to combine content filters with custom domain-specific safety policy. No demonstrated capability in this scenario guarantees that this step resolves the concern raised by a shipping brokerage. In this deployment, engineers should verify the missing mechanism rather than assume the proposed step satisfies the acceptance conditions.
Question 1117
At a commercial property platform, engineers need to preserve user conversation context safely across stateless invocations. The next release must be evaluated against the previous baseline. The initial assessment isolates this issue from unrelated infrastructure changes. Which change should the team prioritize?
- Store scoped conversation state with retention rules and replay only relevant history
- Put all users in a single shared memory record
- Store unlimited conversation history in every prompt
- Assume a stateless Lambda invocation retains memory between executions
Explanation
Correct Answer
A:External state management preserves context without violating user isolation or token budgets. In a commercial property platform, the engineering team should verify this design against its stated objective to preserve user conversation context safely across stateless invocations, including the requirement that the next release must be evaluated against the previous baseline.
Incorrect Answers
B:The suggested action—put all users in a single shared memory record—does not establish the required control for a commercial property platform to preserve user conversation context safely across stateless invocations. The change is applied outside the component responsible for the requirement identified by a commercial property platform. In this deployment, engineers should verify the missing mechanism rather than assume the proposed step satisfies the acceptance conditions.
C:The suggested action—store unlimited conversation history in every prompt—does not establish the required control for a commercial property platform to preserve user conversation context safely across stateless invocations. No demonstrated capability in this scenario guarantees that this step resolves the concern raised by a commercial property platform. In this deployment, engineers should verify the missing mechanism rather than assume the proposed step satisfies the acceptance conditions.
D:The suggested action—assume a stateless Lambda invocation retains memory between executions—does not establish the required control for a commercial property platform to preserve user conversation context safely across stateless invocations. It replaces a verifiable engineering control with an untested shortcut in the a commercial property platform deployment. In this deployment, engineers should verify the missing mechanism rather than assume the proposed step satisfies the acceptance conditions.
Question 1118
At a nonprofit grant portal, engineers need to monitor vector index freshness and ingestion failures. The migration must preserve existing downstream API contracts. An architecture review has rejected fixes that only conceal the symptoms. Which design decision addresses the underlying issue?
- Measure document lag, failed updates and retrieval-health indicators
- Monitor only model output length
- Assume all index updates succeed after receiving HTTP 202
- Never record deleted-source propagation
Explanation
Correct Answer
A:Index-health observability complements model invocation metrics. In a nonprofit grant portal, the engineering team should verify this design against its stated objective to monitor vector index freshness and ingestion failures, including the requirement that the migration must preserve existing downstream API contracts.
Incorrect Answers
B:The suggested action—monitor only model output length—does not establish the required control for a nonprofit grant portal to monitor vector index freshness and ingestion failures. It replaces a verifiable engineering control with an untested shortcut in the a nonprofit grant portal deployment. In this deployment, engineers should verify the missing mechanism rather than assume the proposed step satisfies the acceptance conditions.
C:The suggested action—assume all index updates succeed after receiving HTTP 202—does not establish the required control for a nonprofit grant portal to monitor vector index freshness and ingestion failures. The change is applied outside the component responsible for the requirement identified by a nonprofit grant portal. In this deployment, engineers should verify the missing mechanism rather than assume the proposed step satisfies the acceptance conditions.
D:The suggested action—never record deleted-source propagation—does not establish the required control for a nonprofit grant portal to monitor vector index freshness and ingestion failures. No demonstrated capability in this scenario guarantees that this step resolves the concern raised by a nonprofit grant portal. In this deployment, engineers should verify the missing mechanism rather than assume the proposed step satisfies the acceptance conditions.
Question 1119
At an automotive parts supplier, engineers need to connect cloud inference to restricted on-premises systems. The team must preserve existing identity and authorization boundaries. The initial assessment isolates this issue from unrelated infrastructure changes. What should the lead engineer recommend?
- Store unrestricted database credentials in the prompt
- Use controlled private connectivity and enforce access and residency policies
- Make the on-premises data store public for convenience
- Assume cross-environment traffic is always private without configuration
Explanation
Correct Answer
B:Enterprise integration must explicitly secure networks, identities and data paths. In an automotive parts supplier, the engineering team should verify this design against its stated objective to connect cloud inference to restricted on-premises systems, including the requirement that the team must preserve existing identity and authorization boundaries.
Incorrect Answers
A:The suggested action—store unrestricted database credentials in the prompt—does not establish the required control for an automotive parts supplier to connect cloud inference to restricted on-premises systems. The change is applied outside the component responsible for the requirement identified by an automotive parts supplier. In this deployment, engineers should verify the missing mechanism rather than assume the proposed step satisfies the acceptance conditions.
C:The suggested action—make the on-premises data store public for convenience—does not establish the required control for an automotive parts supplier to connect cloud inference to restricted on-premises systems. It replaces a verifiable engineering control with an untested shortcut in the an automotive parts supplier deployment. In this deployment, engineers should verify the missing mechanism rather than assume the proposed step satisfies the acceptance conditions.
D:The suggested action—assume cross-environment traffic is always private without configuration—does not establish the required control for an automotive parts supplier to connect cloud inference to restricted on-premises systems. The change is applied outside the component responsible for the requirement identified by an automotive parts supplier. In this deployment, engineers should verify the missing mechanism rather than assume the proposed step satisfies the acceptance conditions.
Question 1120
At a travel services company, engineers need to route easy requests to inexpensive models while preserving quality on difficult requests. The implementation must remain maintainable across model upgrades. A recent review found that the current design has no reliable safeguard for this case. Which design decision addresses the underlying issue?
- Use a policy-driven model router with measurable fallback conditions
- Send all requests to the largest model regardless of complexity
- Change production source code manually for every routing decision
- Select a model solely by its parameter count
Explanation
Correct Answer
A:Capability-aware routing balances quality, latency and invocation cost. In a travel services company, the engineering team should verify this design against its stated objective to route easy requests to inexpensive models while preserving quality on difficult requests, including the requirement that the implementation must remain maintainable across model upgrades.
Incorrect Answers
B:The suggested action—send all requests to the largest model regardless of complexity—does not establish the required control for a travel services company to route easy requests to inexpensive models while preserving quality on difficult requests. The change is applied outside the component responsible for the requirement identified by a travel services company. In this deployment, engineers should verify the missing mechanism rather than assume the proposed step satisfies the acceptance conditions.
C:The suggested action—change production source code manually for every routing decision—does not establish the required control for a travel services company to route easy requests to inexpensive models while preserving quality on difficult requests. No demonstrated capability in this scenario guarantees that this step resolves the concern raised by a travel services company. In this deployment, engineers should verify the missing mechanism rather than assume the proposed step satisfies the acceptance conditions.
D:The suggested action—select a model solely by its parameter count—does not establish the required control for a travel services company to route easy requests to inexpensive models while preserving quality on difficult requests. It replaces a verifiable engineering control with an untested shortcut in the a travel services company deployment. In this deployment, engineers should verify the missing mechanism rather than assume the proposed step satisfies the acceptance conditions.