Question 50
At a security incident response team, engineers need to capture human feedback on nuanced response usefulness. Monitoring should isolate failures to the responsible component. The team wants a solution that can be validated through targeted test cases. Which implementation most directly satisfies the requirement?
- Use a structured annotation workflow and reconcile inconsistent reviewer judgments
- Treat a thumbs-up from one user as a universally valid benchmark
- Never store the evaluated prompt version
- Use only token count as a satisfaction measure
Explanation
Correct Answer
A:Human evaluation needs defined criteria and repeatable sampling. In a security incident response team, the engineering team should verify this design against its stated objective to capture human feedback on nuanced response usefulness, including the requirement that monitoring should isolate failures to the responsible component.
Incorrect Answers
B:The suggested action—treat a thumbs-up from one user as a universally valid benchmark—does not establish the required control for a security incident response team to capture human feedback on nuanced response usefulness. No demonstrated capability in this scenario guarantees that this step resolves the concern raised by a security incident response team. In this deployment, engineers should verify the missing mechanism rather than assume the proposed step satisfies the acceptance conditions.
C:The suggested action—never store the evaluated prompt version—does not establish the required control for a security incident response team to capture human feedback on nuanced response usefulness. It replaces a verifiable engineering control with an untested shortcut in the a security incident response team deployment. In this deployment, engineers should verify the missing mechanism rather than assume the proposed step satisfies the acceptance conditions.
D:The suggested action—use only token count as a satisfaction measure—does not establish the required control for a security incident response team to capture human feedback on nuanced response usefulness. The change is applied outside the component responsible for the requirement identified by a security incident response team. In this deployment, engineers should verify the missing mechanism rather than assume the proposed step satisfies the acceptance conditions.
Question 51
At a regional insurer, engineers need to limit prompt and response retention for a regulated application. The current deployment processes customer-specific information. The initial assessment isolates this issue from unrelated infrastructure changes. Which change should the team prioritize?
- Set data retention and logging policies consistent with the compliance mandate
- Keep verbose unredacted invocation logs forever
- Assume disabling application logs eliminates all copies in supporting systems
- Write sensitive prompts to browser analytics automatically
Explanation
Correct Answer
A:Privacy controls must address the full data lifecycle, including diagnostic stores. In a regional insurer, the engineering team should verify this design against its stated objective to limit prompt and response retention for a regulated application, including the requirement that the current deployment processes customer-specific information.
Incorrect Answers
B:The suggested action—keep verbose unredacted invocation logs forever—does not establish the required control for a regional insurer to limit prompt and response retention for a regulated application. No demonstrated capability in this scenario guarantees that this step resolves the concern raised by a regional insurer. In this deployment, engineers should verify the missing mechanism rather than assume the proposed step satisfies the acceptance conditions.
C:The suggested action—assume disabling application logs eliminates all copies in supporting systems—does not establish the required control for a regional insurer to limit prompt and response retention for a regulated application. It replaces a verifiable engineering control with an untested shortcut in the a regional insurer deployment. In this deployment, engineers should verify the missing mechanism rather than assume the proposed step satisfies the acceptance conditions.
D:The suggested action—write sensitive prompts to browser analytics automatically—does not establish the required control for a regional insurer to limit prompt and response retention for a regulated application. The change is applied outside the component responsible for the requirement identified by a regional insurer. In this deployment, engineers should verify the missing mechanism rather than assume the proposed step satisfies the acceptance conditions.
Question 52
At a SaaS procurement platform, engineers need to support a large offline document-analysis workload efficiently. The migration must preserve existing downstream API contracts. The initial assessment isolates this issue from unrelated infrastructure changes. What is the most appropriate production approach?
- Run every document synchronously on one interactive browser connection
- Increase temperature to process more records per second
- Rely on throttling errors as capacity planning
- Evaluate eligible batch inference and appropriately sized concurrency
Explanation
Correct Answer
D:Batch and concurrency planning match workload characteristics to inference capacity. In a SaaS procurement platform, the engineering team should verify this design against its stated objective to support a large offline document-analysis workload efficiently, including the requirement that the migration must preserve existing downstream API contracts.
Incorrect Answers
A:The suggested action—run every document synchronously on one interactive browser connection—does not establish the required control for a SaaS procurement platform to support a large offline document-analysis workload efficiently. No demonstrated capability in this scenario guarantees that this step resolves the concern raised by a SaaS procurement platform. In this deployment, engineers should verify the missing mechanism rather than assume the proposed step satisfies the acceptance conditions.
B:The suggested action—increase temperature to process more records per second—does not establish the required control for a SaaS procurement platform to support a large offline document-analysis workload efficiently. It replaces a verifiable engineering control with an untested shortcut in the a SaaS procurement platform deployment. In this deployment, engineers should verify the missing mechanism rather than assume the proposed step satisfies the acceptance conditions.
C:The suggested action—rely on throttling errors as capacity planning—does not establish the required control for a SaaS procurement platform to support a large offline document-analysis workload efficiently. The change is applied outside the component responsible for the requirement identified by a SaaS procurement platform. In this deployment, engineers should verify the missing mechanism rather than assume the proposed step satisfies the acceptance conditions.
Question 53
At a digital publishing business, engineers need to capture human feedback on nuanced response usefulness. The next release must be evaluated against the previous baseline. The initial assessment isolates this issue from unrelated infrastructure changes. What should be implemented before scaling this workflow?
- Never store the evaluated prompt version
- Use only token count as a satisfaction measure
- Use a structured annotation workflow and reconcile inconsistent reviewer judgments
- Treat a thumbs-up from one user as a universally valid benchmark
Explanation
Correct Answer
C:Human evaluation needs defined criteria and repeatable sampling. In a digital publishing business, the engineering team should verify this design against its stated objective to capture human feedback on nuanced response usefulness, including the requirement that the next release must be evaluated against the previous baseline.
Incorrect Answers
A:The suggested action—never store the evaluated prompt version—does not establish the required control for a digital publishing business to capture human feedback on nuanced response usefulness. No demonstrated capability in this scenario guarantees that this step resolves the concern raised by a digital publishing business. In this deployment, engineers should verify the missing mechanism rather than assume the proposed step satisfies the acceptance conditions.
B:The suggested action—use only token count as a satisfaction measure—does not establish the required control for a digital publishing business to capture human feedback on nuanced response usefulness. It replaces a verifiable engineering control with an untested shortcut in the a digital publishing business deployment. In this deployment, engineers should verify the missing mechanism rather than assume the proposed step satisfies the acceptance conditions.
D:The suggested action—treat a thumbs-up from one user as a universally valid benchmark—does not establish the required control for a digital publishing business to capture human feedback on nuanced response usefulness. No demonstrated capability in this scenario guarantees that this step resolves the concern raised by a digital publishing business. In this deployment, engineers should verify the missing mechanism rather than assume the proposed step satisfies the acceptance conditions.
Question 54
At a security incident response team, engineers need to audit which users accessed sensitive retrieval documents. The design must distinguish inference behavior from upstream data quality. A recent review found that the current design has no reliable safeguard for this case. Which change should the team prioritize?
- Rely solely on answer citations as an audit trail
- Publish document access logs to anonymous users
- Enforce data-source authorization and emit protected access logs
- Use a single shared principal with no user attribution
Explanation
Correct Answer
C:Auditable data access requires attributable identities and controlled log retention. In a security incident response team, the engineering team should verify this design against its stated objective to audit which users accessed sensitive retrieval documents, including the requirement that the design must distinguish inference behavior from upstream data quality.
Incorrect Answers
A:The suggested action—rely solely on answer citations as an audit trail—does not establish the required control for a security incident response team to audit which users accessed sensitive retrieval documents. It replaces a verifiable engineering control with an untested shortcut in the a security incident response team deployment. In this deployment, engineers should verify the missing mechanism rather than assume the proposed step satisfies the acceptance conditions.
B:The suggested action—publish document access logs to anonymous users—does not establish the required control for a security incident response team to audit which users accessed sensitive retrieval documents. The change is applied outside the component responsible for the requirement identified by a security incident response team. In this deployment, engineers should verify the missing mechanism rather than assume the proposed step satisfies the acceptance conditions.
D:The suggested action—use a single shared principal with no user attribution—does not establish the required control for a security incident response team to audit which users accessed sensitive retrieval documents. It replaces a verifiable engineering control with an untested shortcut in the a security incident response team deployment. In this deployment, engineers should verify the missing mechanism rather than assume the proposed step satisfies the acceptance conditions.
Question 55
At a SaaS procurement platform, engineers need to meet a strict data residency requirement during GenAI design. The architecture must minimize avoidable data exposure. An architecture review has rejected fixes that only conceal the symptoms. What is the most appropriate production approach?
- Store all source documents in an unrestricted global repository
- Verify model and retrieval service Region support, data flows and jurisdictional constraints
- Assume every Bedrock model is available in every AWS Region
- Rely on a client-side warning instead of controlling data movement
Explanation
Correct Answer
B:Region-aware design must account for inference, storage and supporting integration paths. In a SaaS procurement platform, the engineering team should verify this design against its stated objective to meet a strict data residency requirement during GenAI design, including the requirement that the architecture must minimize avoidable data exposure.
Incorrect Answers
A:The suggested action—store all source documents in an unrestricted global repository—does not establish the required control for a SaaS procurement platform to meet a strict data residency requirement during GenAI design. No demonstrated capability in this scenario guarantees that this step resolves the concern raised by a SaaS procurement platform. In this deployment, engineers should verify the missing mechanism rather than assume the proposed step satisfies the acceptance conditions.
C:The suggested action—assume every Bedrock model is available in every AWS Region—does not establish the required control for a SaaS procurement platform to meet a strict data residency requirement during GenAI design. The change is applied outside the component responsible for the requirement identified by a SaaS procurement platform. In this deployment, engineers should verify the missing mechanism rather than assume the proposed step satisfies the acceptance conditions.
D:The suggested action—rely on a client-side warning instead of controlling data movement—does not establish the required control for a SaaS procurement platform to meet a strict data residency requirement during GenAI design. No demonstrated capability in this scenario guarantees that this step resolves the concern raised by a SaaS procurement platform. In this deployment, engineers should verify the missing mechanism rather than assume the proposed step satisfies the acceptance conditions.
Question 56
At a pharmaceutical documentation team, engineers need to prevent an agent from entering an infinite tool-calling loop. The architecture must avoid unnecessary coupling between components. The initial assessment isolates this issue from unrelated infrastructure changes. Which architecture is best supported by the stated constraints?
- Allow recursive calls without tracing
- Apply maximum-step limits, timeouts and explicit stopping conditions
- Remove all execution deadlines
- Increase the maximum output tokens without a tool limit
Explanation
Correct Answer
B:Deterministic runtime controls bound autonomous execution and spend. In a pharmaceutical documentation team, the engineering team should verify this design against its stated objective to prevent an agent from entering an infinite tool-calling loop, including the requirement that the architecture must avoid unnecessary coupling between components.
Incorrect Answers
A:The suggested action—allow recursive calls without tracing—does not establish the required control for a pharmaceutical documentation team to prevent an agent from entering an infinite tool-calling loop. It replaces a verifiable engineering control with an untested shortcut in the a pharmaceutical documentation team deployment. In this deployment, engineers should verify the missing mechanism rather than assume the proposed step satisfies the acceptance conditions.
C:The suggested action—remove all execution deadlines—does not establish the required control for a pharmaceutical documentation team to prevent an agent from entering an infinite tool-calling loop. No demonstrated capability in this scenario guarantees that this step resolves the concern raised by a pharmaceutical documentation team. In this deployment, engineers should verify the missing mechanism rather than assume the proposed step satisfies the acceptance conditions.
D:The suggested action—increase the maximum output tokens without a tool limit—does not establish the required control for a pharmaceutical documentation team to prevent an agent from entering an infinite tool-calling loop. It replaces a verifiable engineering control with an untested shortcut in the a pharmaceutical documentation team deployment. In this deployment, engineers should verify the missing mechanism rather than assume the proposed step satisfies the acceptance conditions.
Question 57
At a nonprofit grant portal, engineers need to detect and redact personal identifiers before sending user documents to inference. Response reliability is more important than free-form creativity. A recent review found that the current design has no reliable safeguard for this case. What should be implemented before scaling this workflow?
- Classify PII and apply approved redaction or masking before invocation
- Send raw identifiers and ask the model to forget them afterward
- Use an S3 bucket name as a data redaction control
- Log entire unmasked prompts to every debugging dashboard
Explanation
Correct Answer
A:Data minimization reduces exposure before sensitive information enters the model interaction. In a nonprofit grant portal, the engineering team should verify this design against its stated objective to detect and redact personal identifiers before sending user documents to inference, including the requirement that response reliability is more important than free-form creativity.
Incorrect Answers
B:The suggested action—send raw identifiers and ask the model to forget them afterward—does not establish the required control for a nonprofit grant portal to detect and redact personal identifiers before sending user documents to inference. No demonstrated capability in this scenario guarantees that this step resolves the concern raised by a nonprofit grant portal. In this deployment, engineers should verify the missing mechanism rather than assume the proposed step satisfies the acceptance conditions.
C:The suggested action—use an S3 bucket name as a data redaction control—does not establish the required control for a nonprofit grant portal to detect and redact personal identifiers before sending user documents to inference. It replaces a verifiable engineering control with an untested shortcut in the a nonprofit grant portal deployment. In this deployment, engineers should verify the missing mechanism rather than assume the proposed step satisfies the acceptance conditions.
D:The suggested action—log entire unmasked prompts to every debugging dashboard—does not establish the required control for a nonprofit grant portal to detect and redact personal identifiers before sending user documents to inference. The change is applied outside the component responsible for the requirement identified by a nonprofit grant portal. In this deployment, engineers should verify the missing mechanism rather than assume the proposed step satisfies the acceptance conditions.
Question 58
At a legal case-management provider, engineers need to route model requests by compliance class and task capability. A controlled rollout is required before broad user exposure. The initial assessment isolates this issue from unrelated infrastructure changes. Which implementation most directly satisfies the requirement?
- Implement explicit policy-based routing before invoking permitted models
- Let the language model decide whether to bypass policy
- Send sensitive data to any model with the lowest price
- Ignore requested response modalities when selecting a model
Explanation
Correct Answer
A:Model routing must satisfy hard constraints before optimizing cost or performance. In a legal case-management provider, the engineering team should verify this design against its stated objective to route model requests by compliance class and task capability, including the requirement that a controlled rollout is required before broad user exposure.
Incorrect Answers
B:The suggested action—let the language model decide whether to bypass policy—does not establish the required control for a legal case-management provider to route model requests by compliance class and task capability. It replaces a verifiable engineering control with an untested shortcut in the a legal case-management provider deployment. In this deployment, engineers should verify the missing mechanism rather than assume the proposed step satisfies the acceptance conditions.
C:The suggested action—send sensitive data to any model with the lowest price—does not establish the required control for a legal case-management provider to route model requests by compliance class and task capability. The change is applied outside the component responsible for the requirement identified by a legal case-management provider. In this deployment, engineers should verify the missing mechanism rather than assume the proposed step satisfies the acceptance conditions.
D:The suggested action—ignore requested response modalities when selecting a model—does not establish the required control for a legal case-management provider to route model requests by compliance class and task capability. No demonstrated capability in this scenario guarantees that this step resolves the concern raised by a legal case-management provider. In this deployment, engineers should verify the missing mechanism rather than assume the proposed step satisfies the acceptance conditions.
Question 59
At a digital publishing business, engineers need to investigate whether responses lost factual grounding after a prompt update. The migration must preserve existing downstream API contracts. The initial assessment isolates this issue from unrelated infrastructure changes. Which design decision addresses the underlying issue?
- Disable evaluation to prevent noisy alerts
- Assume a high token count implies grounded answers
- Track quality regression metrics against a fixed evaluation set and prompt versions
- Compare only average CPU utilization
Explanation
Correct Answer
C:Quality telemetry ties behavior changes to model and prompt release history. In a digital publishing business, the engineering team should verify this design against its stated objective to investigate whether responses lost factual grounding after a prompt update, including the requirement that the migration must preserve existing downstream API contracts.
Incorrect Answers
A:The suggested action—disable evaluation to prevent noisy alerts—does not establish the required control for a digital publishing business to investigate whether responses lost factual grounding after a prompt update. It replaces a verifiable engineering control with an untested shortcut in the a digital publishing business deployment. In this deployment, engineers should verify the missing mechanism rather than assume the proposed step satisfies the acceptance conditions.
B:The suggested action—assume a high token count implies grounded answers—does not establish the required control for a digital publishing business to investigate whether responses lost factual grounding after a prompt update. The change is applied outside the component responsible for the requirement identified by a digital publishing business. In this deployment, engineers should verify the missing mechanism rather than assume the proposed step satisfies the acceptance conditions.
D:The suggested action—compare only average CPU utilization—does not establish the required control for a digital publishing business to investigate whether responses lost factual grounding after a prompt update. It replaces a verifiable engineering control with an untested shortcut in the a digital publishing business deployment. In this deployment, engineers should verify the missing mechanism rather than assume the proposed step satisfies the acceptance conditions.
Question 60
At a security incident response team, engineers need to reconstruct which data revision supported an AI-generated answer. Response reliability is more important than free-form creativity. An architecture review has rejected fixes that only conceal the symptoms. Which change should the team prioritize?
- Replace source metadata with a random label after generation
- Depend on the model to recall a deleted source later
- Record source IDs, version metadata and request correlation information
- Keep only the final natural-language answer
Explanation
Correct Answer
C:Traceability links model outputs to the exact version of authorized evidence. In a security incident response team, the engineering team should verify this design against its stated objective to reconstruct which data revision supported an AI-generated answer, including the requirement that response reliability is more important than free-form creativity.
Incorrect Answers
A:The suggested action—replace source metadata with a random label after generation—does not establish the required control for a security incident response team to reconstruct which data revision supported an AI-generated answer. The change is applied outside the component responsible for the requirement identified by a security incident response team. In this deployment, engineers should verify the missing mechanism rather than assume the proposed step satisfies the acceptance conditions.
B:The suggested action—depend on the model to recall a deleted source later—does not establish the required control for a security incident response team to reconstruct which data revision supported an AI-generated answer. No demonstrated capability in this scenario guarantees that this step resolves the concern raised by a security incident response team. In this deployment, engineers should verify the missing mechanism rather than assume the proposed step satisfies the acceptance conditions.
D:The suggested action—keep only the final natural-language answer—does not establish the required control for a security incident response team to reconstruct which data revision supported an AI-generated answer. The change is applied outside the component responsible for the requirement identified by a security incident response team. In this deployment, engineers should verify the missing mechanism rather than assume the proposed step satisfies the acceptance conditions.