Question 130

At a global manufacturer, engineers need to measure whether a RAG system retrieves the right supporting passages. Operators need measurable acceptance criteria before rollout. The team wants a solution that can be validated through targeted test cases. Which implementation most directly satisfies the requirement?

  1. Evaluate retrieval recall or precision against annotated query-document pairs
  2. Grade only fluency of final text
  3. Measure GPU utilization and infer document relevance
  4. Remove labeled documents from the test set

Explanation

Correct Answer

A:

Retrieval-stage metrics isolate evidence selection from answer generation. In a global manufacturer, the engineering team should verify this design against its stated objective to measure whether a RAG system retrieves the right supporting passages, including the requirement that operators need measurable acceptance criteria before rollout.

Incorrect Answers

B:

The suggested action—grade only fluency of final text—does not establish the required control for a global manufacturer to measure whether a RAG system retrieves the right supporting passages. It replaces a verifiable engineering control with an untested shortcut in the a global manufacturer deployment. In this deployment, engineers should verify the missing mechanism rather than assume the proposed step satisfies the acceptance conditions.

C:

The suggested action—measure GPU utilization and infer document relevance—does not establish the required control for a global manufacturer to measure whether a RAG system retrieves the right supporting passages. The change is applied outside the component responsible for the requirement identified by a global manufacturer. In this deployment, engineers should verify the missing mechanism rather than assume the proposed step satisfies the acceptance conditions.

D:

The suggested action—remove labeled documents from the test set—does not establish the required control for a global manufacturer to measure whether a RAG system retrieves the right supporting passages. No demonstrated capability in this scenario guarantees that this step resolves the concern raised by a global manufacturer. In this deployment, engineers should verify the missing mechanism rather than assume the proposed step satisfies the acceptance conditions.

Question 131

At a wholesale distribution platform, engineers need to protect a retrieval assistant against instructions hidden inside source documents. The solution must tolerate transient dependency failures. The team wants a solution that can be validated through targeted test cases. What is the most appropriate production approach?

  1. Promote all retrieved instructions to system-level authority
  2. Grant the model permission to run arbitrary commands from documents
  3. Disable source-level access controls
  4. Treat retrieved text as untrusted data and prevent it from overriding high-priority instructions

Explanation

Correct Answer

D:

Prompt-injection defenses separate lower-trust content from application instructions and tool rights. In a wholesale distribution platform, the engineering team should verify this design against its stated objective to protect a retrieval assistant against instructions hidden inside source documents, including the requirement that the solution must tolerate transient dependency failures.

Incorrect Answers

A:

The suggested action—promote all retrieved instructions to system-level authority—does not establish the required control for a wholesale distribution platform to protect a retrieval assistant against instructions hidden inside source documents. No demonstrated capability in this scenario guarantees that this step resolves the concern raised by a wholesale distribution platform. In this deployment, engineers should verify the missing mechanism rather than assume the proposed step satisfies the acceptance conditions.

B:

The suggested action—grant the model permission to run arbitrary commands from documents—does not establish the required control for a wholesale distribution platform to protect a retrieval assistant against instructions hidden inside source documents. It replaces a verifiable engineering control with an untested shortcut in the a wholesale distribution platform deployment. In this deployment, engineers should verify the missing mechanism rather than assume the proposed step satisfies the acceptance conditions.

C:

The suggested action—disable source-level access controls—does not establish the required control for a wholesale distribution platform to protect a retrieval assistant against instructions hidden inside source documents. The change is applied outside the component responsible for the requirement identified by a wholesale distribution platform. In this deployment, engineers should verify the missing mechanism rather than assume the proposed step satisfies the acceptance conditions.

Question 132

At an airline operations unit, engineers need to resolve truncated answers when prompts exceed model context limits. Monitoring should isolate failures to the responsible component. The initial assessment isolates this issue from unrelated infrastructure changes. Which remediation addresses the root problem?

  1. Raise temperature to make the context window larger
  2. Remove HTTP retry logic to increase model memory
  3. Change IAM credentials to expand a token limit
  4. Inspect token budgets and adapt history, retrieval context and output allowances

Explanation

Correct Answer

D:

Context-window errors require input and output token budgeting, not authorization changes. In an airline operations unit, the engineering team should verify this design against its stated objective to resolve truncated answers when prompts exceed model context limits, including the requirement that monitoring should isolate failures to the responsible component.

Incorrect Answers

A:

The suggested action—raise temperature to make the context window larger—does not establish the required control for an airline operations unit to resolve truncated answers when prompts exceed model context limits. The change is applied outside the component responsible for the requirement identified by an airline operations unit. In this deployment, engineers should verify the missing mechanism rather than assume the proposed step satisfies the acceptance conditions.

B:

The suggested action—remove HTTP retry logic to increase model memory—does not establish the required control for an airline operations unit to resolve truncated answers when prompts exceed model context limits. No demonstrated capability in this scenario guarantees that this step resolves the concern raised by an airline operations unit. In this deployment, engineers should verify the missing mechanism rather than assume the proposed step satisfies the acceptance conditions.

C:

The suggested action—change IAM credentials to expand a token limit—does not establish the required control for an airline operations unit to resolve truncated answers when prompts exceed model context limits. It replaces a verifiable engineering control with an untested shortcut in the an airline operations unit deployment. In this deployment, engineers should verify the missing mechanism rather than assume the proposed step satisfies the acceptance conditions.

Question 133

At a regional insurer, engineers need to process long-running jobs without forcing a synchronous connection to stay open. The service must continue to support multiple independent tenants. A recent review found that the current design has no reliable safeguard for this case. Which change should the team prioritize?

  1. Put a batch job identifier in the model temperature field
  2. Retry the same job without an idempotency strategy
  3. Queue requests and report job status via an asynchronous workflow
  4. Keep a user HTTP connection open indefinitely

Explanation

Correct Answer

C:

Asynchronous orchestration handles long tasks independently of a browser connection. In a regional insurer, the engineering team should verify this design against its stated objective to process long-running jobs without forcing a synchronous connection to stay open, including the requirement that the service must continue to support multiple independent tenants.

Incorrect Answers

A:

The suggested action—put a batch job identifier in the model temperature field—does not establish the required control for a regional insurer to process long-running jobs without forcing a synchronous connection to stay open. It replaces a verifiable engineering control with an untested shortcut in the a regional insurer deployment. In this deployment, engineers should verify the missing mechanism rather than assume the proposed step satisfies the acceptance conditions.

B:

The suggested action—retry the same job without an idempotency strategy—does not establish the required control for a regional insurer to process long-running jobs without forcing a synchronous connection to stay open. The change is applied outside the component responsible for the requirement identified by a regional insurer. In this deployment, engineers should verify the missing mechanism rather than assume the proposed step satisfies the acceptance conditions.

D:

The suggested action—keep a user HTTP connection open indefinitely—does not establish the required control for a regional insurer to process long-running jobs without forcing a synchronous connection to stay open. It replaces a verifiable engineering control with an untested shortcut in the a regional insurer deployment. In this deployment, engineers should verify the missing mechanism rather than assume the proposed step satisfies the acceptance conditions.

Question 134

At a wholesale distribution platform, engineers need to prevent a low-complexity task from consuming high-end inference capacity. The deployment has both bursty and sustained workloads. A recent review found that the current design has no reliable safeguard for this case. What is the most appropriate production approach?

  1. Increase the context window to avoid routing decisions
  2. Use cost-aware model selection with quality thresholds and escalation
  3. Always use the largest model for trivial deterministic tasks
  4. Evaluate prices without measuring answer quality

Explanation

Correct Answer

B:

A tiered model policy controls cost without compromising measured task success. In a wholesale distribution platform, the engineering team should verify this design against its stated objective to prevent a low-complexity task from consuming high-end inference capacity, including the requirement that the deployment has both bursty and sustained workloads.

Incorrect Answers

A:

The suggested action—increase the context window to avoid routing decisions—does not establish the required control for a wholesale distribution platform to prevent a low-complexity task from consuming high-end inference capacity. The change is applied outside the component responsible for the requirement identified by a wholesale distribution platform. In this deployment, engineers should verify the missing mechanism rather than assume the proposed step satisfies the acceptance conditions.

C:

The suggested action—always use the largest model for trivial deterministic tasks—does not establish the required control for a wholesale distribution platform to prevent a low-complexity task from consuming high-end inference capacity. It replaces a verifiable engineering control with an untested shortcut in the a wholesale distribution platform deployment. In this deployment, engineers should verify the missing mechanism rather than assume the proposed step satisfies the acceptance conditions.

D:

The suggested action—evaluate prices without measuring answer quality—does not establish the required control for a wholesale distribution platform to prevent a low-complexity task from consuming high-end inference capacity. The change is applied outside the component responsible for the requirement identified by a wholesale distribution platform. In this deployment, engineers should verify the missing mechanism rather than assume the proposed step satisfies the acceptance conditions.

Question 135

At a shipping brokerage, engineers need to keep an entire policy section together across chunk boundaries. Monitoring should isolate failures to the responsible component. The initial assessment isolates this issue from unrelated infrastructure changes. Which architecture is best supported by the stated constraints?

  1. Increase model output tokens without improving context selection
  2. Use structure-aware or hierarchical chunking and test answer recall
  3. Split every document into single-character chunks
  4. Use randomly sized chunks without overlap or structure

Explanation

Correct Answer

B:

Structure-sensitive chunking preserves relationships between headings and text. In a shipping brokerage, the engineering team should verify this design against its stated objective to keep an entire policy section together across chunk boundaries, including the requirement that monitoring should isolate failures to the responsible component.

Incorrect Answers

A:

The suggested action—increase model output tokens without improving context selection—does not establish the required control for a shipping brokerage to keep an entire policy section together across chunk boundaries. No demonstrated capability in this scenario guarantees that this step resolves the concern raised by a shipping brokerage. In this deployment, engineers should verify the missing mechanism rather than assume the proposed step satisfies the acceptance conditions.

C:

The suggested action—split every document into single-character chunks—does not establish the required control for a shipping brokerage to keep an entire policy section together across chunk boundaries. The change is applied outside the component responsible for the requirement identified by a shipping brokerage. In this deployment, engineers should verify the missing mechanism rather than assume the proposed step satisfies the acceptance conditions.

D:

The suggested action—use randomly sized chunks without overlap or structure—does not establish the required control for a shipping brokerage to keep an entire policy section together across chunk boundaries. No demonstrated capability in this scenario guarantees that this step resolves the concern raised by a shipping brokerage. In this deployment, engineers should verify the missing mechanism rather than assume the proposed step satisfies the acceptance conditions.

Question 136

At a global manufacturer, engineers need to prepare model input that must satisfy a specific JSON request schema. Operators need measurable acceptance criteria before rollout. The team wants a solution that can be validated through targeted test cases. Which implementation most directly satisfies the requirement?

  1. Validate request structure and model-specific parameter types before invocation
  2. Pass free-form invalid JSON and rely on the service to repair it
  3. Mix response schemas from unrelated providers without conversion
  4. Use a larger context window to correct malformed fields

Explanation

Correct Answer

A:

Request validation prevents avoidable API failures and inconsistent model invocation. In a global manufacturer, the engineering team should verify this design against its stated objective to prepare model input that must satisfy a specific JSON request schema, including the requirement that operators need measurable acceptance criteria before rollout.

Incorrect Answers

B:

The suggested action—pass free-form invalid JSON and rely on the service to repair it—does not establish the required control for a global manufacturer to prepare model input that must satisfy a specific JSON request schema. No demonstrated capability in this scenario guarantees that this step resolves the concern raised by a global manufacturer. In this deployment, engineers should verify the missing mechanism rather than assume the proposed step satisfies the acceptance conditions.

C:

The suggested action—mix response schemas from unrelated providers without conversion—does not establish the required control for a global manufacturer to prepare model input that must satisfy a specific JSON request schema. It replaces a verifiable engineering control with an untested shortcut in the a global manufacturer deployment. In this deployment, engineers should verify the missing mechanism rather than assume the proposed step satisfies the acceptance conditions.

D:

The suggested action—use a larger context window to correct malformed fields—does not establish the required control for a global manufacturer to prepare model input that must satisfy a specific JSON request schema. The change is applied outside the component responsible for the requirement identified by a global manufacturer. In this deployment, engineers should verify the missing mechanism rather than assume the proposed step satisfies the acceptance conditions.

Question 137

At a clinical scheduling platform, engineers need to audit which users accessed sensitive retrieval documents. The solution must tolerate transient dependency failures. An architecture review has rejected fixes that only conceal the symptoms. What should be implemented before scaling this workflow?

  1. Enforce data-source authorization and emit protected access logs
  2. Use a single shared principal with no user attribution
  3. Rely solely on answer citations as an audit trail
  4. Publish document access logs to anonymous users

Explanation

Correct Answer

A:

Auditable data access requires attributable identities and controlled log retention. In a clinical scheduling platform, the engineering team should verify this design against its stated objective to audit which users accessed sensitive retrieval documents, including the requirement that the solution must tolerate transient dependency failures.

Incorrect Answers

B:

The suggested action—use a single shared principal with no user attribution—does not establish the required control for a clinical scheduling platform to audit which users accessed sensitive retrieval documents. The change is applied outside the component responsible for the requirement identified by a clinical scheduling platform. In this deployment, engineers should verify the missing mechanism rather than assume the proposed step satisfies the acceptance conditions.

C:

The suggested action—rely solely on answer citations as an audit trail—does not establish the required control for a clinical scheduling platform to audit which users accessed sensitive retrieval documents. No demonstrated capability in this scenario guarantees that this step resolves the concern raised by a clinical scheduling platform. In this deployment, engineers should verify the missing mechanism rather than assume the proposed step satisfies the acceptance conditions.

D:

The suggested action—publish document access logs to anonymous users—does not establish the required control for a clinical scheduling platform to audit which users accessed sensitive retrieval documents. It replaces a verifiable engineering control with an untested shortcut in the a clinical scheduling platform deployment. In this deployment, engineers should verify the missing mechanism rather than assume the proposed step satisfies the acceptance conditions.

Question 138

At a shipping brokerage, engineers need to evaluate whether the generated answer is faithful to retrieved evidence. The architecture must minimize avoidable data exposure. The team wants a solution that can be validated through targeted test cases. Which architecture is best supported by the stated constraints?

  1. Measure string length as factual accuracy
  2. Use groundedness or faithfulness scoring with human-checked evaluation examples
  3. Score only whether the response sounds articulate
  4. Assume a citation exists therefore every statement is supported

Explanation

Correct Answer

B:

Faithfulness checks whether claims are entailed by the provided evidence. In a shipping brokerage, the engineering team should verify this design against its stated objective to evaluate whether the generated answer is faithful to retrieved evidence, including the requirement that the architecture must minimize avoidable data exposure.

Incorrect Answers

A:

The suggested action—measure string length as factual accuracy—does not establish the required control for a shipping brokerage to evaluate whether the generated answer is faithful to retrieved evidence. No demonstrated capability in this scenario guarantees that this step resolves the concern raised by a shipping brokerage. In this deployment, engineers should verify the missing mechanism rather than assume the proposed step satisfies the acceptance conditions.

C:

The suggested action—score only whether the response sounds articulate—does not establish the required control for a shipping brokerage to evaluate whether the generated answer is faithful to retrieved evidence. The change is applied outside the component responsible for the requirement identified by a shipping brokerage. In this deployment, engineers should verify the missing mechanism rather than assume the proposed step satisfies the acceptance conditions.

D:

The suggested action—assume a citation exists therefore every statement is supported—does not establish the required control for a shipping brokerage to evaluate whether the generated answer is faithful to retrieved evidence. No demonstrated capability in this scenario guarantees that this step resolves the concern raised by a shipping brokerage. In this deployment, engineers should verify the missing mechanism rather than assume the proposed step satisfies the acceptance conditions.

Question 139

At a retail bank, engineers need to change embedding models without corrupting nearest-neighbor comparisons. Monitoring should isolate failures to the responsible component. The initial assessment isolates this issue from unrelated infrastructure changes. What should the lead engineer recommend?

  1. Increase the vector similarity threshold arbitrarily
  2. Re-embed the corpus and queries into the selected model's compatible vector space
  3. Compare new query vectors with old embeddings without validation
  4. Change only the vector database display name

Explanation

Correct Answer

B:

Embedding migrations require compatible representations and a controlled index cutover. In a retail bank, the engineering team should verify this design against its stated objective to change embedding models without corrupting nearest-neighbor comparisons, including the requirement that monitoring should isolate failures to the responsible component.

Incorrect Answers

A:

The suggested action—increase the vector similarity threshold arbitrarily—does not establish the required control for a retail bank to change embedding models without corrupting nearest-neighbor comparisons. It replaces a verifiable engineering control with an untested shortcut in the a retail bank deployment. In this deployment, engineers should verify the missing mechanism rather than assume the proposed step satisfies the acceptance conditions.

C:

The suggested action—compare new query vectors with old embeddings without validation—does not establish the required control for a retail bank to change embedding models without corrupting nearest-neighbor comparisons. No demonstrated capability in this scenario guarantees that this step resolves the concern raised by a retail bank. In this deployment, engineers should verify the missing mechanism rather than assume the proposed step satisfies the acceptance conditions.

D:

The suggested action—change only the vector database display name—does not establish the required control for a retail bank to change embedding models without corrupting nearest-neighbor comparisons. It replaces a verifiable engineering control with an untested shortcut in the a retail bank deployment. In this deployment, engineers should verify the missing mechanism rather than assume the proposed step satisfies the acceptance conditions.

Question 140

At a wholesale distribution platform, engineers need to deploy a large self-hosted model with significant GPU memory needs. The service must continue to support multiple independent tenants. The team wants a solution that can be validated through targeted test cases. Which remediation addresses the root problem?

  1. Treat model deployment as a CPU-only static web hosting task
  2. Assume endpoint throughput is independent of generated token length
  3. Run a large GPU workload in an API Gateway mapping template
  4. Size accelerator memory, batching, concurrency and model-loading strategy explicitly

Explanation

Correct Answer

D:

Self-hosted LLM serving must account for memory, accelerator use and token generation dynamics. In a wholesale distribution platform, the engineering team should verify this design against its stated objective to deploy a large self-hosted model with significant GPU memory needs, including the requirement that the service must continue to support multiple independent tenants.

Incorrect Answers

A:

The suggested action—treat model deployment as a CPU-only static web hosting task—does not establish the required control for a wholesale distribution platform to deploy a large self-hosted model with significant GPU memory needs. No demonstrated capability in this scenario guarantees that this step resolves the concern raised by a wholesale distribution platform. In this deployment, engineers should verify the missing mechanism rather than assume the proposed step satisfies the acceptance conditions.

B:

The suggested action—assume endpoint throughput is independent of generated token length—does not establish the required control for a wholesale distribution platform to deploy a large self-hosted model with significant GPU memory needs. It replaces a verifiable engineering control with an untested shortcut in the a wholesale distribution platform deployment. In this deployment, engineers should verify the missing mechanism rather than assume the proposed step satisfies the acceptance conditions.

C:

The suggested action—run a large GPU workload in an API Gateway mapping template—does not establish the required control for a wholesale distribution platform to deploy a large self-hosted model with significant GPU memory needs. The change is applied outside the component responsible for the requirement identified by a wholesale distribution platform. In this deployment, engineers should verify the missing mechanism rather than assume the proposed step satisfies the acceptance conditions.

AWS Certified Generative AI Developer - Professional AIP-C01 Practice Tests