Question 380

At a telecom support operation, engineers need to evaluate whether the generated answer is faithful to retrieved evidence. The next release must be evaluated against the previous baseline. The initial assessment isolates this issue from unrelated infrastructure changes. What is the most appropriate production approach?

  1. Score only whether the response sounds articulate
  2. Assume a citation exists therefore every statement is supported
  3. Measure string length as factual accuracy
  4. Use groundedness or faithfulness scoring with human-checked evaluation examples

Explanation

Correct Answer

D:

Faithfulness checks whether claims are entailed by the provided evidence. In a telecom support operation, the engineering team should verify this design against its stated objective to evaluate whether the generated answer is faithful to retrieved evidence, including the requirement that the next release must be evaluated against the previous baseline.

Incorrect Answers

A:

The suggested action—score only whether the response sounds articulate—does not establish the required control for a telecom support operation to evaluate whether the generated answer is faithful to retrieved evidence. No demonstrated capability in this scenario guarantees that this step resolves the concern raised by a telecom support operation. In this deployment, engineers should verify the missing mechanism rather than assume the proposed step satisfies the acceptance conditions.

B:

The suggested action—assume a citation exists therefore every statement is supported—does not establish the required control for a telecom support operation to evaluate whether the generated answer is faithful to retrieved evidence. It replaces a verifiable engineering control with an untested shortcut in the a telecom support operation deployment. In this deployment, engineers should verify the missing mechanism rather than assume the proposed step satisfies the acceptance conditions.

C:

The suggested action—measure string length as factual accuracy—does not establish the required control for a telecom support operation to evaluate whether the generated answer is faithful to retrieved evidence. The change is applied outside the component responsible for the requirement identified by a telecom support operation. In this deployment, engineers should verify the missing mechanism rather than assume the proposed step satisfies the acceptance conditions.

Question 381

At a municipal services portal, engineers need to connect agents to tools with consistent contracts across services. The service must continue to support multiple independent tenants. A recent review found that the current design has no reliable safeguard for this case. What should be implemented before scaling this workflow?

  1. Define typed tool inputs and outputs and validate parameters at execution time
  2. Parse arbitrary unvalidated text as database commands
  3. Give agents raw internal credentials for every service
  4. Assume tool schemas never change between versions

Explanation

Correct Answer

A:

Well-defined tool contracts reduce execution errors and enforce boundaries. In a municipal services portal, the engineering team should verify this design against its stated objective to connect agents to tools with consistent contracts across services, including the requirement that the service must continue to support multiple independent tenants.

Incorrect Answers

B:

The suggested action—parse arbitrary unvalidated text as database commands—does not establish the required control for a municipal services portal to connect agents to tools with consistent contracts across services. No demonstrated capability in this scenario guarantees that this step resolves the concern raised by a municipal services portal. In this deployment, engineers should verify the missing mechanism rather than assume the proposed step satisfies the acceptance conditions.

C:

The suggested action—give agents raw internal credentials for every service—does not establish the required control for a municipal services portal to connect agents to tools with consistent contracts across services. It replaces a verifiable engineering control with an untested shortcut in the a municipal services portal deployment. In this deployment, engineers should verify the missing mechanism rather than assume the proposed step satisfies the acceptance conditions.

D:

The suggested action—assume tool schemas never change between versions—does not establish the required control for a municipal services portal to connect agents to tools with consistent contracts across services. The change is applied outside the component responsible for the requirement identified by a municipal services portal. In this deployment, engineers should verify the missing mechanism rather than assume the proposed step satisfies the acceptance conditions.

Question 382

At a retail bank, engineers need to reduce end-to-end latency of independent retrieval and policy checks. The deployment has both bursty and sustained workloads. The initial assessment isolates this issue from unrelated infrastructure changes. Which architecture is best supported by the stated constraints?

  1. Assume shorter prompts always compensate for network bottlenecks
  2. Execute safe independent stages concurrently and join their results before generation
  3. Serialize every independent request by default
  4. Remove validation to conceal latency

Explanation

Correct Answer

B:

Parallel work can reduce critical-path latency when stages have no dependency. In a retail bank, the engineering team should verify this design against its stated objective to reduce end-to-end latency of independent retrieval and policy checks, including the requirement that the deployment has both bursty and sustained workloads.

Incorrect Answers

A:

The suggested action—assume shorter prompts always compensate for network bottlenecks—does not establish the required control for a retail bank to reduce end-to-end latency of independent retrieval and policy checks. No demonstrated capability in this scenario guarantees that this step resolves the concern raised by a retail bank. In this deployment, engineers should verify the missing mechanism rather than assume the proposed step satisfies the acceptance conditions.

C:

The suggested action—serialize every independent request by default—does not establish the required control for a retail bank to reduce end-to-end latency of independent retrieval and policy checks. The change is applied outside the component responsible for the requirement identified by a retail bank. In this deployment, engineers should verify the missing mechanism rather than assume the proposed step satisfies the acceptance conditions.

D:

The suggested action—remove validation to conceal latency—does not establish the required control for a retail bank to reduce end-to-end latency of independent retrieval and policy checks. No demonstrated capability in this scenario guarantees that this step resolves the concern raised by a retail bank. In this deployment, engineers should verify the missing mechanism rather than assume the proposed step satisfies the acceptance conditions.

Question 383

At a nonprofit grant portal, engineers need to reduce unsupported claims in a policy-answering assistant. The design must distinguish inference behavior from upstream data quality. An architecture review has rejected fixes that only conceal the symptoms. What should be implemented before scaling this workflow?

  1. Ground responses in retrieved approved sources and evaluate citation support
  2. Raise temperature to make responses sound confident
  3. Remove citations and ask the model to infer facts
  4. Store policies only as hidden system-prompt text with no updates

Explanation

Correct Answer

A:

Grounding and faithfulness tests make assertions verifiable against source context. In a nonprofit grant portal, the engineering team should verify this design against its stated objective to reduce unsupported claims in a policy-answering assistant, including the requirement that the design must distinguish inference behavior from upstream data quality.

Incorrect Answers

B:

The suggested action—raise temperature to make responses sound confident—does not establish the required control for a nonprofit grant portal to reduce unsupported claims in a policy-answering assistant. The change is applied outside the component responsible for the requirement identified by a nonprofit grant portal. In this deployment, engineers should verify the missing mechanism rather than assume the proposed step satisfies the acceptance conditions.

C:

The suggested action—remove citations and ask the model to infer facts—does not establish the required control for a nonprofit grant portal to reduce unsupported claims in a policy-answering assistant. No demonstrated capability in this scenario guarantees that this step resolves the concern raised by a nonprofit grant portal. In this deployment, engineers should verify the missing mechanism rather than assume the proposed step satisfies the acceptance conditions.

D:

The suggested action—store policies only as hidden system-prompt text with no updates—does not establish the required control for a nonprofit grant portal to reduce unsupported claims in a policy-answering assistant. It replaces a verifiable engineering control with an untested shortcut in the a nonprofit grant portal deployment. In this deployment, engineers should verify the missing mechanism rather than assume the proposed step satisfies the acceptance conditions.

Question 384

At a payment operations team, engineers need to switch model providers without modifying application business logic. Operators need measurable acceptance criteria before rollout. The team wants a solution that can be validated through targeted test cases. Which design decision addresses the underlying issue?

  1. Hard-code one model ID in all business services
  2. Depend on prompt wording to silently change cloud providers
  3. Introduce a model adapter and externalized routing configuration
  4. Embed provider-specific request formats in every user interface

Explanation

Correct Answer

C:

An abstraction layer isolates provider requests and lets configuration drive changes. In a payment operations team, the engineering team should verify this design against its stated objective to switch model providers without modifying application business logic, including the requirement that operators need measurable acceptance criteria before rollout.

Incorrect Answers

A:

The suggested action—hard-code one model ID in all business services—does not establish the required control for a payment operations team to switch model providers without modifying application business logic. The change is applied outside the component responsible for the requirement identified by a payment operations team. In this deployment, engineers should verify the missing mechanism rather than assume the proposed step satisfies the acceptance conditions.

B:

The suggested action—depend on prompt wording to silently change cloud providers—does not establish the required control for a payment operations team to switch model providers without modifying application business logic. No demonstrated capability in this scenario guarantees that this step resolves the concern raised by a payment operations team. In this deployment, engineers should verify the missing mechanism rather than assume the proposed step satisfies the acceptance conditions.

D:

The suggested action—embed provider-specific request formats in every user interface—does not establish the required control for a payment operations team to switch model providers without modifying application business logic. The change is applied outside the component responsible for the requirement identified by a payment operations team. In this deployment, engineers should verify the missing mechanism rather than assume the proposed step satisfies the acceptance conditions.

Question 385

At a public-sector document office, engineers need to coordinate agents performing specialized research and verification tasks. The team must preserve existing identity and authorization boundaries. The initial assessment isolates this issue from unrelated infrastructure changes. What should the lead engineer recommend?

  1. Concatenate outputs without conflict resolution
  2. Use a controlled supervisor workflow with bounded handoffs and combined results
  3. Let agents recursively call one another without a coordination policy
  4. Assume every agent has access to every private data source

Explanation

Correct Answer

B:

Multi-agent orchestration needs roles, shared state contracts and controlled delegation. In a public-sector document office, the engineering team should verify this design against its stated objective to coordinate agents performing specialized research and verification tasks, including the requirement that the team must preserve existing identity and authorization boundaries.

Incorrect Answers

A:

The suggested action—concatenate outputs without conflict resolution—does not establish the required control for a public-sector document office to coordinate agents performing specialized research and verification tasks. No demonstrated capability in this scenario guarantees that this step resolves the concern raised by a public-sector document office. In this deployment, engineers should verify the missing mechanism rather than assume the proposed step satisfies the acceptance conditions.

C:

The suggested action—let agents recursively call one another without a coordination policy—does not establish the required control for a public-sector document office to coordinate agents performing specialized research and verification tasks. The change is applied outside the component responsible for the requirement identified by a public-sector document office. In this deployment, engineers should verify the missing mechanism rather than assume the proposed step satisfies the acceptance conditions.

D:

The suggested action—assume every agent has access to every private data source—does not establish the required control for a public-sector document office to coordinate agents performing specialized research and verification tasks. No demonstrated capability in this scenario guarantees that this step resolves the concern raised by a public-sector document office. In this deployment, engineers should verify the missing mechanism rather than assume the proposed step satisfies the acceptance conditions.

Question 386

At a travel services company, engineers need to monitor vector index freshness and ingestion failures. The engineers cannot depend on manual intervention for every request. An architecture review has rejected fixes that only conceal the symptoms. What should be implemented before scaling this workflow?

  1. Measure document lag, failed updates and retrieval-health indicators
  2. Monitor only model output length
  3. Assume all index updates succeed after receiving HTTP 202
  4. Never record deleted-source propagation

Explanation

Correct Answer

A:

Index-health observability complements model invocation metrics. In a travel services company, the engineering team should verify this design against its stated objective to monitor vector index freshness and ingestion failures, including the requirement that the engineers cannot depend on manual intervention for every request.

Incorrect Answers

B:

The suggested action—monitor only model output length—does not establish the required control for a travel services company to monitor vector index freshness and ingestion failures. The change is applied outside the component responsible for the requirement identified by a travel services company. In this deployment, engineers should verify the missing mechanism rather than assume the proposed step satisfies the acceptance conditions.

C:

The suggested action—assume all index updates succeed after receiving HTTP 202—does not establish the required control for a travel services company to monitor vector index freshness and ingestion failures. No demonstrated capability in this scenario guarantees that this step resolves the concern raised by a travel services company. In this deployment, engineers should verify the missing mechanism rather than assume the proposed step satisfies the acceptance conditions.

D:

The suggested action—never record deleted-source propagation—does not establish the required control for a travel services company to monitor vector index freshness and ingestion failures. It replaces a verifiable engineering control with an untested shortcut in the a travel services company deployment. In this deployment, engineers should verify the missing mechanism rather than assume the proposed step satisfies the acceptance conditions.

Question 387

At a logistics marketplace, engineers need to measure whether a RAG system retrieves the right supporting passages. The implementation must remain maintainable across model upgrades. A recent review found that the current design has no reliable safeguard for this case. Which remediation addresses the root problem?

  1. Remove labeled documents from the test set
  2. Evaluate retrieval recall or precision against annotated query-document pairs
  3. Grade only fluency of final text
  4. Measure GPU utilization and infer document relevance

Explanation

Correct Answer

B:

Retrieval-stage metrics isolate evidence selection from answer generation. In a logistics marketplace, the engineering team should verify this design against its stated objective to measure whether a RAG system retrieves the right supporting passages, including the requirement that the implementation must remain maintainable across model upgrades.

Incorrect Answers

A:

The suggested action—remove labeled documents from the test set—does not establish the required control for a logistics marketplace to measure whether a RAG system retrieves the right supporting passages. No demonstrated capability in this scenario guarantees that this step resolves the concern raised by a logistics marketplace. In this deployment, engineers should verify the missing mechanism rather than assume the proposed step satisfies the acceptance conditions.

C:

The suggested action—grade only fluency of final text—does not establish the required control for a logistics marketplace to measure whether a RAG system retrieves the right supporting passages. The change is applied outside the component responsible for the requirement identified by a logistics marketplace. In this deployment, engineers should verify the missing mechanism rather than assume the proposed step satisfies the acceptance conditions.

D:

The suggested action—measure GPU utilization and infer document relevance—does not establish the required control for a logistics marketplace to measure whether a RAG system retrieves the right supporting passages. No demonstrated capability in this scenario guarantees that this step resolves the concern raised by a logistics marketplace. In this deployment, engineers should verify the missing mechanism rather than assume the proposed step satisfies the acceptance conditions.

Question 388

At a logistics marketplace, engineers need to reconstruct which data revision supported an AI-generated answer. The compliance team requires a traceable decision record. The team wants a solution that can be validated through targeted test cases. What is the most appropriate production approach?

  1. Keep only the final natural-language answer
  2. Replace source metadata with a random label after generation
  3. Depend on the model to recall a deleted source later
  4. Record source IDs, version metadata and request correlation information

Explanation

Correct Answer

D:

Traceability links model outputs to the exact version of authorized evidence. In a logistics marketplace, the engineering team should verify this design against its stated objective to reconstruct which data revision supported an AI-generated answer, including the requirement that the compliance team requires a traceable decision record.

Incorrect Answers

A:

The suggested action—keep only the final natural-language answer—does not establish the required control for a logistics marketplace to reconstruct which data revision supported an AI-generated answer. No demonstrated capability in this scenario guarantees that this step resolves the concern raised by a logistics marketplace. In this deployment, engineers should verify the missing mechanism rather than assume the proposed step satisfies the acceptance conditions.

B:

The suggested action—replace source metadata with a random label after generation—does not establish the required control for a logistics marketplace to reconstruct which data revision supported an AI-generated answer. It replaces a verifiable engineering control with an untested shortcut in the a logistics marketplace deployment. In this deployment, engineers should verify the missing mechanism rather than assume the proposed step satisfies the acceptance conditions.

C:

The suggested action—depend on the model to recall a deleted source later—does not establish the required control for a logistics marketplace to reconstruct which data revision supported an AI-generated answer. The change is applied outside the component responsible for the requirement identified by a logistics marketplace. In this deployment, engineers should verify the missing mechanism rather than assume the proposed step satisfies the acceptance conditions.

Question 389

At a global manufacturer, engineers need to keep a vector knowledge index aligned with frequent source changes. The implementation must remain maintainable across model upgrades. A recent review found that the current design has no reliable safeguard for this case. Which change should the team prioritize?

  1. Never delete embeddings for withdrawn documents
  2. Modify the prompt without updating stale vectors
  3. Use incremental synchronization with deletion handling and freshness monitoring
  4. Rebuild all indexes blindly on every user query

Explanation

Correct Answer

C:

Incremental updates maintain freshness and avoid unnecessary full rebuild work. In a global manufacturer, the engineering team should verify this design against its stated objective to keep a vector knowledge index aligned with frequent source changes, including the requirement that the implementation must remain maintainable across model upgrades.

Incorrect Answers

A:

The suggested action—never delete embeddings for withdrawn documents—does not establish the required control for a global manufacturer to keep a vector knowledge index aligned with frequent source changes. The change is applied outside the component responsible for the requirement identified by a global manufacturer. In this deployment, engineers should verify the missing mechanism rather than assume the proposed step satisfies the acceptance conditions.

B:

The suggested action—modify the prompt without updating stale vectors—does not establish the required control for a global manufacturer to keep a vector knowledge index aligned with frequent source changes. No demonstrated capability in this scenario guarantees that this step resolves the concern raised by a global manufacturer. In this deployment, engineers should verify the missing mechanism rather than assume the proposed step satisfies the acceptance conditions.

D:

The suggested action—rebuild all indexes blindly on every user query—does not establish the required control for a global manufacturer to keep a vector knowledge index aligned with frequent source changes. The change is applied outside the component responsible for the requirement identified by a global manufacturer. In this deployment, engineers should verify the missing mechanism rather than assume the proposed step satisfies the acceptance conditions.

Question 390

At a retail bank, engineers need to reconstruct which data revision supported an AI-generated answer. The compliance team requires a traceable decision record. The initial assessment isolates this issue from unrelated infrastructure changes. What should the lead engineer recommend?

  1. Depend on the model to recall a deleted source later
  2. Record source IDs, version metadata and request correlation information
  3. Keep only the final natural-language answer
  4. Replace source metadata with a random label after generation

Explanation

Correct Answer

B:

Traceability links model outputs to the exact version of authorized evidence. In a retail bank, the engineering team should verify this design against its stated objective to reconstruct which data revision supported an AI-generated answer, including the requirement that the compliance team requires a traceable decision record.

Incorrect Answers

A:

The suggested action—depend on the model to recall a deleted source later—does not establish the required control for a retail bank to reconstruct which data revision supported an AI-generated answer. It replaces a verifiable engineering control with an untested shortcut in the a retail bank deployment. In this deployment, engineers should verify the missing mechanism rather than assume the proposed step satisfies the acceptance conditions.

C:

The suggested action—keep only the final natural-language answer—does not establish the required control for a retail bank to reconstruct which data revision supported an AI-generated answer. No demonstrated capability in this scenario guarantees that this step resolves the concern raised by a retail bank. In this deployment, engineers should verify the missing mechanism rather than assume the proposed step satisfies the acceptance conditions.

D:

The suggested action—replace source metadata with a random label after generation—does not establish the required control for a retail bank to reconstruct which data revision supported an AI-generated answer. It replaces a verifiable engineering control with an untested shortcut in the a retail bank deployment. In this deployment, engineers should verify the missing mechanism rather than assume the proposed step satisfies the acceptance conditions.

AWS Certified Generative AI Developer - Professional AIP-C01 Practice Tests