Anthropic CCAR-P (Claude Certified Architect - Professional) Practice Test 34

Question 330

A financial assistant is evaluated only on easy inputs, hiding failures on atypical cases. What should be incorporated into the approved design?

  1. At this decision point, record authoritative inputs, approvals, decision rules and audit provenance outside the model.
  2. As a candidate control, assess ambiguity, locale and cultural context as reliability risks needing expert review.
  3. In the initial solution, document uncertainty and failure boundaries with edge-case stress testing.
  4. As a scoped first step, add indirect prompt injection to the threat model for untrusted context and tool outputs.

Explanation

Correct Answer

C:

A validated average does not guarantee reliability on rare but costly distribution tails; the controlled test needs to find that the risk register includes measured failures for unusual transaction patterns.

Incorrect Answers

A:

Generated narrative is not a durable substitute for independently verifiable controls and evidence; this makes sense when a firm uses a model response as the sole record of a compliance decision, rather than the risk that a financial assistant is evaluated only on easy inputs, hiding failures on atypical cases.

B:

Literal fluency can conceal changed legal or social meaning for particular populations; this technique fits where a translation assistant loses nuance across legal jurisdictions and dialects, rather than the condition that a financial assistant is evaluated only on easy inputs, hiding failures on atypical cases.

D:

Retrieved text can carry adversarial instructions unrelated to the user's legitimate task; the design helps when a customer-support corpus contains hostile instructions hidden inside imported tickets, but the present constraint is that a financial assistant is evaluated only on easy inputs, hiding failures on atypical cases.

Question 331

A translation assistant loses nuance across legal jurisdictions and dialects. Which approach should the design team choose?

  1. During architecture review, treat model and prompt combinations as change-sensitive and run regression evaluations.
  2. In the proposed implementation, add indirect prompt injection to the threat model for untrusted context and tool outputs.
  3. At this decision point, assess ambiguity, locale and cultural context as reliability risks needing expert review.
  4. As a candidate control, record authoritative inputs, approvals, decision rules and audit provenance outside the model.
  5. In the initial solution, threat-model unintended side effects and constrain outbound actions before deployment.

Explanation

Correct Answer

C:

Literal fluency can conceal changed legal or social meaning for particular populations; acceptance evidence must confirm that native expert assessment identifies high-risk semantic mismatches before publication.

Incorrect Answers

A:

Generative systems can shift behavior even when application code remains unchanged; the other workload is one where a legal team assumes the same prompt will behave identically after each model upgrade, not the risk where a translation assistant loses nuance across legal jurisdictions and dialects.

B:

Retrieved text can carry adversarial instructions unrelated to the user's legitimate task; this applies when a customer-support corpus contains hostile instructions hidden inside imported tickets, not this situation where a translation assistant loses nuance across legal jurisdictions and dialects.

D:

Generated narrative is not a durable substitute for independently verifiable controls and evidence; it is justified if a firm uses a model response as the sole record of a compliance decision, but here a translation assistant loses nuance across legal jurisdictions and dialects.

E:

Action-capable errors can create real-world consequences beyond inaccurate conversational text; its scope includes cases where an autonomous assistant can send external emails when it misreads a user request, instead of when a translation assistant loses nuance across legal jurisdictions and dialects.

Question 332

A firm uses a model response as the sole record of a compliance decision. Where should the solution architect focus the implementation?

  1. As a scoped first step, assess ambiguity, locale and cultural context as reliability risks needing expert review.
  2. In the release design, classify unsupported factual claims as a hallucination risk and require evidence checks.
  3. During architecture review, record authoritative inputs, approvals, decision rules and audit provenance outside the model.
  4. In the proposed implementation, document uncertainty and failure boundaries with edge-case stress testing.

Explanation

Correct Answer

C:

Generated narrative is not a durable substitute for independently verifiable controls and evidence; a clear sign-off signal is that auditors can trace the decision to sources, owner and applied policy without trusting the prose.

Incorrect Answers

A:

Literal fluency can conceal changed legal or social meaning for particular populations; it serves conditions where a translation assistant loses nuance across legal jurisdictions and dialects, but this decision concerns a firm uses a model response as the sole record of a compliance decision.

B:

Fluent phrasing does not demonstrate that a conclusion is grounded in the supplied materials; the other case is when a generated procurement recommendation appears confident but lacks support in the contract corpus, but the actual risk is that a firm uses a model response as the sole record of a compliance decision.

D:

A validated average does not guarantee reliability on rare but costly distribution tails; this technique fits where a financial assistant is evaluated only on easy inputs, hiding failures on atypical cases, not the present case where a firm uses a model response as the sole record of a compliance decision.

Question 333

A contract assistant confidently names a cancellation fee that cannot be found in any approved agreement. What result discriminates a working safeguard from a demo?

  1. The regression suite verifies that pinned tests identify changed legal interpretations before promoting a new version.
  2. A production-like test shows that auditors can trace the decision to sources, owner and applied policy without trusting the prose.
  3. The release check confirms that ambiguous requests cannot result in unreviewed external messages.
  4. The reviewer observes that tests detect fabricated contract terms and force abstention without supporting passages.
  5. The release report verifies that native expert assessment identifies high-risk semantic mismatches before publication.

Explanation

Correct Answer

D:

Fluent phrasing does not demonstrate that a conclusion is grounded in the supplied materials; the reviewer is concerned with situations where a generated procurement recommendation appears confident but lacks support in the contract corpus.

Incorrect Answers

A:

Generative systems can shift behavior even when application code remains unchanged; it serves a setting where a legal team assumes the same prompt will behave identically after each model upgrade, rather than the condition that a contract assistant confidently names a cancellation fee that cannot be found in any approved agreement.

B:

Generated narrative is not a durable substitute for independently verifiable controls and evidence; that is defensible if a firm uses a model response as the sole record of a compliance decision, while the immediate question involves a contract assistant confidently names a cancellation fee that cannot be found in any approved agreement.

C:

Action-capable errors can create real-world consequences beyond inaccurate conversational text; the other workload is one where an autonomous assistant can send external emails when it misreads a user request, but the present constraint is that a contract assistant confidently names a cancellation fee that cannot be found in any approved agreement.

E:

Literal fluency can conceal changed legal or social meaning for particular populations; the alternative helps if a translation assistant loses nuance across legal jurisdictions and dialects, whereas the release criterion addresses a contract assistant confidently names a cancellation fee that cannot be found in any approved agreement.

Question 334

A messaging agent drafts an external notice and might transmit it before a human verifies the recipient and content. What outcome must the reviewer see before proceeding?

  1. The end-to-end check confirms that the risk register includes measured failures for unusual transaction patterns.
  2. The observed outcome is that auditors can trace the decision to sources, owner and applied policy without trusting the prose.
  3. The regression suite verifies that tests detect fabricated contract terms and force abstention without supporting passages.
  4. A production-like test shows that ambiguous requests cannot result in unreviewed external messages.

Explanation

Correct Answer

D:

Action-capable errors can create real-world consequences beyond inaccurate conversational text; its finding speaks to the case where an autonomous assistant can send external emails when it misreads a user request.

Incorrect Answers

A:

A validated average does not guarantee reliability on rare but costly distribution tails; that belongs to situations where a financial assistant is evaluated only on easy inputs, hiding failures on atypical cases, not this situation where a messaging agent drafts an external notice and might transmit it before a human verifies the recipient and content.

B:

Generated narrative is not a durable substitute for independently verifiable controls and evidence; it is relevant if a firm uses a model response as the sole record of a compliance decision, whereas this scenario involves a messaging agent drafts an external notice and might transmit it before a human verifies the recipient and content.

C:

Fluent phrasing does not demonstrate that a conclusion is grounded in the supplied materials; it serves conditions where a generated procurement recommendation appears confident but lacks support in the contract corpus, but here a messaging agent drafts an external notice and might transmit it before a human verifies the recipient and content.

Question 335

A release candidate behaves differently on legal summaries after a model-version change that left prompts untouched. Which result should the pilot review prioritize?

  1. The measured evidence confirms that ambiguous requests cannot result in unreviewed external messages.
  2. The scenario test demonstrates that tests detect fabricated contract terms and force abstention without supporting passages.
  3. The verified result is that the risk register includes measured failures for unusual transaction patterns.
  4. The observed outcome is that pinned tests identify changed legal interpretations before promoting a new version.

Explanation

Correct Answer

D:

Generative systems can shift behavior even when application code remains unchanged; the verification boundary is the one where a legal team assumes the same prompt will behave identically after each model upgrade.

Incorrect Answers

A:

Action-capable errors can create real-world consequences beyond inaccurate conversational text; this control is needed when an autonomous assistant can send external emails when it misreads a user request, but the actual risk is that a release candidate behaves differently on legal summaries after a model-version change that left prompts untouched.

B:

Fluent phrasing does not demonstrate that a conclusion is grounded in the supplied materials; that would be useful if a generated procurement recommendation appears confident but lacks support in the contract corpus, but the requested boundary concerns a release candidate behaves differently on legal summaries after a model-version change that left prompts untouched.

C:

A validated average does not guarantee reliability on rare but costly distribution tails; it serves a setting where a financial assistant is evaluated only on easy inputs, hiding failures on atypical cases, not the present case where a release candidate behaves differently on legal summaries after a model-version change that left prompts untouched.

Question 336

An imported help-desk ticket contains instructions telling the assistant to disregard its system rules. What result would directly validate the necessary safeguard?

  1. The negative-case evaluation confirms that ambiguous requests cannot result in unreviewed external messages.
  2. A controlled trial finds that the risk register includes measured failures for unusual transaction patterns.
  3. The measured evidence confirms that tests detect fabricated contract terms and force abstention without supporting passages.
  4. The scenario test demonstrates that malicious ticket text cannot induce unauthorized tool calls or hidden-data disclosure.

Explanation

Correct Answer

D:

Retrieved text can carry adversarial instructions unrelated to the user's legitimate task; the evidence must be robust when a customer-support corpus contains hostile instructions hidden inside imported tickets.

Incorrect Answers

A:

Action-capable errors can create real-world consequences beyond inaccurate conversational text; it targets cases where an autonomous assistant can send external emails when it misreads a user request, while the immediate question involves an imported help-desk ticket contains instructions telling the assistant to disregard its system rules.

B:

A validated average does not guarantee reliability on rare but costly distribution tails; the approach helps when a financial assistant is evaluated only on easy inputs, hiding failures on atypical cases, but the present constraint is that an imported help-desk ticket contains instructions telling the assistant to disregard its system rules.

C:

Fluent phrasing does not demonstrate that a conclusion is grounded in the supplied materials; that belongs to situations where a generated procurement recommendation appears confident but lacks support in the contract corpus, whereas the current issue is that an imported help-desk ticket contains instructions telling the assistant to disregard its system rules.

Question 337

A finance classifier passes standard invoices but mishandles suspicious multi-party payment exceptions. What evidence would reveal whether the control truly works?

  1. The recorded test establishes that pinned tests identify changed legal interpretations before promoting a new version.
  2. The representative case test finds that ambiguous requests cannot result in unreviewed external messages.
  3. The negative-case evaluation confirms that the risk register includes measured failures for unusual transaction patterns.
  4. A controlled trial finds that auditors can trace the decision to sources, owner and applied policy without trusting the prose.

Explanation

Correct Answer

C:

A validated average does not guarantee reliability on rare but costly distribution tails; its finding speaks to the case where a financial assistant is evaluated only on easy inputs, hiding failures on atypical cases.

Incorrect Answers

A:

Generative systems can shift behavior even when application code remains unchanged; the design helps when a legal team assumes the same prompt will behave identically after each model upgrade, whereas this scenario involves a finance classifier passes standard invoices but mishandles suspicious multi-party payment exceptions.

B:

Action-capable errors can create real-world consequences beyond inaccurate conversational text; that fits cases where an autonomous assistant can send external emails when it misreads a user request, but here a finance classifier passes standard invoices but mishandles suspicious multi-party payment exceptions.

D:

Generated narrative is not a durable substitute for independently verifiable controls and evidence; that would be useful if a firm uses a model response as the sole record of a compliance decision, not the case in which a finance classifier passes standard invoices but mishandles suspicious multi-party payment exceptions.

Question 338

A translated legal notice loses a mandatory qualifier for a specific region's audience. Which result proves the requested control, not just configuration?

  1. The independent test establishes that auditors can trace the decision to sources, owner and applied policy without trusting the prose.
  2. The verified result is that ambiguous requests cannot result in unreviewed external messages.
  3. The recorded test establishes that native expert assessment identifies high-risk semantic mismatches before publication.
  4. The representative case test finds that pinned tests identify changed legal interpretations before promoting a new version.
  5. The staged rollout demonstrates that the risk register includes measured failures for unusual transaction patterns.

Explanation

Correct Answer

C:

Literal fluency can conceal changed legal or social meaning for particular populations; the verification boundary is the one where a translation assistant loses nuance across legal jurisdictions and dialects.

Incorrect Answers

A:

Generated narrative is not a durable substitute for independently verifiable controls and evidence; it is justified if a firm uses a model response as the sole record of a compliance decision, but the requested boundary concerns a translated legal notice loses a mandatory qualifier for a specific region's audience.

B:

Action-capable errors can create real-world consequences beyond inaccurate conversational text; its scope includes cases where an autonomous assistant can send external emails when it misreads a user request, not the present case where a translated legal notice loses a mandatory qualifier for a specific region's audience.

D:

Generative systems can shift behavior even when application code remains unchanged; the approach helps when a legal team assumes the same prompt will behave identically after each model upgrade, and not where a translated legal notice loses a mandatory qualifier for a specific region's audience.

E:

A validated average does not guarantee reliability on rare but costly distribution tails; that belongs to situations where a financial assistant is evaluated only on easy inputs, hiding failures on atypical cases, rather than the risk that a translated legal notice loses a mandatory qualifier for a specific region's audience.

Question 339

A regulator asks for the authority behind a decision, but the team saved only a free-text assistant response. Which acceptance result provides the most specific evidence?

  1. The audit sample demonstrates that the risk register includes measured failures for unusual transaction patterns.
  2. The readiness assessment shows that native expert assessment identifies high-risk semantic mismatches before publication.
  3. The independent test establishes that pinned tests identify changed legal interpretations before promoting a new version.
  4. The verified result is that auditors can trace the decision to sources, owner and applied policy without trusting the prose.

Explanation

Correct Answer

D:

Generated narrative is not a durable substitute for independently verifiable controls and evidence; this is a functional check for the case where a firm uses a model response as the sole record of a compliance decision.

Incorrect Answers

A:

A validated average does not guarantee reliability on rare but costly distribution tails; this technique fits where a financial assistant is evaluated only on easy inputs, hiding failures on atypical cases, but the present constraint is that a regulator asks for the authority behind a decision, but the team saved only a free-text assistant response.

B:

Literal fluency can conceal changed legal or social meaning for particular populations; the trigger would be that a translation assistant loses nuance across legal jurisdictions and dialects, whereas the current issue is that a regulator asks for the authority behind a decision, but the team saved only a free-text assistant response.

C:

Generative systems can shift behavior even when application code remains unchanged; the design helps when a legal team assumes the same prompt will behave identically after each model upgrade, whereas the release criterion addresses a regulator asks for the authority behind a decision, but the team saved only a free-text assistant response.

Question 340

A retrieved page tells an assistant to reveal a system secret during a normal summary. Which control should govern the first implementation?

  1. For this production path, treat retrieval as untrusted and enforce secret protection outside the prompt.
  2. For the intended users, validate against an allowlisted schema and reject unrecognized executable parameters.
  3. Within the delivery plan, add risk-aware content handling with safe refusal and escalation pathways.
  4. At the system boundary, gate high-impact tool execution with authenticated parameters and server-side policy checks.

Explanation

Correct Answer

A:

Layered controls prevent source text from overriding authority and block actual secret access; a suitable release result is that injected pages fail to elicit secrets even when the model repeats their instructions.

Incorrect Answers

B:

Structured syntax alone does not establish that content is safe for downstream execution; the alternative helps if a model generates seemingly valid JSON containing an unexpected shell-command field, instead of when a retrieved page tells an assistant to reveal a system secret during a normal summary.

C:

A scoped safety policy should prevent harmful responses while preserving legitimate help; it is justified if a public service receives harassment and self-harm requests outside its permitted purpose, not the case in which a retrieved page tells an assistant to reveal a system secret during a normal summary.

D:

A model's requested action must be validated before an irreversible financial operation occurs; its scope includes cases where an order agent accepts a text instruction to send payment to any account, whereas the problem presented is that a retrieved page tells an assistant to reveal a system secret during a normal summary.

Claude Certified Architect - Professional (CCAR-P) Practice Tests