Anthropic CCAR-P (Claude Certified Architect - Professional) Practice Test 10

Question 90

A multilingual customer assistant must meet a quality target for underrepresented dialects. What change directly resolves this production-design issue?

  1. For this production path, evaluate candidate models on approved dialect-specific examples before routing traffic.
  2. For the intended users, route by task difficulty with quality gates and escalation to a stronger model when justified.
  3. Within the delivery plan, use a versioned canary evaluation and preserve rollback to the previous approved model.
  4. At the system boundary, benchmark an efficient Claude model tier on the actual labeled classifier workload.
  5. For this deployment, evaluate a higher-capability model against expert-rated reasoning cases before deployment.

Explanation

Correct Answer

A:

English-only accuracy can hide critical gaps in the actual served user population; its effect can be measured when per-dialect error rates and expert judgments stay within documented release limits.

Incorrect Answers

B:

Tiered inference avoids paying the highest reasoning cost for requests that an efficient model handles safely; this technique fits where an assistant faces inexpensive simple questions alongside rare complex investigations, rather than the condition that a multilingual customer assistant must meet a quality target for underrepresented dialects.

C:

A model change is a behavioral release that can invalidate prior prompts and safety assumptions; the trigger would be that a team proposes a model upgrade that changes output behavior across regulated reports, while the immediate question involves a multilingual customer assistant must meet a quality target for underrepresented dialects.

D:

Smaller capable models can minimize unit cost if measured quality meets the task threshold; the design helps when a low-risk classification queue needs massive throughput and has simple prompts, but the present constraint is that a multilingual customer assistant must meet a quality target for underrepresented dialects.

E:

Hard multi-constraint reasoning may justify greater latency and price when smaller models fail reliable acceptance tests; that fits cases where an architecture review asks Claude to reconcile many conflicting technical constraints, whereas the current issue is that a multilingual customer assistant must meet a quality target for underrepresented dialects.

Question 91

A team proposes a model upgrade that changes output behavior across regulated reports. Which proposed design action directly addresses the risk?

  1. In the proposed design, evaluate a higher-capability model against expert-rated reasoning cases before deployment.
  2. Under the reviewed approach, use a versioned canary evaluation and preserve rollback to the previous approved model.
  3. For this production path, test retrieval and evidence fidelity at realistic context lengths for candidate models.
  4. In the proposed implementation, route by task difficulty with quality gates and escalation to a stronger model when justified.

Explanation

Correct Answer

B:

A model change is a behavioral release that can invalidate prior prompts and safety assumptions; a meaningful test result is that shadow comparisons detect any schema, citation or safety regression before broad cutover.

Incorrect Answers

A:

Hard multi-constraint reasoning may justify greater latency and price when smaller models fail reliable acceptance tests; the other workload is one where an architecture review asks Claude to reconcile many conflicting technical constraints, not the risk where a team proposes a model upgrade that changes output behavior across regulated reports.

C:

Nominal context capacity is different from reliable use of relevant facts buried in lengthy material; the alternative helps if a long-document workflow assumes the largest supported context window guarantees correct recall, whereas this scenario involves a team proposes a model upgrade that changes output behavior across regulated reports.

D:

Tiered inference avoids paying the highest reasoning cost for requests that an efficient model handles safely; it is justified if an assistant faces inexpensive simple questions alongside rare complex investigations, but here a team proposes a model upgrade that changes output behavior across regulated reports.

Question 92

An assistant faces inexpensive simple questions alongside rare complex investigations. Which option supplies the needed architectural boundary?

  1. As a candidate control, route by task difficulty with quality gates and escalation to a stronger model when justified.
  2. In the initial solution, benchmark an efficient Claude model tier on the actual labeled classifier workload.
  3. As a scoped first step, evaluate a higher-capability model against expert-rated reasoning cases before deployment.
  4. Under the reviewed approach, evaluate candidate models on approved dialect-specific examples before routing traffic.

Explanation

Correct Answer

A:

Tiered inference avoids paying the highest reasoning cost for requests that an efficient model handles safely; the audit trail can establish that routing tests show simple-task savings without missed escalations on difficult cases.

Incorrect Answers

B:

Smaller capable models can minimize unit cost if measured quality meets the task threshold; the other case is when a low-risk classification queue needs massive throughput and has simple prompts, but the actual risk is that an assistant faces inexpensive simple questions alongside rare complex investigations.

C:

Hard multi-constraint reasoning may justify greater latency and price when smaller models fail reliable acceptance tests; this makes sense when an architecture review asks Claude to reconcile many conflicting technical constraints, but the requested boundary concerns an assistant faces inexpensive simple questions alongside rare complex investigations.

D:

English-only accuracy can hide critical gaps in the actual served user population; this technique fits where a multilingual customer assistant must meet a quality target for underrepresented dialects, not the present case where an assistant faces inexpensive simple questions alongside rare complex investigations.

Question 93

A throughput trial uses short generic examples rather than actual low-complexity messages and cost limits. What independently verifiable observation is needed?

  1. The controlled replay verifies that shadow comparisons detect any schema, citation or safety regression before broad cutover.
  2. A reproducible run shows that holdout comparisons report quality, tail latency and price under the real prompt structure.
  3. The signed test record confirms that a representative benchmark proves classification quality at required throughput and cost.
  4. The sign-off record demonstrates that expert blind ratings on conflicted design cases show the chosen tier meets the target.

Explanation

Correct Answer

C:

Smaller capable models can minimize unit cost if measured quality meets the task threshold; the safeguard must work when a low-risk classification queue needs massive throughput and has simple prompts.

Incorrect Answers

A:

A model change is a behavioral release that can invalidate prior prompts and safety assumptions; it serves a setting where a team proposes a model upgrade that changes output behavior across regulated reports, rather than the condition that a throughput trial uses short generic examples rather than actual low-complexity messages and cost limits.

B:

Public benchmarks do not substitute for task-specific correctness, token usage and latency measurement; that is defensible if a team wants to choose its model only from published benchmark rankings, while the immediate question involves a throughput trial uses short generic examples rather than actual low-complexity messages and cost limits.

D:

Hard multi-constraint reasoning may justify greater latency and price when smaller models fail reliable acceptance tests; this applies when an architecture review asks Claude to reconcile many conflicting technical constraints, whereas the current issue is that a throughput trial uses short generic examples rather than actual low-complexity messages and cost limits.

Question 94

A cheaper model handles basic questions but fails expert review on intertwined architectural constraints. What outcome would demonstrate this requirement in operation?

  1. The reviewer observes that expert blind ratings on conflicted design cases show the chosen tier meets the target.
  2. The release report verifies that a representative benchmark proves classification quality at required throughput and cost.
  3. The controlled replay verifies that adversarial long-document cases retain correct citation grounding as document length grows.
  4. The observed outcome is that holdout comparisons report quality, tail latency and price under the real prompt structure.

Explanation

Correct Answer

A:

Hard multi-constraint reasoning may justify greater latency and price when smaller models fail reliable acceptance tests; the condition under test is that an architecture review asks Claude to reconcile many conflicting technical constraints.

Incorrect Answers

B:

Smaller capable models can minimize unit cost if measured quality meets the task threshold; it is relevant if a low-risk classification queue needs massive throughput and has simple prompts, whereas this scenario involves a cheaper model handles basic questions but fails expert review on intertwined architectural constraints.

C:

Nominal context capacity is different from reliable use of relevant facts buried in lengthy material; it serves conditions where a long-document workflow assumes the largest supported context window guarantees correct recall, but here a cheaper model handles basic questions but fails expert review on intertwined architectural constraints.

D:

Public benchmarks do not substitute for task-specific correctness, token usage and latency measurement; the other case is when a team wants to choose its model only from published benchmark rankings, instead of when a cheaper model handles basic questions but fails expert review on intertwined architectural constraints.

Question 95

A model selection memo cites public rankings without any evidence from the organization's actual prompts. Which observed test outcome would justify sign-off?

  1. A production-like test shows that holdout comparisons report quality, tail latency and price under the real prompt structure.
  2. The release check confirms that shadow comparisons detect any schema, citation or safety regression before broad cutover.
  3. The reviewer observes that per-dialect error rates and expert judgments stay within documented release limits.
  4. The release report verifies that expert blind ratings on conflicted design cases show the chosen tier meets the target.

Explanation

Correct Answer

A:

Public benchmarks do not substitute for task-specific correctness, token usage and latency measurement; the observed protection matters when a team wants to choose its model only from published benchmark rankings.

Incorrect Answers

B:

A model change is a behavioral release that can invalidate prior prompts and safety assumptions; that would be useful if a team proposes a model upgrade that changes output behavior across regulated reports, but the requested boundary concerns a model selection memo cites public rankings without any evidence from the organization's actual prompts.

C:

English-only accuracy can hide critical gaps in the actual served user population; it serves a setting where a multilingual customer assistant must meet a quality target for underrepresented dialects, not the present case where a model selection memo cites public rankings without any evidence from the organization's actual prompts.

D:

Hard multi-constraint reasoning may justify greater latency and price when smaller models fail reliable acceptance tests; that is defensible if an architecture review asks Claude to reconcile many conflicting technical constraints, while this problem involves a model selection memo cites public rankings without any evidence from the organization's actual prompts.

Question 96

A contract summarizer passes tests on short passages yet misattributes facts deep inside long submissions. Which sign-off finding best checks the actual boundary?

  1. The observed outcome is that adversarial long-document cases retain correct citation grounding as document length grows.
  2. The regression suite verifies that routing tests show simple-task savings without missed escalations on difficult cases.
  3. A production-like test shows that expert blind ratings on conflicted design cases show the chosen tier meets the target.
  4. The release check confirms that holdout comparisons report quality, tail latency and price under the real prompt structure.

Explanation

Correct Answer

A:

Nominal context capacity is different from reliable use of relevant facts buried in lengthy material; it tests the operating case in which a long-document workflow assumes the largest supported context window guarantees correct recall.

Incorrect Answers

B:

Tiered inference avoids paying the highest reasoning cost for requests that an efficient model handles safely; the approach helps when an assistant faces inexpensive simple questions alongside rare complex investigations, but the present constraint is that a contract summarizer passes tests on short passages yet misattributes facts deep inside long submissions.

C:

Hard multi-constraint reasoning may justify greater latency and price when smaller models fail reliable acceptance tests; that belongs to situations where an architecture review asks Claude to reconcile many conflicting technical constraints, whereas the current issue is that a contract summarizer passes tests on short passages yet misattributes facts deep inside long submissions.

D:

Public benchmarks do not substitute for task-specific correctness, token usage and latency measurement; it is relevant if a team wants to choose its model only from published benchmark rankings, whereas the release criterion addresses a contract summarizer passes tests on short passages yet misattributes facts deep inside long submissions.

Question 97

A multilingual beta reports strong English scores and no judged results for a low-resource service dialect. What validation evidence would address this failure mode?

  1. The scenario test demonstrates that routing tests show simple-task savings without missed escalations on difficult cases.
  2. The end-to-end check confirms that per-dialect error rates and expert judgments stay within documented release limits.
  3. The observed outcome is that expert blind ratings on conflicted design cases show the chosen tier meets the target.
  4. The regression suite verifies that holdout comparisons report quality, tail latency and price under the real prompt structure.
  5. A production-like test shows that a representative benchmark proves classification quality at required throughput and cost.

Explanation

Correct Answer

B:

English-only accuracy can hide critical gaps in the actual served user population; the test covers the original risk that a multilingual customer assistant must meet a quality target for underrepresented dialects.

Incorrect Answers

A:

Tiered inference avoids paying the highest reasoning cost for requests that an efficient model handles safely; the design helps when an assistant faces inexpensive simple questions alongside rare complex investigations, whereas this scenario involves a multilingual beta reports strong English scores and no judged results for a low-resource service dialect.

C:

Hard multi-constraint reasoning may justify greater latency and price when smaller models fail reliable acceptance tests; this control is needed when an architecture review asks Claude to reconcile many conflicting technical constraints, instead of when a multilingual beta reports strong English scores and no judged results for a low-resource service dialect.

D:

Public benchmarks do not substitute for task-specific correctness, token usage and latency measurement; that would be useful if a team wants to choose its model only from published benchmark rankings, not the case in which a multilingual beta reports strong English scores and no judged results for a low-resource service dialect.

E:

Smaller capable models can minimize unit cost if measured quality meets the task threshold; it serves a setting where a low-risk classification queue needs massive throughput and has simple prompts, whereas the problem presented is that a multilingual beta reports strong English scores and no judged results for a low-resource service dialect.

Question 98

A replacement model changes required report phrasing even though API responses remain syntactically valid. What end-to-end observation would best settle the concern?

  1. A controlled trial finds that shadow comparisons detect any schema, citation or safety regression before broad cutover.
  2. The measured evidence confirms that adversarial long-document cases retain correct citation grounding as document length grows.
  3. The scenario test demonstrates that per-dialect error rates and expert judgments stay within documented release limits.
  4. The end-to-end check confirms that expert blind ratings on conflicted design cases show the chosen tier meets the target.

Explanation

Correct Answer

A:

A model change is a behavioral release that can invalidate prior prompts and safety assumptions; a valid sign-off must address the risk that a team proposes a model upgrade that changes output behavior across regulated reports.

Incorrect Answers

B:

Nominal context capacity is different from reliable use of relevant facts buried in lengthy material; its scope includes cases where a long-document workflow assumes the largest supported context window guarantees correct recall, not the present case where a replacement model changes required report phrasing even though API responses remain syntactically valid.

C:

English-only accuracy can hide critical gaps in the actual served user population; it targets cases where a multilingual customer assistant must meet a quality target for underrepresented dialects, while this problem involves a replacement model changes required report phrasing even though API responses remain syntactically valid.

D:

Hard multi-constraint reasoning may justify greater latency and price when smaller models fail reliable acceptance tests; the approach helps when an architecture review asks Claude to reconcile many conflicting technical constraints, and not where a replacement model changes required report phrasing even though API responses remain syntactically valid.

Question 99

A billing assistant gives different refund criteria depending on the user's writing style. What is the most appropriate initial architecture decision?

  1. In the project scope, put prompt versions through review, evaluation and controlled release.
  2. Within the rollout design, require source-attributed claims and explicit uncertainty when evidence is missing.
  3. For the next architecture revision, separate stable policy instructions from user content and supply a version-controlled system template.
  4. For the current integration, treat the review as untrusted data and enforce higher-priority task boundaries.

Explanation

Correct Answer

C:

Instruction hierarchy and fixed templates keep governing business rules consistent across requests; one measurable outcome is that paraphrased customer requests produce the same refund-policy decision.

Incorrect Answers

A:

Prompt text is application logic whose untracked changes can cause regression and unsafe behavior; this technique fits where a team edits production prompts directly and cannot explain changed answers, but the present constraint is that a billing assistant gives different refund criteria depending on the user's writing style.

B:

Clear evidence instructions help distinguish supported facts from interpretation in the final response; the trigger would be that a model must cite provided materials yet sometimes blends source statements with inference, whereas the current issue is that a billing assistant gives different refund criteria depending on the user's writing style.

D:

The embedded instruction has no authority to override the system's allowed summarization task; that fits cases where a user inserts 'ignore all rules' into a quoted customer review, while the required safeguard concerns a billing assistant gives different refund criteria depending on the user's writing style.

Question 100

A user inserts 'ignore all rules' into a quoted customer review. Which architecture change should be approved first?

  1. For this workflow, parameterize tenant context and keep global rules separate from per-request variables.
  2. For the affected service, define a narrow output contract and validate structured responses before consumption.
  3. In the project scope, treat the review as untrusted data and enforce higher-priority task boundaries.
  4. Within the rollout design, state explicit scope and refusal/escalation conditions for unauthorized commitments.

Explanation

Correct Answer

C:

The embedded instruction has no authority to override the system's allowed summarization task; one operational check should confirm that attack prompts embedded in reviews do not change tool permissions or task objective.

Incorrect Answers

A:

Modularity reduces cross-tenant leakage and makes policy changes easier to audit; this applies when a reusable prompt contains extensive tenant-specific details hard-coded into global instructions, but here a user inserts 'ignore all rules' into a quoted customer review.

B:

Schema enforcement at the application boundary catches malformed fields instead of trusting prompt wording; the alternative helps if a report generator repeatedly produces prose where downstream systems require JSON, instead of when a user inserts 'ignore all rules' into a quoted customer review.

D:

Behavioral boundaries should make the assistant defer approval rather than invent authority; its scope includes cases where a support bot makes undocumented promises about customer reimbursements, whereas the problem presented is that a user inserts 'ignore all rules' into a quoted customer review.

Claude Certified Architect - Professional (CCAR-P) Practice Tests