You are designing a human-in-the-loop validation workflow for a new Claude-based deployment and must complete the design steps before piloting the workflow.
Which two steps must be completed BEFORE piloting the workflow with a representative subset of traffic?
(Select two.)
Each correct answer presents part of the solution.

• A. Onboard the reviewer pool with role-specific training on the check criteria and escalation procedures.
• B. Define the sampling strategy and the escalation criteria at each oversight point in the pipeline.
• C. Iterate the workflow design based on observed pilot findings before broader rollout to production.
• D. Identify the decision points in the pipeline that require human oversight by impact and reversibility.
• E. Document the workflow with check criteria, escalation paths, and service-level agreements (SLAs) for each step.

You are defining an SLA for a Claude-based assistant.
Which SLA definition is most operationally meaningful?

• A. A qualitative commitment such as "the system will be fast and reliable," which names no metric, threshold, or evaluation window.
• B. A target tied to a stakeholder sentiment measure such as "the team feels satisfied," which cannot be measured objectively or used to trigger a documented breach response.
• C. A target that names the metric and threshold but omits the evaluation window and breach consequence, leaving compliance periods and remediation triggers undefined.
• D. A measurable target with a defined metric, threshold, evaluation window, and consequence for breach- for example, "p95 per-request latency under 800 ms over a 28-day window."

You are running a controlled experiment to compare two prompts and must complete the design steps before executing the experiment.
Which two steps must be completed BEFORE running the experiment with random assignment? (Select two.) Each correct answer presents part of the solution.

• A. Determine the minimum detectable effect size and the sample size needed for power.
• B. Analyze the results against the predefined success metric and significance threshold.
• C. Document the recommendation, the trade-offs accepted, and the alternatives considered.
• D. Decide whether to promote, reject, or iterate the candidate based on the analysis.
• E. Define the hypothesis and the primary success metric for the comparison.

A revenue projection assistant has missed its monthly cost target by 38 percent. Profiling shows three contributors: a 6,000-token policy preamble repeated on every call (45 percent of cost), retrieval of historical sales chunks averaging 3,000 tokens per call (30 percent), and inference on a flagship-tier model (25 percent).
Stakeholders require that projection accuracy remain unchanged.
Which two optimizations should you sequence first to reduce cost without affecting accuracy? (Select two.) Each correct answer presents part of the solution.

• A. Cache common retrieved sales chunks accessed across many of the daily queries.
• B. Enable prompt caching on the static policy preamble across the recurring calls.
• C. Reduce the number of historical sales chunks retrieved across each query run.
• D. Truncate the policy preamble to remove non-essential clauses from the prompt.
• E. Switch the workload to a smaller, faster Claude model tier across all queries.