PoC-to-Production
Sprint 2 turns a validated opportunity into a production-shaped system - measured, safe, and observable - with the evidence a reviewer needs to ship it.
The production-shaped system
Section titled “The production-shaped system” Eval harness & judge calibration Deterministic and judge-backed scorers, and the human-vs-judge calibration gate that blocks launch on safety.
Guardrails The scope classifier, refusal templates, and the deterministic escalation floor.
Model card The measured quality and safety results, in CHAI Applied Model Card format.
Operations runbook The operator handoff: shipping, watching, production-readiness definition of done, incident posture.
Costed blueprint Demo-to-production across five layers, with a timeline band and cost at volume.
Deploy The keyless, CI-gated, secret-preserving deployment architecture.
Engagement artifacts
Section titled “Engagement artifacts”Some artifacts are tuned to your deployment and provided as part of the engagement, not published here - because their value is in the calibration, not the concept. The public docs describe the shape; the tuned values ship with the work:
- Calibration sheet - the tuned human-vs-judge agreement operating point and labelling protocol for your data.
- Retrieval-constants sheet - the tuned chunking and retrieval parameters for your corpus.
- PII-masking specification - the redaction rules matched to your data’s identifiers.
- Judge rubric & tolerance sheet - the per-dimension rubric anchors and gate tolerances calibrated for your domain.
Each is calibrated per deployment and delivered as part of a calibration engagement.
Previous: Discovery.