Summary

The model receives the prompt (and optional system message). The run uses scorer contains_all with the JSON configuration below. Pass/fail and partial credit are determined entirely by that scorer against the model output; no human grading.

Summarize in exactly 3 short bullet points: QA effectiveness improved with risk-based test plans, flaky-test quarantine, and nightly end-to-end runs. Defect escape rate became a release gate metric.

{
  "expected_contains": [
    "risk-based",
    "flaky",
    "end-to-end"
  ]
}