Test fixture
Latency-sensitive tasks where concise correct output matters.
The model receives the prompt (and optional system message). The run uses scorer contains_all with the JSON configuration below. Pass/fail and partial credit are determined entirely by that scorer against the model output; no human grading.
Summarize in exactly 4 short bullet points: A platform team improved release safety by introducing postmortems, queue backpressure, and error budget policy across critical services. They documented ownership, ran weekly reliability reviews, and tracked p95 latency to verify impact over time.
{
"expected_contains": [
"postmortems",
"queue backpressure",
"error budget policy",
"p95 latency"
]
}temperature
0
max_tokens
140
timeout (s)
120
type
scored
file
speed_hard_12.json