Test fixture
Latency-sensitive tasks where concise correct output matters.
The model receives the prompt (and optional system message). The run uses scorer contains_all with the JSON configuration below. Pass/fail and partial credit are determined entirely by that scorer against the model output; no human grading.
Summarize in exactly 3 short bullet points: A data platform team improved analytics reliability by adding schema validation at ingestion, quarantining malformed records, and alerting owners when quality thresholds were breached. They introduced data contracts between producers and consumers and documented ownership for every critical dataset.
{
"expected_contains": [
"schema validation",
"quarantining",
"data contracts"
]
}temperature
0
max_tokens
110
timeout (s)
120
type
scored
file
speed_medium_02.json