Test fixture
Latency-sensitive tasks where concise correct output matters.
The model receives the prompt (and optional system message). The run uses scorer contains_any with the JSON configuration below. Pass/fail and partial credit are determined entirely by that scorer against the model output; no human grading.
Summarize the following text in exactly 3 bullet points. Keep it concise and preserve the main ideas only. Artificial intelligence systems are increasingly used in software development, customer support, education, and scientific research. They can accelerate repetitive tasks, assist with drafting content, and help users explore ideas faster than traditional workflows. However, they also introduce risks such as hallucinated facts, overconfidence, privacy concerns, and dependency on low-quality outputs if not properly validated. In professional environments, the most effective use of AI usually comes from combining model output with strong human review, good evaluation pipelines, and clear operational constraints.
{
"expected_contains": [
"software development",
"customer support",
"education",
"scientific research",
"hallucinated",
"privacy",
"human review",
"evaluation pipelines"
]
}temperature
0
max_tokens
120
timeout (s)
120
type
scored
file
summary_short.json