BLXBenchBLXBench UI
blxbench

Benchmark

Levels

Misc

DocsDownload blxbenchOur TestsPassSponsor / Partnership
DocsDownload blxbenchOur TestsPassSponsor / Partnership
BLXBenchBLXBench UI
blxbench

Benchmark

Levels

Misc

DocsDownload blxbenchOur TestsPassSponsor / Partnership
DocsDownload blxbenchOur TestsPassSponsor / Partnership
  1. Home
  2. Our Tests
  3. Summary Engineering Enablement
blxbench

Test fixture

Summary Engineering Enablement

Speedmediumscorer: contains_all

Latency-sensitive tasks where concise correct output matters.

How it is scored

The model receives the prompt (and optional system message). The run uses scorer contains_all with the JSON configuration below. Pass/fail and partial credit are determined entirely by that scorer against the model output; no human grading.

User prompt
Summarize in exactly 3 short bullet points:
Developer velocity increased after standardizing project templates, automating local environment setup, and enforcing CI checks for formatting, tests, and dependency vulnerabilities. The platform team also published runbooks and office hours to reduce onboarding friction.
Scorer config
{
  "expected_contains": [
    "project templates",
    "CI checks",
    "runbooks"
  ]
}
Run parameters

temperature

0

max_tokens

110

timeout (s)

120

type

scored

file

speed_medium_05.json

← PreviousSummary Customer Support
|
Next →Summary

BLXBench

Community driven leaderboardPublic benchmark runner — run in your environment, share results with the community.

© 2026 BLXBench by bitslix.com

ProvenanceAggregated from user runs
Scope6 / 7 / 372
Latestrun_be5c42 / 7 / $0.0019
TermsPrivacy