Headless Mode
Running benchmarks in automated environments.
Headless mode allows BLXBench to run in CI/CD pipelines, scripts, and automated workflows. Install the blxbench command via @bitslix/blxbench (see Installation) before running the examples below.
Basic Usage
blxbench --headless --provider opr --models openai/gpt-5.4-miniOmit --headless if the process already has no TTY (typical in CI); blxbench then enters the same headless path automatically.
Integration with CI/CD
GitHub Actions
name: Benchmark
on: [push, pull_request]
jobs:
benchmark:
runs-on: ubuntu-latest
steps:
- uses: actions/checkout@v4
- uses: oven-sh/setup-bun@v1
- name: Run benchmark
run: |
bun install -g @bitslix/blxbench
blxbench --headless --provider opr --models openai/gpt-5.4-mini
- name: Upload results
uses: actions/upload-artifact@v4
with:
name: blxbench-results
path: results/GitLab CI
stages:
- benchmark
benchmark:
image: oven/bun:1
script:
- bun install -g @bitslix/blxbench
- blxbench --headless --provider opr --models openai/gpt-5.4-mini
artifacts:
paths:
- results/Exit Codes
| Code | Description |
|---|---|
| 0 | Success |
| 1 | General error |
| 2 | Invalid arguments |
| 3 | Test failure (with --fail-fast) |
Rate Limiting
Use --ratelimit to avoid hitting provider rate limits:
# Default (60 RPM)
blxbench --headless --provider opr --models openai/gpt-5.4-mini --ratelimit
# Custom (30 requests per minute)
blxbench --headless --provider opr --models openai/gpt-5.4-mini --ratelimit 30Output Handling
Save JSON Results
blxbench --headless --provider opr --models openai/gpt-5.4-mini --save-json ./my-results.jsonCapture Output
# Suppress progress output
blxbench --headless --provider opr --models openai/gpt-5.4-mini 2>/dev/null
# Log to file
blxbench --headless --provider opr --models openai/gpt-5.4-mini >> benchmark.log 2>&1Automated Submission
Set environment variables for automatic submission:
export BLXBENCH_API_KEY=your-key
export BLXBENCH_SUBMIT=1
blxbench --headless --provider opr --models openai/gpt-5.4-miniOr use the flag:
blxbench --headless --provider opr --models openai/gpt-5.4-mini --submit --api-key your-keyNon-Interactive Detection
BLXBench automatically detects non-TTY environments and skips the TUI. To force the same behavior in a terminal:
blxbench --headless --provider opr --models openai/gpt-5.4-mini