TerminalBench
The difference between harnesses: same model, same 89 Terminal-Bench 2.1 tasks, one sweep each through the official Harbor adapter. Only the harness changes.
scoring: pass rate · terminal-bench/
Cost = tokens × Anthropic list price (Opus 5.5: $5 / $25 per M in/out, $0.5 cache read, $6.25 cache write); ≈ marks totals from the harness's own token report, which misses 2–3 tasks that never produced a trajectory and, for Codex, cache writes. Codex has no refusal fallback (Claude Code and TODO for AI retry on Opus 4.8 when Opus 5.5 refuses on safety grounds), so its 4 refused tasks were rerun on Opus 4.8 by hand and that result counted (3 pass; 72/89 on pure 5.5). The 4.8 rerun is in its cost. GPT Sol rows: OpenAI list price ($2 / $10 per M, $0.10 cache read), no refusal fallback; the 81/89 and 82/89 Sol rows are best-of-attempts composites (the 13 tasks GPT-6.1 Sol high failed got 1–4 extra tries at high/xhigh, 6.2 was not re-run on the 76 that 6.1 already passed), not a clean single sweep. Harness check on the 40 hardest tasks, GPT-6.2 Sol xhigh: TODO for AI 27/40 ($12.72) vs Codex CLI 26/38 ($12.10; it could not install itself on 2 old-Debian tasks), a tie on the 38 both ran. Not a tbench.ai leaderboard submission and not scored by its rules. Methodology.