Benchmarks · no Elo

VideoBench

Two categories: a product launch video made from scratch, and editing existing footage.

scoring: side by side, cost, time · video-bench/

Product launch video

From a project to a finished MP4: song, lyrics, hand-painted animation. · the agent ↗

TODO for AI · “My TODO list is a rocket car”Claude Opus 5.5 · 96 s

Video editing

Cutting and editing existing footage: trims, pacing, captions, sound.

No runs yet.
Each model runs in its own sandbox through the TODO for AI agent — identical prompt, no view of the others. We publish the raw outputs, what they cost and how long they took. No Elo, nothing fitted to a curve. Upvotes are a separate reader signal and never change the order. Reproducible from the benchmarks repo.