Cost and quote a task set per audited, accepted task, because review adds hours on top of authoring and most submitted tasks do not survive it
Terminal-Bench 2.0 (arXiv 2601.11868, January 2026) crowd-sourced 229 tasks from 93 contributors and kept 89 after difficulty and quality review (about 39 percent, so each kept task stood for 2.6 submitted ones). Its audit gave the average kept task 'approximately three hours of combined reviewer attention', which it puts at 'multiple hundreds of person-hours' for review alone, 'excluding the time spent creating the tasks'.
Dated Jan 2026Source checked 29 Oct 2026Basis: indicative
In the source's own words
“the average task received approximately three hours of combined reviewer attention, implying multiple hundreds of person-hours went into reviewing alone, excluding the time spent creating the tasks”
Figures it counts in
It is shown on its own, not counted into a figure.