Software-engineering task instance created by having a model rewrite a function to introduce a bug in a repository, then validated by the repository's tests (SWE-smith, pallets/flask: 402 candidates, 267 qualified)
$0.00613 per instance per task instance, API cost
Dated 30 Apr 2025Source checked 19 Oct 2026Its page was there at the last check, 28 Oct 2026; it is, or links to, a document whose words the automatic check could not matchBasis: stated
Hold datasets and training environments yourself? AIData.Broker values yours free against every public price and deal like this one, and describes it to every buyer that fits at the same time, without your name, for a fee only out of a sale.
- No data upload
- About two minutes
- No email needed
In the source's own words
“The subsequent function-level rewriting strategy for bugs took 23 minutes to run, incurring a total cost of just $2.47 (∼$0.00613 per instance).”
Where it was read
What it is about
Figures it counts in
- $37 per taskDatasets, tasks and environments, cost to produce, per task