GPT-5.6 Sol (low)

gpt-5-6-sol-low · 7 samples · combined / raw

Scoring

Choose the quality benchmark and final score formula for this model.

Cost adjustment

Tune formulas that account for Cost per Task.

Score over time

52.552.753.053.353.518:0019:3021:0022:3000:00 Run #817 · Score · X: 2026-07-09 18:00:49 · Y: 53.0Run #818 · Score · X: 2026-07-09 19:00:45 · Y: 53.0Run #819 · Score · X: 2026-07-09 20:00:44 · Y: 53.0Run #820 · Score · X: 2026-07-09 21:00:43 · Y: 53.0Run #821 · Score · X: 2026-07-09 22:00:42 · Y: 53.0Run #822 · Score · X: 2026-07-09 23:00:41 · Y: 53.0Run #823 · Score · X: 2026-07-10 00:00:42 · Y: 53.0

Cost per task over time

$0.187$0.192$0.197$0.202$0.20718:0019:3021:0022:3000:00 Run #817 · Cost per task · X: 2026-07-09 18:00:49 · Y: $0.197Run #818 · Cost per task · X: 2026-07-09 19:00:45 · Y: $0.197Run #819 · Cost per task · X: 2026-07-09 20:00:44 · Y: $0.197Run #820 · Cost per task · X: 2026-07-09 21:00:43 · Y: $0.197Run #821 · Cost per task · X: 2026-07-09 22:00:42 · Y: $0.197Run #822 · Cost per task · X: 2026-07-09 23:00:41 · Y: $0.197Run #823 · Cost per task · X: 2026-07-10 00:00:42 · Y: $0.197

Time per task over time

No chart data.

Run?Fetched?Score?Quality?Cost/task?Time/task?Intel?Code?Agent?MMMU%?
#823 2026-07-10 00:00:42 53.0 53.0 $0.197 - 49.4 69.7 40.0 81.0
#822 2026-07-09 23:00:41 53.0 53.0 $0.197 - 49.4 69.7 40.0 81.0
#821 2026-07-09 22:00:42 53.0 53.0 $0.197 - 49.4 69.7 40.0 81.0
#820 2026-07-09 21:00:43 53.0 53.0 $0.197 - 49.4 69.7 40.0 81.0
#819 2026-07-09 20:00:44 53.0 53.0 $0.197 - 49.4 69.7 40.0 81.0
#818 2026-07-09 19:00:45 53.0 53.0 $0.197 - 49.4 69.7 40.0 81.0
#817 2026-07-09 18:00:49 53.0 53.0 $0.197 - 49.4 69.7 40.0 81.0