GPT-5.6 Sol (medium)

gpt-5-6-sol-medium · 7 samples · combined / raw

Scoring

Choose the quality benchmark and final score formula for this model.

Cost adjustment

Tune formulas that account for Cost per Task.

Score over time

57.557.858.158.458.718:0019:3021:0022:3000:00 Run #817 · Score · X: 2026-07-09 18:00:49 · Y: 58.1Run #818 · Score · X: 2026-07-09 19:00:45 · Y: 58.1Run #819 · Score · X: 2026-07-09 20:00:44 · Y: 58.1Run #820 · Score · X: 2026-07-09 21:00:43 · Y: 58.1Run #821 · Score · X: 2026-07-09 22:00:42 · Y: 58.1Run #822 · Score · X: 2026-07-09 23:00:41 · Y: 58.1Run #823 · Score · X: 2026-07-10 00:00:42 · Y: 58.1

Cost per task over time

$0.304$0.309$0.314$0.319$0.32418:0019:3021:0022:3000:00 Run #817 · Cost per task · X: 2026-07-09 18:00:49 · Y: $0.314Run #818 · Cost per task · X: 2026-07-09 19:00:45 · Y: $0.314Run #819 · Cost per task · X: 2026-07-09 20:00:44 · Y: $0.314Run #820 · Cost per task · X: 2026-07-09 21:00:43 · Y: $0.314Run #821 · Cost per task · X: 2026-07-09 22:00:42 · Y: $0.314Run #822 · Cost per task · X: 2026-07-09 23:00:41 · Y: $0.314Run #823 · Cost per task · X: 2026-07-10 00:00:42 · Y: $0.314

Time per task over time

No chart data.

Run?Fetched?Score?Quality?Cost/task?Time/task?Intel?Code?Agent?MMMU%?
#823 2026-07-10 00:00:42 58.1 58.1 $0.314 - 53.6 76.3 44.5 81.4
#822 2026-07-09 23:00:41 58.1 58.1 $0.314 - 53.6 76.3 44.5 81.4
#821 2026-07-09 22:00:42 58.1 58.1 $0.314 - 53.6 76.3 44.5 81.4
#820 2026-07-09 21:00:43 58.1 58.1 $0.314 - 53.6 76.3 44.5 81.4
#819 2026-07-09 20:00:44 58.1 58.1 $0.314 - 53.6 76.3 44.5 81.4
#818 2026-07-09 19:00:45 58.1 58.1 $0.314 - 53.6 76.3 44.5 81.4
#817 2026-07-09 18:00:49 58.1 58.1 $0.314 - 53.6 76.3 44.5 81.4