GPT-5.6 Sol (Non-reasoning)

gpt-5-6-sol-non-reasoning · 7 samples · combined / raw

Scoring

Choose the quality benchmark and final score formula for this model.

Cost adjustment

Tune formulas that account for Cost per Task.

Score over time

46.646.947.147.347.618:0019:3021:0022:3000:00 Run #817 · Score · X: 2026-07-09 18:00:49 · Y: 47.1Run #818 · Score · X: 2026-07-09 19:00:45 · Y: 47.1Run #819 · Score · X: 2026-07-09 20:00:44 · Y: 47.1Run #820 · Score · X: 2026-07-09 21:00:43 · Y: 47.1Run #821 · Score · X: 2026-07-09 22:00:42 · Y: 47.1Run #822 · Score · X: 2026-07-09 23:00:41 · Y: 47.1Run #823 · Score · X: 2026-07-10 00:00:42 · Y: 47.1

Cost per task over time

$0.190$0.195$0.200$0.205$0.21018:0019:3021:0022:3000:00 Run #817 · Cost per task · X: 2026-07-09 18:00:49 · Y: $0.200Run #818 · Cost per task · X: 2026-07-09 19:00:45 · Y: $0.200Run #819 · Cost per task · X: 2026-07-09 20:00:44 · Y: $0.200Run #820 · Cost per task · X: 2026-07-09 21:00:43 · Y: $0.200Run #821 · Cost per task · X: 2026-07-09 22:00:42 · Y: $0.200Run #822 · Cost per task · X: 2026-07-09 23:00:41 · Y: $0.200Run #823 · Cost per task · X: 2026-07-10 00:00:42 · Y: $0.200

Time per task over time

No chart data.

Run?Fetched?Score?Quality?Cost/task?Time/task?Intel?Code?Agent?MMMU%?
#823 2026-07-10 00:00:42 47.1 47.1 $0.200 - 41.2 65.1 34.9 71.9
#822 2026-07-09 23:00:41 47.1 47.1 $0.200 - 41.2 65.1 34.9 71.9
#821 2026-07-09 22:00:42 47.1 47.1 $0.200 - 41.2 65.1 34.9 71.9
#820 2026-07-09 21:00:43 47.1 47.1 $0.200 - 41.2 65.1 34.9 71.9
#819 2026-07-09 20:00:44 47.1 47.1 $0.200 - 41.2 65.1 34.9 71.9
#818 2026-07-09 19:00:45 47.1 47.1 $0.200 - 41.2 65.1 34.9 71.9
#817 2026-07-09 18:00:49 47.1 47.1 $0.200 - 41.2 65.1 34.9 71.9