Llama 3.2 Instruct 11B (Vision)

llama-3-2-instruct-11b-vision · 33 samples · combined / raw

Scoring

Choose the quality benchmark and final score formula for this model.

Cost adjustment

Tune formulas that account for benchmark cost.

Score over time

5.85.96.06.16.205-11 23:1705-12 09:4305-12 20:0905-13 06:3505-13 17:00 Run #1 · Score · X: 2026-05-11 23:17:33 · Y: 6.0Run #2 · Score · X: 2026-05-12 00:00:09 · Y: 6.0Run #3 · Score · X: 2026-05-12 01:00:09 · Y: 6.0Run #4 · Score · X: 2026-05-12 02:00:11 · Y: 6.0Run #5 · Score · X: 2026-05-12 03:00:11 · Y: 6.0Run #7 · Score · X: 2026-05-12 05:00:17 · Y: 6.0Run #8 · Score · X: 2026-05-12 06:00:21 · Y: 6.0Run #9 · Score · X: 2026-05-12 07:00:22 · Y: 6.0Run #11 · Score · X: 2026-05-12 09:00:15 · Y: 6.0Run #12 · Score · X: 2026-05-12 10:00:12 · Y: 6.0Run #15 · Score · X: 2026-05-12 13:00:16 · Y: 6.0Run #16 · Score · X: 2026-05-12 14:00:12 · Y: 6.0Run #18 · Score · X: 2026-05-12 16:00:32 · Y: 6.0Run #19 · Score · X: 2026-05-12 17:00:36 · Y: 6.0Run #20 · Score · X: 2026-05-12 18:00:35 · Y: 6.0Run #21 · Score · X: 2026-05-12 19:00:24 · Y: 6.0Run #22 · Score · X: 2026-05-12 20:00:23 · Y: 6.0Run #23 · Score · X: 2026-05-12 21:00:26 · Y: 6.0Run #24 · Score · X: 2026-05-12 22:00:27 · Y: 6.0Run #25 · Score · X: 2026-05-12 23:00:22 · Y: 6.0Run #26 · Score · X: 2026-05-13 00:00:26 · Y: 6.0Run #27 · Score · X: 2026-05-13 01:00:29 · Y: 6.0Run #28 · Score · X: 2026-05-13 02:00:24 · Y: 6.0Run #29 · Score · X: 2026-05-13 03:00:35 · Y: 6.0Run #30 · Score · X: 2026-05-13 04:00:30 · Y: 6.0Run #31 · Score · X: 2026-05-13 05:00:25 · Y: 6.0Run #32 · Score · X: 2026-05-13 06:00:23 · Y: 6.0Run #33 · Score · X: 2026-05-13 07:00:20 · Y: 6.0Run #34 · Score · X: 2026-05-13 08:00:49 · Y: 6.0Run #35 · Score · X: 2026-05-13 09:00:49 · Y: 6.0Run #41 · Score · X: 2026-05-13 15:00:49 · Y: 6.0Run #42 · Score · X: 2026-05-13 16:00:49 · Y: 6.0Run #43 · Score · X: 2026-05-13 17:00:49 · Y: 6.0

Cost over time

$19.2$19.3$19.4$19.5$19.605-11 23:1705-12 09:4305-12 20:0905-13 06:3505-13 17:00 Run #1 · Cost · X: 2026-05-11 23:17:33 · Y: $19.4Run #2 · Cost · X: 2026-05-12 00:00:09 · Y: $19.4Run #3 · Cost · X: 2026-05-12 01:00:09 · Y: $19.4Run #4 · Cost · X: 2026-05-12 02:00:11 · Y: $19.4Run #5 · Cost · X: 2026-05-12 03:00:11 · Y: $19.4Run #7 · Cost · X: 2026-05-12 05:00:17 · Y: $19.4Run #8 · Cost · X: 2026-05-12 06:00:21 · Y: $19.4Run #9 · Cost · X: 2026-05-12 07:00:22 · Y: $19.4Run #11 · Cost · X: 2026-05-12 09:00:15 · Y: $19.4Run #12 · Cost · X: 2026-05-12 10:00:12 · Y: $19.4Run #15 · Cost · X: 2026-05-12 13:00:16 · Y: $19.4Run #16 · Cost · X: 2026-05-12 14:00:12 · Y: $19.4Run #18 · Cost · X: 2026-05-12 16:00:32 · Y: $19.4Run #19 · Cost · X: 2026-05-12 17:00:36 · Y: $19.4Run #20 · Cost · X: 2026-05-12 18:00:35 · Y: $19.4Run #21 · Cost · X: 2026-05-12 19:00:24 · Y: $19.4Run #22 · Cost · X: 2026-05-12 20:00:23 · Y: $19.4Run #23 · Cost · X: 2026-05-12 21:00:26 · Y: $19.4Run #24 · Cost · X: 2026-05-12 22:00:27 · Y: $19.4Run #25 · Cost · X: 2026-05-12 23:00:22 · Y: $19.4Run #26 · Cost · X: 2026-05-13 00:00:26 · Y: $19.4Run #27 · Cost · X: 2026-05-13 01:00:29 · Y: $19.4Run #28 · Cost · X: 2026-05-13 02:00:24 · Y: $19.4Run #29 · Cost · X: 2026-05-13 03:00:35 · Y: $19.4Run #30 · Cost · X: 2026-05-13 04:00:30 · Y: $19.4Run #31 · Cost · X: 2026-05-13 05:00:25 · Y: $19.4Run #32 · Cost · X: 2026-05-13 06:00:23 · Y: $19.4Run #33 · Cost · X: 2026-05-13 07:00:20 · Y: $19.4Run #34 · Cost · X: 2026-05-13 08:00:49 · Y: $19.4Run #35 · Cost · X: 2026-05-13 09:00:49 · Y: $19.4Run #41 · Cost · X: 2026-05-13 15:00:49 · Y: $19.4Run #42 · Cost · X: 2026-05-13 16:00:49 · Y: $19.4Run #43 · Cost · X: 2026-05-13 17:00:49 · Y: $19.4
Run?Fetched?Score?Quality?Cost?Intel?Code?Agent?MMMU%?
#43 2026-05-13 17:00:49 6.0 6.0 $19.4 8.7 4.3 4.9 29.3
#42 2026-05-13 16:00:49 6.0 6.0 $19.4 8.7 4.3 4.9 29.3
#41 2026-05-13 15:00:49 6.0 6.0 $19.4 8.7 4.3 4.9 29.3
#35 2026-05-13 09:00:49 6.0 6.0 $19.4 8.7 4.3 4.9 29.3
#34 2026-05-13 08:00:49 6.0 6.0 $19.4 8.7 4.3 4.9 29.3
#33 2026-05-13 07:00:20 6.0 6.0 $19.4 8.7 4.3 4.9 29.3
#32 2026-05-13 06:00:23 6.0 6.0 $19.4 8.7 4.3 4.9 29.3
#31 2026-05-13 05:00:25 6.0 6.0 $19.4 8.7 4.3 4.9 29.3
#30 2026-05-13 04:00:30 6.0 6.0 $19.4 8.7 4.3 4.9 29.3
#29 2026-05-13 03:00:35 6.0 6.0 $19.4 8.7 4.3 4.9 29.3
#28 2026-05-13 02:00:24 6.0 6.0 $19.4 8.7 4.3 4.9 29.3
#27 2026-05-13 01:00:29 6.0 6.0 $19.4 8.7 4.3 4.9 29.3
#26 2026-05-13 00:00:26 6.0 6.0 $19.4 8.7 4.3 4.9 29.3
#25 2026-05-12 23:00:22 6.0 6.0 $19.4 8.7 4.3 4.9 29.3
#24 2026-05-12 22:00:27 6.0 6.0 $19.4 8.7 4.3 4.9 29.3
#23 2026-05-12 21:00:26 6.0 6.0 $19.4 8.7 4.3 4.9 29.3
#22 2026-05-12 20:00:23 6.0 6.0 $19.4 8.7 4.3 4.9 29.3
#21 2026-05-12 19:00:24 6.0 6.0 $19.4 8.7 4.3 4.9 29.3
#20 2026-05-12 18:00:35 6.0 6.0 $19.4 8.7 4.3 4.9 29.3
#19 2026-05-12 17:00:36 6.0 6.0 $19.4 8.7 4.3 4.9 29.3
#18 2026-05-12 16:00:32 6.0 6.0 $19.4 8.7 4.3 4.9 29.3
#16 2026-05-12 14:00:12 6.0 6.0 $19.4 8.7 4.3 4.9 29.3
#15 2026-05-12 13:00:16 6.0 6.0 $19.4 8.7 4.3 4.9 29.3
#12 2026-05-12 10:00:12 6.0 6.0 $19.4 8.7 4.3 4.9 29.3
#11 2026-05-12 09:00:15 6.0 6.0 $19.4 8.7 4.3 4.9 29.3
#9 2026-05-12 07:00:22 6.0 6.0 $19.4 8.7 4.3 4.9 29.3
#8 2026-05-12 06:00:21 6.0 6.0 $19.4 8.7 4.3 4.9 29.3
#7 2026-05-12 05:00:17 6.0 6.0 $19.4 8.7 4.3 4.9 29.3
#5 2026-05-12 03:00:11 6.0 6.0 $19.4 8.7 4.3 4.9 29.3
#4 2026-05-12 02:00:11 6.0 6.0 $19.4 8.7 4.3 4.9 29.3
#3 2026-05-12 01:00:09 6.0 6.0 $19.4 8.7 4.3 4.9 29.3
#2 2026-05-12 00:00:09 6.0 6.0 $19.4 8.7 4.3 4.9 29.3
#1 2026-05-11 23:17:33 6.0 6.0 $19.4 8.7 4.3 4.9 29.3