Gemma 4 E4B (Non-reasoning)

gemma-4-e4b-non-reasoning · 53 samples · combined / raw

Scoring

Choose the quality benchmark and final score formula for this model.

Cost adjustment

Tune formulas that account for benchmark cost.

Score over time

9.89.910.010.110.205-11 23:1705-12 17:2805-13 11:3905-14 05:4905-15 00:00 Run #1 · Score · X: 2026-05-11 23:17:33 · Y: 10.0Run #2 · Score · X: 2026-05-12 00:00:09 · Y: 10.0Run #3 · Score · X: 2026-05-12 01:00:09 · Y: 10.0Run #4 · Score · X: 2026-05-12 02:00:11 · Y: 10.0Run #5 · Score · X: 2026-05-12 03:00:11 · Y: 10.0Run #7 · Score · X: 2026-05-12 05:00:17 · Y: 10.0Run #8 · Score · X: 2026-05-12 06:00:21 · Y: 10.0Run #9 · Score · X: 2026-05-12 07:00:22 · Y: 10.0Run #11 · Score · X: 2026-05-12 09:00:15 · Y: 10.0Run #12 · Score · X: 2026-05-12 10:00:12 · Y: 10.0Run #15 · Score · X: 2026-05-12 13:00:16 · Y: 10.0Run #16 · Score · X: 2026-05-12 14:00:12 · Y: 10.0Run #18 · Score · X: 2026-05-12 16:00:32 · Y: 10.0Run #19 · Score · X: 2026-05-12 17:00:36 · Y: 10.0Run #20 · Score · X: 2026-05-12 18:00:35 · Y: 10.0Run #21 · Score · X: 2026-05-12 19:00:24 · Y: 10.0Run #22 · Score · X: 2026-05-12 20:00:23 · Y: 10.0Run #23 · Score · X: 2026-05-12 21:00:26 · Y: 10.0Run #24 · Score · X: 2026-05-12 22:00:27 · Y: 10.0Run #25 · Score · X: 2026-05-12 23:00:22 · Y: 10.0Run #26 · Score · X: 2026-05-13 00:00:26 · Y: 10.0Run #27 · Score · X: 2026-05-13 01:00:29 · Y: 10.0Run #28 · Score · X: 2026-05-13 02:00:24 · Y: 10.0Run #29 · Score · X: 2026-05-13 03:00:35 · Y: 10.0Run #30 · Score · X: 2026-05-13 04:00:30 · Y: 10.0Run #31 · Score · X: 2026-05-13 05:00:25 · Y: 10.0Run #32 · Score · X: 2026-05-13 06:00:23 · Y: 10.0Run #33 · Score · X: 2026-05-13 07:00:20 · Y: 10.0Run #34 · Score · X: 2026-05-13 08:00:49 · Y: 10.0Run #35 · Score · X: 2026-05-13 09:00:49 · Y: 10.0Run #41 · Score · X: 2026-05-13 15:00:49 · Y: 10.0Run #42 · Score · X: 2026-05-13 16:00:49 · Y: 10.0Run #43 · Score · X: 2026-05-13 17:00:49 · Y: 10.0Run #44 · Score · X: 2026-05-13 18:00:49 · Y: 10.0Run #48 · Score · X: 2026-05-13 22:00:50 · Y: 10.0Run #49 · Score · X: 2026-05-13 23:01:01 · Y: 10.0Run #50 · Score · X: 2026-05-14 00:01:04 · Y: 10.0Run #51 · Score · X: 2026-05-14 01:01:03 · Y: 10.0Run #52 · Score · X: 2026-05-14 02:01:04 · Y: 10.0Run #53 · Score · X: 2026-05-14 03:00:20 · Y: 10.0Run #59 · Score · X: 2026-05-14 09:00:19 · Y: 10.0Run #60 · Score · X: 2026-05-14 10:00:24 · Y: 10.0Run #61 · Score · X: 2026-05-14 11:00:22 · Y: 10.0Run #64 · Score · X: 2026-05-14 14:00:19 · Y: 10.0Run #65 · Score · X: 2026-05-14 15:00:16 · Y: 10.0Run #67 · Score · X: 2026-05-14 17:00:24 · Y: 10.0Run #68 · Score · X: 2026-05-14 18:00:31 · Y: 10.0Run #69 · Score · X: 2026-05-14 19:00:27 · Y: 10.0Run #70 · Score · X: 2026-05-14 20:00:28 · Y: 10.0Run #71 · Score · X: 2026-05-14 21:00:28 · Y: 10.0Run #72 · Score · X: 2026-05-14 22:00:28 · Y: 10.0Run #73 · Score · X: 2026-05-14 23:00:25 · Y: 10.0Run #74 · Score · X: 2026-05-15 00:00:33 · Y: 10.0

Cost over time

$70.1$70.5$70.8$71.2$71.505-11 23:1705-12 17:2805-13 11:3905-14 05:4905-15 00:00 Run #1 · Cost · X: 2026-05-11 23:17:33 · Y: $70.8Run #2 · Cost · X: 2026-05-12 00:00:09 · Y: $70.8Run #3 · Cost · X: 2026-05-12 01:00:09 · Y: $70.8Run #4 · Cost · X: 2026-05-12 02:00:11 · Y: $70.8Run #5 · Cost · X: 2026-05-12 03:00:11 · Y: $70.8Run #7 · Cost · X: 2026-05-12 05:00:17 · Y: $70.8Run #8 · Cost · X: 2026-05-12 06:00:21 · Y: $70.8Run #9 · Cost · X: 2026-05-12 07:00:22 · Y: $70.8Run #11 · Cost · X: 2026-05-12 09:00:15 · Y: $70.8Run #12 · Cost · X: 2026-05-12 10:00:12 · Y: $70.8Run #15 · Cost · X: 2026-05-12 13:00:16 · Y: $70.8Run #16 · Cost · X: 2026-05-12 14:00:12 · Y: $70.8Run #18 · Cost · X: 2026-05-12 16:00:32 · Y: $70.8Run #19 · Cost · X: 2026-05-12 17:00:36 · Y: $70.8Run #20 · Cost · X: 2026-05-12 18:00:35 · Y: $70.8Run #21 · Cost · X: 2026-05-12 19:00:24 · Y: $70.8Run #22 · Cost · X: 2026-05-12 20:00:23 · Y: $70.8Run #23 · Cost · X: 2026-05-12 21:00:26 · Y: $70.8Run #24 · Cost · X: 2026-05-12 22:00:27 · Y: $70.8Run #25 · Cost · X: 2026-05-12 23:00:22 · Y: $70.8Run #26 · Cost · X: 2026-05-13 00:00:26 · Y: $70.8Run #27 · Cost · X: 2026-05-13 01:00:29 · Y: $70.8Run #28 · Cost · X: 2026-05-13 02:00:24 · Y: $70.8Run #29 · Cost · X: 2026-05-13 03:00:35 · Y: $70.8Run #30 · Cost · X: 2026-05-13 04:00:30 · Y: $70.8Run #31 · Cost · X: 2026-05-13 05:00:25 · Y: $70.8Run #32 · Cost · X: 2026-05-13 06:00:23 · Y: $70.8Run #33 · Cost · X: 2026-05-13 07:00:20 · Y: $70.8Run #34 · Cost · X: 2026-05-13 08:00:49 · Y: $70.8Run #35 · Cost · X: 2026-05-13 09:00:49 · Y: $70.8Run #41 · Cost · X: 2026-05-13 15:00:49 · Y: $70.8Run #42 · Cost · X: 2026-05-13 16:00:49 · Y: $70.8Run #43 · Cost · X: 2026-05-13 17:00:49 · Y: $70.8Run #44 · Cost · X: 2026-05-13 18:00:49 · Y: $70.8Run #48 · Cost · X: 2026-05-13 22:00:50 · Y: $70.8Run #49 · Cost · X: 2026-05-13 23:01:01 · Y: $70.8Run #50 · Cost · X: 2026-05-14 00:01:04 · Y: $70.8Run #51 · Cost · X: 2026-05-14 01:01:03 · Y: $70.8Run #52 · Cost · X: 2026-05-14 02:01:04 · Y: $70.8Run #53 · Cost · X: 2026-05-14 03:00:20 · Y: $70.8Run #59 · Cost · X: 2026-05-14 09:00:19 · Y: $70.8Run #60 · Cost · X: 2026-05-14 10:00:24 · Y: $70.8Run #61 · Cost · X: 2026-05-14 11:00:22 · Y: $70.8Run #64 · Cost · X: 2026-05-14 14:00:19 · Y: $70.8Run #65 · Cost · X: 2026-05-14 15:00:16 · Y: $70.8Run #67 · Cost · X: 2026-05-14 17:00:24 · Y: $70.8Run #68 · Cost · X: 2026-05-14 18:00:31 · Y: $70.8Run #69 · Cost · X: 2026-05-14 19:00:27 · Y: $70.8Run #70 · Cost · X: 2026-05-14 20:00:28 · Y: $70.8Run #71 · Cost · X: 2026-05-14 21:00:28 · Y: $70.8Run #72 · Cost · X: 2026-05-14 22:00:28 · Y: $70.8Run #73 · Cost · X: 2026-05-14 23:00:25 · Y: $70.8Run #74 · Cost · X: 2026-05-15 00:00:33 · Y: $70.8
Run?Fetched?Score?Quality?Cost?Intel?Code?Agent?MMMU%?
#74 2026-05-15 00:00:33 10.0 10.0 $70.8 14.8 6.4 8.7 51.2
#73 2026-05-14 23:00:25 10.0 10.0 $70.8 14.8 6.4 8.7 51.2
#72 2026-05-14 22:00:28 10.0 10.0 $70.8 14.8 6.4 8.7 51.2
#71 2026-05-14 21:00:28 10.0 10.0 $70.8 14.8 6.4 8.7 51.2
#70 2026-05-14 20:00:28 10.0 10.0 $70.8 14.8 6.4 8.7 51.2
#69 2026-05-14 19:00:27 10.0 10.0 $70.8 14.8 6.4 8.7 51.2
#68 2026-05-14 18:00:31 10.0 10.0 $70.8 14.8 6.4 8.7 51.2
#67 2026-05-14 17:00:24 10.0 10.0 $70.8 14.8 6.4 8.7 51.2
#65 2026-05-14 15:00:16 10.0 10.0 $70.8 14.8 6.4 8.7 51.2
#64 2026-05-14 14:00:19 10.0 10.0 $70.8 14.8 6.4 8.7 51.2
#61 2026-05-14 11:00:22 10.0 10.0 $70.8 14.8 6.4 8.7 51.2
#60 2026-05-14 10:00:24 10.0 10.0 $70.8 14.8 6.4 8.7 51.2
#59 2026-05-14 09:00:19 10.0 10.0 $70.8 14.8 6.4 8.7 51.2
#53 2026-05-14 03:00:20 10.0 10.0 $70.8 14.8 6.4 8.7 51.2
#52 2026-05-14 02:01:04 10.0 10.0 $70.8 14.8 6.4 8.7 51.2
#51 2026-05-14 01:01:03 10.0 10.0 $70.8 14.8 6.4 8.7 51.2
#50 2026-05-14 00:01:04 10.0 10.0 $70.8 14.8 6.4 8.7 51.2
#49 2026-05-13 23:01:01 10.0 10.0 $70.8 14.8 6.4 8.7 51.2
#48 2026-05-13 22:00:50 10.0 10.0 $70.8 14.8 6.4 8.7 51.2
#44 2026-05-13 18:00:49 10.0 10.0 $70.8 14.8 6.4 8.7 51.2
#43 2026-05-13 17:00:49 10.0 10.0 $70.8 14.8 6.4 8.7 51.2
#42 2026-05-13 16:00:49 10.0 10.0 $70.8 14.8 6.4 8.7 51.2
#41 2026-05-13 15:00:49 10.0 10.0 $70.8 14.8 6.4 8.7 51.2
#35 2026-05-13 09:00:49 10.0 10.0 $70.8 14.8 6.4 8.7 51.2
#34 2026-05-13 08:00:49 10.0 10.0 $70.8 14.8 6.4 8.7 51.2
#33 2026-05-13 07:00:20 10.0 10.0 $70.8 14.8 6.4 8.7 51.2
#32 2026-05-13 06:00:23 10.0 10.0 $70.8 14.8 6.4 8.7 51.2
#31 2026-05-13 05:00:25 10.0 10.0 $70.8 14.8 6.4 8.7 51.2
#30 2026-05-13 04:00:30 10.0 10.0 $70.8 14.8 6.4 8.7 51.2
#29 2026-05-13 03:00:35 10.0 10.0 $70.8 14.8 6.4 8.7 51.2
#28 2026-05-13 02:00:24 10.0 10.0 $70.8 14.8 6.4 8.7 51.2
#27 2026-05-13 01:00:29 10.0 10.0 $70.8 14.8 6.4 8.7 51.2
#26 2026-05-13 00:00:26 10.0 10.0 $70.8 14.8 6.4 8.7 51.2
#25 2026-05-12 23:00:22 10.0 10.0 $70.8 14.8 6.4 8.7 51.2
#24 2026-05-12 22:00:27 10.0 10.0 $70.8 14.8 6.4 8.7 51.2
#23 2026-05-12 21:00:26 10.0 10.0 $70.8 14.8 6.4 8.7 51.2
#22 2026-05-12 20:00:23 10.0 10.0 $70.8 14.8 6.4 8.7 51.2
#21 2026-05-12 19:00:24 10.0 10.0 $70.8 14.8 6.4 8.7 51.2
#20 2026-05-12 18:00:35 10.0 10.0 $70.8 14.8 6.4 8.7 51.2
#19 2026-05-12 17:00:36 10.0 10.0 $70.8 14.8 6.4 8.7 51.2
#18 2026-05-12 16:00:32 10.0 10.0 $70.8 14.8 6.4 8.7 51.2
#16 2026-05-12 14:00:12 10.0 10.0 $70.8 14.8 6.4 8.7 51.2
#15 2026-05-12 13:00:16 10.0 10.0 $70.8 14.8 6.4 8.7 51.2
#12 2026-05-12 10:00:12 10.0 10.0 $70.8 14.8 6.4 8.7 51.2
#11 2026-05-12 09:00:15 10.0 10.0 $70.8 14.8 6.4 8.7 51.2
#9 2026-05-12 07:00:22 10.0 10.0 $70.8 14.8 6.4 8.7 51.2
#8 2026-05-12 06:00:21 10.0 10.0 $70.8 14.8 6.4 8.7 51.2
#7 2026-05-12 05:00:17 10.0 10.0 $70.8 14.8 6.4 8.7 51.2
#5 2026-05-12 03:00:11 10.0 10.0 $70.8 14.8 6.4 8.7 51.2
#4 2026-05-12 02:00:11 10.0 10.0 $70.8 14.8 6.4 8.7 51.2
#3 2026-05-12 01:00:09 10.0 10.0 $70.8 14.8 6.4 8.7 51.2
#2 2026-05-12 00:00:09 10.0 10.0 $70.8 14.8 6.4 8.7 51.2
#1 2026-05-11 23:17:33 10.0 10.0 $70.8 14.8 6.4 8.7 51.2