Grok 4.1 Fast (Non-reasoning)

grok-4-1-fast · 69 samples · combined / raw

Scoring

Choose the quality benchmark and final score formula for this model.

Cost adjustment

Tune formulas that account for benchmark cost.

Score over time

25.025.225.325.425.605-11 23:1705-12 21:4305-13 20:0905-14 18:3505-15 17:00 Run #1 · Score · X: 2026-05-11 23:17:33 · Y: 25.3Run #2 · Score · X: 2026-05-12 00:00:09 · Y: 25.3Run #3 · Score · X: 2026-05-12 01:00:09 · Y: 25.3Run #4 · Score · X: 2026-05-12 02:00:11 · Y: 25.3Run #5 · Score · X: 2026-05-12 03:00:11 · Y: 25.3Run #7 · Score · X: 2026-05-12 05:00:17 · Y: 25.3Run #8 · Score · X: 2026-05-12 06:00:21 · Y: 25.3Run #9 · Score · X: 2026-05-12 07:00:22 · Y: 25.3Run #11 · Score · X: 2026-05-12 09:00:15 · Y: 25.3Run #12 · Score · X: 2026-05-12 10:00:12 · Y: 25.3Run #15 · Score · X: 2026-05-12 13:00:16 · Y: 25.3Run #16 · Score · X: 2026-05-12 14:00:12 · Y: 25.3Run #18 · Score · X: 2026-05-12 16:00:32 · Y: 25.3Run #19 · Score · X: 2026-05-12 17:00:36 · Y: 25.3Run #20 · Score · X: 2026-05-12 18:00:35 · Y: 25.3Run #21 · Score · X: 2026-05-12 19:00:24 · Y: 25.3Run #22 · Score · X: 2026-05-12 20:00:23 · Y: 25.3Run #23 · Score · X: 2026-05-12 21:00:26 · Y: 25.3Run #24 · Score · X: 2026-05-12 22:00:27 · Y: 25.3Run #25 · Score · X: 2026-05-12 23:00:22 · Y: 25.3Run #26 · Score · X: 2026-05-13 00:00:26 · Y: 25.3Run #27 · Score · X: 2026-05-13 01:00:29 · Y: 25.3Run #28 · Score · X: 2026-05-13 02:00:24 · Y: 25.3Run #29 · Score · X: 2026-05-13 03:00:35 · Y: 25.3Run #30 · Score · X: 2026-05-13 04:00:30 · Y: 25.3Run #31 · Score · X: 2026-05-13 05:00:25 · Y: 25.3Run #32 · Score · X: 2026-05-13 06:00:23 · Y: 25.3Run #33 · Score · X: 2026-05-13 07:00:20 · Y: 25.3Run #34 · Score · X: 2026-05-13 08:00:49 · Y: 25.3Run #35 · Score · X: 2026-05-13 09:00:49 · Y: 25.3Run #41 · Score · X: 2026-05-13 15:00:49 · Y: 25.3Run #42 · Score · X: 2026-05-13 16:00:49 · Y: 25.3Run #43 · Score · X: 2026-05-13 17:00:49 · Y: 25.3Run #44 · Score · X: 2026-05-13 18:00:49 · Y: 25.3Run #48 · Score · X: 2026-05-13 22:00:50 · Y: 25.3Run #49 · Score · X: 2026-05-13 23:01:01 · Y: 25.3Run #50 · Score · X: 2026-05-14 00:01:04 · Y: 25.3Run #51 · Score · X: 2026-05-14 01:01:03 · Y: 25.3Run #52 · Score · X: 2026-05-14 02:01:04 · Y: 25.3Run #53 · Score · X: 2026-05-14 03:00:20 · Y: 25.3Run #59 · Score · X: 2026-05-14 09:00:19 · Y: 25.3Run #60 · Score · X: 2026-05-14 10:00:24 · Y: 25.3Run #61 · Score · X: 2026-05-14 11:00:22 · Y: 25.3Run #64 · Score · X: 2026-05-14 14:00:19 · Y: 25.3Run #65 · Score · X: 2026-05-14 15:00:16 · Y: 25.3Run #67 · Score · X: 2026-05-14 17:00:24 · Y: 25.3Run #68 · Score · X: 2026-05-14 18:00:31 · Y: 25.3Run #69 · Score · X: 2026-05-14 19:00:27 · Y: 25.3Run #70 · Score · X: 2026-05-14 20:00:28 · Y: 25.3Run #71 · Score · X: 2026-05-14 21:00:28 · Y: 25.3Run #72 · Score · X: 2026-05-14 22:00:28 · Y: 25.3Run #73 · Score · X: 2026-05-14 23:00:25 · Y: 25.3Run #74 · Score · X: 2026-05-15 00:00:33 · Y: 25.3Run #75 · Score · X: 2026-05-15 01:00:26 · Y: 25.3Run #76 · Score · X: 2026-05-15 02:00:26 · Y: 25.3Run #77 · Score · X: 2026-05-15 03:00:29 · Y: 25.3Run #78 · Score · X: 2026-05-15 04:00:27 · Y: 25.3Run #79 · Score · X: 2026-05-15 05:00:29 · Y: 25.3Run #81 · Score · X: 2026-05-15 07:00:24 · Y: 25.3Run #82 · Score · X: 2026-05-15 08:00:55 · Y: 25.3Run #83 · Score · X: 2026-05-15 09:00:55 · Y: 25.3Run #84 · Score · X: 2026-05-15 10:00:55 · Y: 25.3Run #85 · Score · X: 2026-05-15 11:00:55 · Y: 25.3Run #86 · Score · X: 2026-05-15 12:00:56 · Y: 25.3Run #87 · Score · X: 2026-05-15 13:00:57 · Y: 25.3Run #88 · Score · X: 2026-05-15 14:00:57 · Y: 25.3Run #89 · Score · X: 2026-05-15 15:00:56 · Y: 25.3Run #90 · Score · X: 2026-05-15 16:00:57 · Y: 25.3Run #91 · Score · X: 2026-05-15 17:00:58 · Y: 25.3

Cost over time

$21.2$21.3$21.4$21.5$21.605-11 23:1705-12 21:4305-13 20:0905-14 18:3505-15 17:00 Run #1 · Cost · X: 2026-05-11 23:17:33 · Y: $21.4Run #2 · Cost · X: 2026-05-12 00:00:09 · Y: $21.4Run #3 · Cost · X: 2026-05-12 01:00:09 · Y: $21.4Run #4 · Cost · X: 2026-05-12 02:00:11 · Y: $21.4Run #5 · Cost · X: 2026-05-12 03:00:11 · Y: $21.4Run #7 · Cost · X: 2026-05-12 05:00:17 · Y: $21.4Run #8 · Cost · X: 2026-05-12 06:00:21 · Y: $21.4Run #9 · Cost · X: 2026-05-12 07:00:22 · Y: $21.4Run #11 · Cost · X: 2026-05-12 09:00:15 · Y: $21.4Run #12 · Cost · X: 2026-05-12 10:00:12 · Y: $21.4Run #15 · Cost · X: 2026-05-12 13:00:16 · Y: $21.4Run #16 · Cost · X: 2026-05-12 14:00:12 · Y: $21.4Run #18 · Cost · X: 2026-05-12 16:00:32 · Y: $21.4Run #19 · Cost · X: 2026-05-12 17:00:36 · Y: $21.4Run #20 · Cost · X: 2026-05-12 18:00:35 · Y: $21.4Run #21 · Cost · X: 2026-05-12 19:00:24 · Y: $21.4Run #22 · Cost · X: 2026-05-12 20:00:23 · Y: $21.4Run #23 · Cost · X: 2026-05-12 21:00:26 · Y: $21.4Run #24 · Cost · X: 2026-05-12 22:00:27 · Y: $21.4Run #25 · Cost · X: 2026-05-12 23:00:22 · Y: $21.4Run #26 · Cost · X: 2026-05-13 00:00:26 · Y: $21.4Run #27 · Cost · X: 2026-05-13 01:00:29 · Y: $21.4Run #28 · Cost · X: 2026-05-13 02:00:24 · Y: $21.4Run #29 · Cost · X: 2026-05-13 03:00:35 · Y: $21.4Run #30 · Cost · X: 2026-05-13 04:00:30 · Y: $21.4Run #31 · Cost · X: 2026-05-13 05:00:25 · Y: $21.4Run #32 · Cost · X: 2026-05-13 06:00:23 · Y: $21.4Run #33 · Cost · X: 2026-05-13 07:00:20 · Y: $21.4Run #34 · Cost · X: 2026-05-13 08:00:49 · Y: $21.4Run #35 · Cost · X: 2026-05-13 09:00:49 · Y: $21.4Run #41 · Cost · X: 2026-05-13 15:00:49 · Y: $21.4Run #42 · Cost · X: 2026-05-13 16:00:49 · Y: $21.4Run #43 · Cost · X: 2026-05-13 17:00:49 · Y: $21.4Run #44 · Cost · X: 2026-05-13 18:00:49 · Y: $21.4Run #48 · Cost · X: 2026-05-13 22:00:50 · Y: $21.4Run #49 · Cost · X: 2026-05-13 23:01:01 · Y: $21.4Run #50 · Cost · X: 2026-05-14 00:01:04 · Y: $21.4Run #51 · Cost · X: 2026-05-14 01:01:03 · Y: $21.4Run #52 · Cost · X: 2026-05-14 02:01:04 · Y: $21.4Run #53 · Cost · X: 2026-05-14 03:00:20 · Y: $21.4Run #59 · Cost · X: 2026-05-14 09:00:19 · Y: $21.4Run #60 · Cost · X: 2026-05-14 10:00:24 · Y: $21.4Run #61 · Cost · X: 2026-05-14 11:00:22 · Y: $21.4Run #64 · Cost · X: 2026-05-14 14:00:19 · Y: $21.4Run #65 · Cost · X: 2026-05-14 15:00:16 · Y: $21.4Run #67 · Cost · X: 2026-05-14 17:00:24 · Y: $21.4Run #68 · Cost · X: 2026-05-14 18:00:31 · Y: $21.4Run #69 · Cost · X: 2026-05-14 19:00:27 · Y: $21.4Run #70 · Cost · X: 2026-05-14 20:00:28 · Y: $21.4Run #71 · Cost · X: 2026-05-14 21:00:28 · Y: $21.4Run #72 · Cost · X: 2026-05-14 22:00:28 · Y: $21.4Run #73 · Cost · X: 2026-05-14 23:00:25 · Y: $21.4Run #74 · Cost · X: 2026-05-15 00:00:33 · Y: $21.4Run #75 · Cost · X: 2026-05-15 01:00:26 · Y: $21.4Run #76 · Cost · X: 2026-05-15 02:00:26 · Y: $21.4Run #77 · Cost · X: 2026-05-15 03:00:29 · Y: $21.4Run #78 · Cost · X: 2026-05-15 04:00:27 · Y: $21.4Run #79 · Cost · X: 2026-05-15 05:00:29 · Y: $21.4Run #81 · Cost · X: 2026-05-15 07:00:24 · Y: $21.4Run #82 · Cost · X: 2026-05-15 08:00:55 · Y: $21.4Run #83 · Cost · X: 2026-05-15 09:00:55 · Y: $21.4Run #84 · Cost · X: 2026-05-15 10:00:55 · Y: $21.4Run #85 · Cost · X: 2026-05-15 11:00:55 · Y: $21.4Run #86 · Cost · X: 2026-05-15 12:00:56 · Y: $21.4Run #87 · Cost · X: 2026-05-15 13:00:57 · Y: $21.4Run #88 · Cost · X: 2026-05-15 14:00:57 · Y: $21.4Run #89 · Cost · X: 2026-05-15 15:00:56 · Y: $21.4Run #90 · Cost · X: 2026-05-15 16:00:57 · Y: $21.4Run #91 · Cost · X: 2026-05-15 17:00:58 · Y: $21.4
Run?Fetched?Score?Quality?Cost?Intel?Code?Agent?MMMU%?
#91 2026-05-15 17:00:58 25.3 25.3 $21.4 23.6 19.5 32.9 48.4
#90 2026-05-15 16:00:57 25.3 25.3 $21.4 23.6 19.5 32.9 48.4
#89 2026-05-15 15:00:56 25.3 25.3 $21.4 23.6 19.5 32.9 48.4
#88 2026-05-15 14:00:57 25.3 25.3 $21.4 23.6 19.5 32.9 48.4
#87 2026-05-15 13:00:57 25.3 25.3 $21.4 23.6 19.5 32.9 48.4
#86 2026-05-15 12:00:56 25.3 25.3 $21.4 23.6 19.5 32.9 48.4
#85 2026-05-15 11:00:55 25.3 25.3 $21.4 23.6 19.5 32.9 48.4
#84 2026-05-15 10:00:55 25.3 25.3 $21.4 23.6 19.5 32.9 48.4
#83 2026-05-15 09:00:55 25.3 25.3 $21.4 23.6 19.5 32.9 48.4
#82 2026-05-15 08:00:55 25.3 25.3 $21.4 23.6 19.5 32.9 48.4
#81 2026-05-15 07:00:24 25.3 25.3 $21.4 23.6 19.5 32.9 48.4
#79 2026-05-15 05:00:29 25.3 25.3 $21.4 23.6 19.5 32.9 48.4
#78 2026-05-15 04:00:27 25.3 25.3 $21.4 23.6 19.5 32.9 48.4
#77 2026-05-15 03:00:29 25.3 25.3 $21.4 23.6 19.5 32.9 48.4
#76 2026-05-15 02:00:26 25.3 25.3 $21.4 23.6 19.5 32.9 48.4
#75 2026-05-15 01:00:26 25.3 25.3 $21.4 23.6 19.5 32.9 48.4
#74 2026-05-15 00:00:33 25.3 25.3 $21.4 23.6 19.5 32.9 48.4
#73 2026-05-14 23:00:25 25.3 25.3 $21.4 23.6 19.5 32.9 48.4
#72 2026-05-14 22:00:28 25.3 25.3 $21.4 23.6 19.5 32.9 48.4
#71 2026-05-14 21:00:28 25.3 25.3 $21.4 23.6 19.5 32.9 48.4
#70 2026-05-14 20:00:28 25.3 25.3 $21.4 23.6 19.5 32.9 48.4
#69 2026-05-14 19:00:27 25.3 25.3 $21.4 23.6 19.5 32.9 48.4
#68 2026-05-14 18:00:31 25.3 25.3 $21.4 23.6 19.5 32.9 48.4
#67 2026-05-14 17:00:24 25.3 25.3 $21.4 23.6 19.5 32.9 48.4
#65 2026-05-14 15:00:16 25.3 25.3 $21.4 23.6 19.5 32.9 48.4
#64 2026-05-14 14:00:19 25.3 25.3 $21.4 23.6 19.5 32.9 48.4
#61 2026-05-14 11:00:22 25.3 25.3 $21.4 23.6 19.5 32.9 48.4
#60 2026-05-14 10:00:24 25.3 25.3 $21.4 23.6 19.5 32.9 48.4
#59 2026-05-14 09:00:19 25.3 25.3 $21.4 23.6 19.5 32.9 48.4
#53 2026-05-14 03:00:20 25.3 25.3 $21.4 23.6 19.5 32.9 48.4
#52 2026-05-14 02:01:04 25.3 25.3 $21.4 23.6 19.5 32.9 48.4
#51 2026-05-14 01:01:03 25.3 25.3 $21.4 23.6 19.5 32.9 48.4
#50 2026-05-14 00:01:04 25.3 25.3 $21.4 23.6 19.5 32.9 48.4
#49 2026-05-13 23:01:01 25.3 25.3 $21.4 23.6 19.5 32.9 48.4
#48 2026-05-13 22:00:50 25.3 25.3 $21.4 23.6 19.5 32.9 48.4
#44 2026-05-13 18:00:49 25.3 25.3 $21.4 23.6 19.5 32.9 48.4
#43 2026-05-13 17:00:49 25.3 25.3 $21.4 23.6 19.5 33.0 48.4
#42 2026-05-13 16:00:49 25.3 25.3 $21.4 23.6 19.5 33.0 48.4
#41 2026-05-13 15:00:49 25.3 25.3 $21.4 23.6 19.5 33.0 48.4
#35 2026-05-13 09:00:49 25.3 25.3 $21.4 23.6 19.5 33.0 48.4
#34 2026-05-13 08:00:49 25.3 25.3 $21.4 23.6 19.5 33.0 48.4
#33 2026-05-13 07:00:20 25.3 25.3 $21.4 23.6 19.5 33.0 48.4
#32 2026-05-13 06:00:23 25.3 25.3 $21.4 23.6 19.5 33.0 48.4
#31 2026-05-13 05:00:25 25.3 25.3 $21.4 23.6 19.5 33.0 48.4
#30 2026-05-13 04:00:30 25.3 25.3 $21.4 23.6 19.5 33.0 48.4
#29 2026-05-13 03:00:35 25.3 25.3 $21.4 23.6 19.5 33.0 48.4
#28 2026-05-13 02:00:24 25.3 25.3 $21.4 23.6 19.5 33.0 48.4
#27 2026-05-13 01:00:29 25.3 25.3 $21.4 23.6 19.5 33.0 48.4
#26 2026-05-13 00:00:26 25.3 25.3 $21.4 23.6 19.5 33.0 48.4
#25 2026-05-12 23:00:22 25.3 25.3 $21.4 23.6 19.5 33.0 48.4
#24 2026-05-12 22:00:27 25.3 25.3 $21.4 23.6 19.5 33.0 48.4
#23 2026-05-12 21:00:26 25.3 25.3 $21.4 23.6 19.5 33.0 48.4
#22 2026-05-12 20:00:23 25.3 25.3 $21.4 23.6 19.5 33.0 48.4
#21 2026-05-12 19:00:24 25.3 25.3 $21.4 23.6 19.5 33.0 48.4
#20 2026-05-12 18:00:35 25.3 25.3 $21.4 23.6 19.5 33.0 48.4
#19 2026-05-12 17:00:36 25.3 25.3 $21.4 23.6 19.5 33.0 48.4
#18 2026-05-12 16:00:32 25.3 25.3 $21.4 23.6 19.5 33.0 48.4
#16 2026-05-12 14:00:12 25.3 25.3 $21.4 23.6 19.5 33.0 48.4
#15 2026-05-12 13:00:16 25.3 25.3 $21.4 23.6 19.5 33.0 48.4
#12 2026-05-12 10:00:12 25.3 25.3 $21.4 23.6 19.5 33.0 48.4
#11 2026-05-12 09:00:15 25.3 25.3 $21.4 23.6 19.5 33.0 48.4
#9 2026-05-12 07:00:22 25.3 25.3 $21.4 23.6 19.5 33.0 48.4
#8 2026-05-12 06:00:21 25.3 25.3 $21.4 23.6 19.5 33.0 48.4
#7 2026-05-12 05:00:17 25.3 25.3 $21.4 23.6 19.5 33.0 48.4
#5 2026-05-12 03:00:11 25.3 25.3 $21.4 23.6 19.5 33.0 48.4
#4 2026-05-12 02:00:11 25.3 25.3 $21.4 23.6 19.5 33.0 48.4
#3 2026-05-12 01:00:09 25.3 25.3 $21.4 23.6 19.5 33.0 48.4
#2 2026-05-12 00:00:09 25.3 25.3 $21.4 23.6 19.5 33.0 48.4
#1 2026-05-11 23:17:33 25.3 25.3 $21.4 23.6 19.5 33.0 48.4