Gemma 4 E4B (Reasoning)

gemma-4-e4b · 120 samples · combined / raw

Scoring

Choose the quality benchmark and final score formula for this model.

Cost adjustment

Tune formulas that account for Cost per Task.

Score over time

7.67.77.87.98.007-31 01:0008-01 06:4508-02 12:3008-03 18:1508-05 00:00 Run #1300 · Score · X: 2026-07-31 01:00:13 · Y: 7.8Run #1301 · Score · X: 2026-07-31 02:00:13 · Y: 7.8Run #1302 · Score · X: 2026-07-31 03:00:13 · Y: 7.8Run #1303 · Score · X: 2026-07-31 04:00:13 · Y: 7.8Run #1304 · Score · X: 2026-07-31 05:00:13 · Y: 7.8Run #1305 · Score · X: 2026-07-31 06:00:13 · Y: 7.8Run #1306 · Score · X: 2026-07-31 07:00:13 · Y: 7.8Run #1307 · Score · X: 2026-07-31 08:00:13 · Y: 7.8Run #1308 · Score · X: 2026-07-31 09:00:13 · Y: 7.8Run #1309 · Score · X: 2026-07-31 10:00:05 · Y: 7.8Run #1310 · Score · X: 2026-07-31 11:00:05 · Y: 7.8Run #1311 · Score · X: 2026-07-31 12:00:05 · Y: 7.8Run #1312 · Score · X: 2026-07-31 13:00:05 · Y: 7.8Run #1313 · Score · X: 2026-07-31 14:00:05 · Y: 7.8Run #1314 · Score · X: 2026-07-31 15:00:05 · Y: 7.8Run #1315 · Score · X: 2026-07-31 16:00:05 · Y: 7.8Run #1316 · Score · X: 2026-07-31 17:00:05 · Y: 7.8Run #1317 · Score · X: 2026-07-31 18:00:05 · Y: 7.8Run #1318 · Score · X: 2026-07-31 19:00:05 · Y: 7.8Run #1319 · Score · X: 2026-07-31 20:00:05 · Y: 7.8Run #1320 · Score · X: 2026-07-31 21:00:05 · Y: 7.8Run #1321 · Score · X: 2026-07-31 22:00:05 · Y: 7.8Run #1322 · Score · X: 2026-07-31 23:00:05 · Y: 7.8Run #1323 · Score · X: 2026-08-01 00:00:05 · Y: 7.8Run #1324 · Score · X: 2026-08-01 01:00:05 · Y: 7.8Run #1325 · Score · X: 2026-08-01 02:00:05 · Y: 7.8Run #1326 · Score · X: 2026-08-01 03:00:05 · Y: 7.8Run #1327 · Score · X: 2026-08-01 04:00:05 · Y: 7.8Run #1328 · Score · X: 2026-08-01 05:00:05 · Y: 7.8Run #1329 · Score · X: 2026-08-01 06:00:05 · Y: 7.8Run #1330 · Score · X: 2026-08-01 07:00:05 · Y: 7.8Run #1331 · Score · X: 2026-08-01 08:00:04 · Y: 7.8Run #1332 · Score · X: 2026-08-01 09:00:05 · Y: 7.8Run #1333 · Score · X: 2026-08-01 10:00:05 · Y: 7.8Run #1334 · Score · X: 2026-08-01 11:00:05 · Y: 7.8Run #1335 · Score · X: 2026-08-01 12:00:05 · Y: 7.8Run #1336 · Score · X: 2026-08-01 13:00:05 · Y: 7.8Run #1337 · Score · X: 2026-08-01 14:00:05 · Y: 7.8Run #1338 · Score · X: 2026-08-01 15:00:05 · Y: 7.8Run #1339 · Score · X: 2026-08-01 16:00:05 · Y: 7.8Run #1340 · Score · X: 2026-08-01 17:00:05 · Y: 7.8Run #1341 · Score · X: 2026-08-01 18:00:05 · Y: 7.8Run #1342 · Score · X: 2026-08-01 19:00:05 · Y: 7.8Run #1343 · Score · X: 2026-08-01 20:00:05 · Y: 7.8Run #1344 · Score · X: 2026-08-01 21:00:05 · Y: 7.8Run #1345 · Score · X: 2026-08-01 22:00:05 · Y: 7.8Run #1346 · Score · X: 2026-08-01 23:00:05 · Y: 7.8Run #1347 · Score · X: 2026-08-02 00:00:05 · Y: 7.8Run #1348 · Score · X: 2026-08-02 01:00:05 · Y: 7.8Run #1349 · Score · X: 2026-08-02 02:00:05 · Y: 7.8Run #1350 · Score · X: 2026-08-02 03:00:05 · Y: 7.8Run #1351 · Score · X: 2026-08-02 04:00:05 · Y: 7.8Run #1352 · Score · X: 2026-08-02 05:00:05 · Y: 7.8Run #1353 · Score · X: 2026-08-02 06:00:05 · Y: 7.8Run #1354 · Score · X: 2026-08-02 07:00:05 · Y: 7.8Run #1355 · Score · X: 2026-08-02 08:00:04 · Y: 7.8Run #1356 · Score · X: 2026-08-02 09:00:05 · Y: 7.8Run #1357 · Score · X: 2026-08-02 10:00:05 · Y: 7.8Run #1358 · Score · X: 2026-08-02 11:00:05 · Y: 7.8Run #1359 · Score · X: 2026-08-02 12:00:05 · Y: 7.8Run #1360 · Score · X: 2026-08-02 13:00:05 · Y: 7.8Run #1361 · Score · X: 2026-08-02 14:00:05 · Y: 7.8Run #1362 · Score · X: 2026-08-02 15:00:06 · Y: 7.8Run #1363 · Score · X: 2026-08-02 16:00:05 · Y: 7.8Run #1364 · Score · X: 2026-08-02 17:00:05 · Y: 7.8Run #1365 · Score · X: 2026-08-02 18:00:05 · Y: 7.8Run #1366 · Score · X: 2026-08-02 19:00:05 · Y: 7.8Run #1367 · Score · X: 2026-08-02 20:00:05 · Y: 7.8Run #1368 · Score · X: 2026-08-02 21:00:05 · Y: 7.8Run #1369 · Score · X: 2026-08-02 22:00:05 · Y: 7.8Run #1370 · Score · X: 2026-08-02 23:00:05 · Y: 7.8Run #1371 · Score · X: 2026-08-03 00:00:05 · Y: 7.8Run #1372 · Score · X: 2026-08-03 01:00:05 · Y: 7.8Run #1373 · Score · X: 2026-08-03 02:00:05 · Y: 7.8Run #1374 · Score · X: 2026-08-03 03:00:05 · Y: 7.8Run #1375 · Score · X: 2026-08-03 04:00:05 · Y: 7.8Run #1376 · Score · X: 2026-08-03 05:00:05 · Y: 7.8Run #1377 · Score · X: 2026-08-03 06:00:05 · Y: 7.8Run #1378 · Score · X: 2026-08-03 07:00:05 · Y: 7.8Run #1379 · Score · X: 2026-08-03 08:00:05 · Y: 7.8Run #1380 · Score · X: 2026-08-03 09:00:05 · Y: 7.8Run #1381 · Score · X: 2026-08-03 10:00:05 · Y: 7.8Run #1382 · Score · X: 2026-08-03 11:00:05 · Y: 7.8Run #1383 · Score · X: 2026-08-03 12:00:05 · Y: 7.8Run #1384 · Score · X: 2026-08-03 13:00:05 · Y: 7.8Run #1385 · Score · X: 2026-08-03 14:00:05 · Y: 7.8Run #1386 · Score · X: 2026-08-03 15:00:05 · Y: 7.8Run #1387 · Score · X: 2026-08-03 16:00:06 · Y: 7.8Run #1388 · Score · X: 2026-08-03 17:00:05 · Y: 7.8Run #1389 · Score · X: 2026-08-03 18:00:05 · Y: 7.8Run #1390 · Score · X: 2026-08-03 19:00:05 · Y: 7.8Run #1391 · Score · X: 2026-08-03 20:00:05 · Y: 7.8Run #1392 · Score · X: 2026-08-03 21:00:05 · Y: 7.8Run #1393 · Score · X: 2026-08-03 22:00:05 · Y: 7.8Run #1394 · Score · X: 2026-08-03 23:00:05 · Y: 7.8Run #1395 · Score · X: 2026-08-04 00:00:05 · Y: 7.8Run #1396 · Score · X: 2026-08-04 01:00:05 · Y: 7.8Run #1397 · Score · X: 2026-08-04 02:00:05 · Y: 7.8Run #1398 · Score · X: 2026-08-04 03:00:05 · Y: 7.8Run #1399 · Score · X: 2026-08-04 04:00:05 · Y: 7.8Run #1400 · Score · X: 2026-08-04 05:00:05 · Y: 7.8Run #1401 · Score · X: 2026-08-04 06:00:05 · Y: 7.8Run #1402 · Score · X: 2026-08-04 07:00:05 · Y: 7.8Run #1403 · Score · X: 2026-08-04 08:00:05 · Y: 7.8Run #1404 · Score · X: 2026-08-04 09:00:05 · Y: 7.8Run #1405 · Score · X: 2026-08-04 10:00:05 · Y: 7.8Run #1406 · Score · X: 2026-08-04 11:00:05 · Y: 7.8Run #1407 · Score · X: 2026-08-04 12:00:05 · Y: 7.8Run #1408 · Score · X: 2026-08-04 13:00:06 · Y: 7.8Run #1409 · Score · X: 2026-08-04 14:00:05 · Y: 7.8Run #1410 · Score · X: 2026-08-04 15:00:05 · Y: 7.8Run #1411 · Score · X: 2026-08-04 16:00:06 · Y: 7.8Run #1412 · Score · X: 2026-08-04 17:00:06 · Y: 7.8Run #1413 · Score · X: 2026-08-04 18:00:29 · Y: 7.8Run #1414 · Score · X: 2026-08-04 19:00:29 · Y: 7.8Run #1415 · Score · X: 2026-08-04 20:00:29 · Y: 7.8Run #1416 · Score · X: 2026-08-04 21:00:29 · Y: 7.8Run #1417 · Score · X: 2026-08-04 22:00:29 · Y: 7.8Run #1418 · Score · X: 2026-08-04 23:00:30 · Y: 7.8Run #1419 · Score · X: 2026-08-05 00:00:29 · Y: 7.8

Cost per task over time

$0.0132$0.0136$0.0141$0.0145$0.014907-31 01:0008-01 06:4508-02 12:3008-03 18:1508-05 00:00 Run #1300 · Cost per task · X: 2026-07-31 01:00:13 · Y: $0.0132Run #1301 · Cost per task · X: 2026-07-31 02:00:13 · Y: $0.0132Run #1302 · Cost per task · X: 2026-07-31 03:00:13 · Y: $0.0132Run #1303 · Cost per task · X: 2026-07-31 04:00:13 · Y: $0.0132Run #1304 · Cost per task · X: 2026-07-31 05:00:13 · Y: $0.0132Run #1305 · Cost per task · X: 2026-07-31 06:00:13 · Y: $0.0132Run #1306 · Cost per task · X: 2026-07-31 07:00:13 · Y: $0.0149Run #1307 · Cost per task · X: 2026-07-31 08:00:13 · Y: $0.0149Run #1308 · Cost per task · X: 2026-07-31 09:00:13 · Y: $0.0149Run #1309 · Cost per task · X: 2026-07-31 10:00:05 · Y: $0.0149Run #1310 · Cost per task · X: 2026-07-31 11:00:05 · Y: $0.0149Run #1311 · Cost per task · X: 2026-07-31 12:00:05 · Y: $0.0149Run #1312 · Cost per task · X: 2026-07-31 13:00:05 · Y: $0.0149Run #1313 · Cost per task · X: 2026-07-31 14:00:05 · Y: $0.0149Run #1314 · Cost per task · X: 2026-07-31 15:00:05 · Y: $0.0149Run #1315 · Cost per task · X: 2026-07-31 16:00:05 · Y: $0.0149Run #1316 · Cost per task · X: 2026-07-31 17:00:05 · Y: $0.0149Run #1317 · Cost per task · X: 2026-07-31 18:00:05 · Y: $0.0149Run #1318 · Cost per task · X: 2026-07-31 19:00:05 · Y: $0.0149Run #1319 · Cost per task · X: 2026-07-31 20:00:05 · Y: $0.0149Run #1320 · Cost per task · X: 2026-07-31 21:00:05 · Y: $0.0149Run #1321 · Cost per task · X: 2026-07-31 22:00:05 · Y: $0.0149Run #1322 · Cost per task · X: 2026-07-31 23:00:05 · Y: $0.0149Run #1323 · Cost per task · X: 2026-08-01 00:00:05 · Y: $0.0149Run #1324 · Cost per task · X: 2026-08-01 01:00:05 · Y: $0.0149Run #1325 · Cost per task · X: 2026-08-01 02:00:05 · Y: $0.0149Run #1326 · Cost per task · X: 2026-08-01 03:00:05 · Y: $0.0149Run #1327 · Cost per task · X: 2026-08-01 04:00:05 · Y: $0.0149Run #1328 · Cost per task · X: 2026-08-01 05:00:05 · Y: $0.0149Run #1329 · Cost per task · X: 2026-08-01 06:00:05 · Y: $0.0149Run #1330 · Cost per task · X: 2026-08-01 07:00:05 · Y: $0.0149Run #1331 · Cost per task · X: 2026-08-01 08:00:04 · Y: $0.0149Run #1332 · Cost per task · X: 2026-08-01 09:00:05 · Y: $0.0149Run #1333 · Cost per task · X: 2026-08-01 10:00:05 · Y: $0.0149Run #1334 · Cost per task · X: 2026-08-01 11:00:05 · Y: $0.0149Run #1335 · Cost per task · X: 2026-08-01 12:00:05 · Y: $0.0149Run #1336 · Cost per task · X: 2026-08-01 13:00:05 · Y: $0.0149Run #1337 · Cost per task · X: 2026-08-01 14:00:05 · Y: $0.0149Run #1338 · Cost per task · X: 2026-08-01 15:00:05 · Y: $0.0149Run #1339 · Cost per task · X: 2026-08-01 16:00:05 · Y: $0.0149Run #1340 · Cost per task · X: 2026-08-01 17:00:05 · Y: $0.0149Run #1341 · Cost per task · X: 2026-08-01 18:00:05 · Y: $0.0149Run #1342 · Cost per task · X: 2026-08-01 19:00:05 · Y: $0.0149Run #1343 · Cost per task · X: 2026-08-01 20:00:05 · Y: $0.0149Run #1344 · Cost per task · X: 2026-08-01 21:00:05 · Y: $0.0149Run #1345 · Cost per task · X: 2026-08-01 22:00:05 · Y: $0.0149Run #1346 · Cost per task · X: 2026-08-01 23:00:05 · Y: $0.0149Run #1347 · Cost per task · X: 2026-08-02 00:00:05 · Y: $0.0149Run #1348 · Cost per task · X: 2026-08-02 01:00:05 · Y: $0.0149Run #1349 · Cost per task · X: 2026-08-02 02:00:05 · Y: $0.0149Run #1350 · Cost per task · X: 2026-08-02 03:00:05 · Y: $0.0149Run #1351 · Cost per task · X: 2026-08-02 04:00:05 · Y: $0.0149Run #1352 · Cost per task · X: 2026-08-02 05:00:05 · Y: $0.0149Run #1353 · Cost per task · X: 2026-08-02 06:00:05 · Y: $0.0149Run #1354 · Cost per task · X: 2026-08-02 07:00:05 · Y: $0.0149Run #1355 · Cost per task · X: 2026-08-02 08:00:04 · Y: $0.0149Run #1356 · Cost per task · X: 2026-08-02 09:00:05 · Y: $0.0149Run #1357 · Cost per task · X: 2026-08-02 10:00:05 · Y: $0.0149Run #1358 · Cost per task · X: 2026-08-02 11:00:05 · Y: $0.0149Run #1359 · Cost per task · X: 2026-08-02 12:00:05 · Y: $0.0149Run #1360 · Cost per task · X: 2026-08-02 13:00:05 · Y: $0.0149Run #1361 · Cost per task · X: 2026-08-02 14:00:05 · Y: $0.0149Run #1362 · Cost per task · X: 2026-08-02 15:00:06 · Y: $0.0149Run #1363 · Cost per task · X: 2026-08-02 16:00:05 · Y: $0.0149Run #1364 · Cost per task · X: 2026-08-02 17:00:05 · Y: $0.0149Run #1365 · Cost per task · X: 2026-08-02 18:00:05 · Y: $0.0149Run #1366 · Cost per task · X: 2026-08-02 19:00:05 · Y: $0.0149Run #1367 · Cost per task · X: 2026-08-02 20:00:05 · Y: $0.0149Run #1368 · Cost per task · X: 2026-08-02 21:00:05 · Y: $0.0149Run #1369 · Cost per task · X: 2026-08-02 22:00:05 · Y: $0.0149Run #1370 · Cost per task · X: 2026-08-02 23:00:05 · Y: $0.0149Run #1371 · Cost per task · X: 2026-08-03 00:00:05 · Y: $0.0149Run #1372 · Cost per task · X: 2026-08-03 01:00:05 · Y: $0.0149Run #1373 · Cost per task · X: 2026-08-03 02:00:05 · Y: $0.0149Run #1374 · Cost per task · X: 2026-08-03 03:00:05 · Y: $0.0149Run #1375 · Cost per task · X: 2026-08-03 04:00:05 · Y: $0.0149Run #1376 · Cost per task · X: 2026-08-03 05:00:05 · Y: $0.0149Run #1377 · Cost per task · X: 2026-08-03 06:00:05 · Y: $0.0149Run #1378 · Cost per task · X: 2026-08-03 07:00:05 · Y: $0.0149Run #1379 · Cost per task · X: 2026-08-03 08:00:05 · Y: $0.0149Run #1380 · Cost per task · X: 2026-08-03 09:00:05 · Y: $0.0149Run #1381 · Cost per task · X: 2026-08-03 10:00:05 · Y: $0.0149Run #1382 · Cost per task · X: 2026-08-03 11:00:05 · Y: $0.0149Run #1383 · Cost per task · X: 2026-08-03 12:00:05 · Y: $0.0149Run #1384 · Cost per task · X: 2026-08-03 13:00:05 · Y: $0.0149Run #1385 · Cost per task · X: 2026-08-03 14:00:05 · Y: $0.0149Run #1386 · Cost per task · X: 2026-08-03 15:00:05 · Y: $0.0149Run #1387 · Cost per task · X: 2026-08-03 16:00:06 · Y: $0.0149Run #1388 · Cost per task · X: 2026-08-03 17:00:05 · Y: $0.0149Run #1389 · Cost per task · X: 2026-08-03 18:00:05 · Y: $0.0149Run #1390 · Cost per task · X: 2026-08-03 19:00:05 · Y: $0.0149Run #1391 · Cost per task · X: 2026-08-03 20:00:05 · Y: $0.0149Run #1392 · Cost per task · X: 2026-08-03 21:00:05 · Y: $0.0149Run #1393 · Cost per task · X: 2026-08-03 22:00:05 · Y: $0.0149Run #1394 · Cost per task · X: 2026-08-03 23:00:05 · Y: $0.0149Run #1395 · Cost per task · X: 2026-08-04 00:00:05 · Y: $0.0149Run #1396 · Cost per task · X: 2026-08-04 01:00:05 · Y: $0.0149Run #1397 · Cost per task · X: 2026-08-04 02:00:05 · Y: $0.0149Run #1398 · Cost per task · X: 2026-08-04 03:00:05 · Y: $0.0149Run #1399 · Cost per task · X: 2026-08-04 04:00:05 · Y: $0.0149Run #1400 · Cost per task · X: 2026-08-04 05:00:05 · Y: $0.0149Run #1401 · Cost per task · X: 2026-08-04 06:00:05 · Y: $0.0149Run #1402 · Cost per task · X: 2026-08-04 07:00:05 · Y: $0.0149Run #1403 · Cost per task · X: 2026-08-04 08:00:05 · Y: $0.0149Run #1404 · Cost per task · X: 2026-08-04 09:00:05 · Y: $0.0149Run #1405 · Cost per task · X: 2026-08-04 10:00:05 · Y: $0.0149Run #1406 · Cost per task · X: 2026-08-04 11:00:05 · Y: $0.0149Run #1407 · Cost per task · X: 2026-08-04 12:00:05 · Y: $0.0149Run #1408 · Cost per task · X: 2026-08-04 13:00:06 · Y: $0.0149Run #1409 · Cost per task · X: 2026-08-04 14:00:05 · Y: $0.0149Run #1410 · Cost per task · X: 2026-08-04 15:00:05 · Y: $0.0149Run #1411 · Cost per task · X: 2026-08-04 16:00:06 · Y: $0.0149Run #1412 · Cost per task · X: 2026-08-04 17:00:06 · Y: $0.0149Run #1413 · Cost per task · X: 2026-08-04 18:00:29 · Y: $0.0149Run #1414 · Cost per task · X: 2026-08-04 19:00:29 · Y: $0.0149Run #1415 · Cost per task · X: 2026-08-04 20:00:29 · Y: $0.0149Run #1416 · Cost per task · X: 2026-08-04 21:00:29 · Y: $0.0149Run #1417 · Cost per task · X: 2026-08-04 22:00:29 · Y: $0.0149Run #1418 · Cost per task · X: 2026-08-04 23:00:30 · Y: $0.0149Run #1419 · Cost per task · X: 2026-08-05 00:00:29 · Y: $0.0149

Time per task over time

1.37m1.44m1.51m1.57m1.64m07-31 01:0008-01 06:4508-02 12:3008-03 18:1508-05 00:00 Run #1300 · Time per task · X: 2026-07-31 01:00:13 · Y: 1.37mRun #1301 · Time per task · X: 2026-07-31 02:00:13 · Y: 1.37mRun #1302 · Time per task · X: 2026-07-31 03:00:13 · Y: 1.37mRun #1303 · Time per task · X: 2026-07-31 04:00:13 · Y: 1.37mRun #1304 · Time per task · X: 2026-07-31 05:00:13 · Y: 1.37mRun #1305 · Time per task · X: 2026-07-31 06:00:13 · Y: 1.37mRun #1306 · Time per task · X: 2026-07-31 07:00:13 · Y: 1.54mRun #1307 · Time per task · X: 2026-07-31 08:00:13 · Y: 1.54mRun #1308 · Time per task · X: 2026-07-31 09:00:13 · Y: 1.54mRun #1309 · Time per task · X: 2026-07-31 10:00:05 · Y: 1.54mRun #1310 · Time per task · X: 2026-07-31 11:00:05 · Y: 1.54mRun #1311 · Time per task · X: 2026-07-31 12:00:05 · Y: 1.54mRun #1312 · Time per task · X: 2026-07-31 13:00:05 · Y: 1.54mRun #1313 · Time per task · X: 2026-07-31 14:00:05 · Y: 1.54mRun #1314 · Time per task · X: 2026-07-31 15:00:05 · Y: 1.54mRun #1315 · Time per task · X: 2026-07-31 16:00:05 · Y: 1.54mRun #1316 · Time per task · X: 2026-07-31 17:00:05 · Y: 1.54mRun #1317 · Time per task · X: 2026-07-31 18:00:05 · Y: 1.55mRun #1318 · Time per task · X: 2026-07-31 19:00:05 · Y: 1.55mRun #1319 · Time per task · X: 2026-07-31 20:00:05 · Y: 1.55mRun #1320 · Time per task · X: 2026-07-31 21:00:05 · Y: 1.55mRun #1321 · Time per task · X: 2026-07-31 22:00:05 · Y: 1.55mRun #1322 · Time per task · X: 2026-07-31 23:00:05 · Y: 1.55mRun #1323 · Time per task · X: 2026-08-01 00:00:05 · Y: 1.55mRun #1324 · Time per task · X: 2026-08-01 01:00:05 · Y: 1.55mRun #1325 · Time per task · X: 2026-08-01 02:00:05 · Y: 1.55mRun #1326 · Time per task · X: 2026-08-01 03:00:05 · Y: 1.55mRun #1327 · Time per task · X: 2026-08-01 04:00:05 · Y: 1.55mRun #1328 · Time per task · X: 2026-08-01 05:00:05 · Y: 1.55mRun #1329 · Time per task · X: 2026-08-01 06:00:05 · Y: 1.55mRun #1330 · Time per task · X: 2026-08-01 07:00:05 · Y: 1.55mRun #1331 · Time per task · X: 2026-08-01 08:00:04 · Y: 1.55mRun #1332 · Time per task · X: 2026-08-01 09:00:05 · Y: 1.55mRun #1333 · Time per task · X: 2026-08-01 10:00:05 · Y: 1.55mRun #1334 · Time per task · X: 2026-08-01 11:00:05 · Y: 1.55mRun #1335 · Time per task · X: 2026-08-01 12:00:05 · Y: 1.55mRun #1336 · Time per task · X: 2026-08-01 13:00:05 · Y: 1.55mRun #1337 · Time per task · X: 2026-08-01 14:00:05 · Y: 1.55mRun #1338 · Time per task · X: 2026-08-01 15:00:05 · Y: 1.55mRun #1339 · Time per task · X: 2026-08-01 16:00:05 · Y: 1.55mRun #1340 · Time per task · X: 2026-08-01 17:00:05 · Y: 1.55mRun #1341 · Time per task · X: 2026-08-01 18:00:05 · Y: 1.55mRun #1342 · Time per task · X: 2026-08-01 19:00:05 · Y: 1.55mRun #1343 · Time per task · X: 2026-08-01 20:00:05 · Y: 1.55mRun #1344 · Time per task · X: 2026-08-01 21:00:05 · Y: 1.55mRun #1345 · Time per task · X: 2026-08-01 22:00:05 · Y: 1.55mRun #1346 · Time per task · X: 2026-08-01 23:00:05 · Y: 1.55mRun #1347 · Time per task · X: 2026-08-02 00:00:05 · Y: 1.55mRun #1348 · Time per task · X: 2026-08-02 01:00:05 · Y: 1.55mRun #1349 · Time per task · X: 2026-08-02 02:00:05 · Y: 1.55mRun #1350 · Time per task · X: 2026-08-02 03:00:05 · Y: 1.58mRun #1351 · Time per task · X: 2026-08-02 04:00:05 · Y: 1.58mRun #1352 · Time per task · X: 2026-08-02 05:00:05 · Y: 1.60mRun #1353 · Time per task · X: 2026-08-02 06:00:05 · Y: 1.60mRun #1354 · Time per task · X: 2026-08-02 07:00:05 · Y: 1.61mRun #1355 · Time per task · X: 2026-08-02 08:00:04 · Y: 1.61mRun #1356 · Time per task · X: 2026-08-02 09:00:05 · Y: 1.61mRun #1357 · Time per task · X: 2026-08-02 10:00:05 · Y: 1.61mRun #1358 · Time per task · X: 2026-08-02 11:00:05 · Y: 1.61mRun #1359 · Time per task · X: 2026-08-02 12:00:05 · Y: 1.61mRun #1360 · Time per task · X: 2026-08-02 13:00:05 · Y: 1.61mRun #1361 · Time per task · X: 2026-08-02 14:00:05 · Y: 1.61mRun #1362 · Time per task · X: 2026-08-02 15:00:06 · Y: 1.61mRun #1363 · Time per task · X: 2026-08-02 16:00:05 · Y: 1.61mRun #1364 · Time per task · X: 2026-08-02 17:00:05 · Y: 1.61mRun #1365 · Time per task · X: 2026-08-02 18:00:05 · Y: 1.61mRun #1366 · Time per task · X: 2026-08-02 19:00:05 · Y: 1.60mRun #1367 · Time per task · X: 2026-08-02 20:00:05 · Y: 1.60mRun #1368 · Time per task · X: 2026-08-02 21:00:05 · Y: 1.60mRun #1369 · Time per task · X: 2026-08-02 22:00:05 · Y: 1.60mRun #1370 · Time per task · X: 2026-08-02 23:00:05 · Y: 1.60mRun #1371 · Time per task · X: 2026-08-03 00:00:05 · Y: 1.60mRun #1372 · Time per task · X: 2026-08-03 01:00:05 · Y: 1.60mRun #1373 · Time per task · X: 2026-08-03 02:00:05 · Y: 1.61mRun #1374 · Time per task · X: 2026-08-03 03:00:05 · Y: 1.61mRun #1375 · Time per task · X: 2026-08-03 04:00:05 · Y: 1.61mRun #1376 · Time per task · X: 2026-08-03 05:00:05 · Y: 1.61mRun #1377 · Time per task · X: 2026-08-03 06:00:05 · Y: 1.61mRun #1378 · Time per task · X: 2026-08-03 07:00:05 · Y: 1.62mRun #1379 · Time per task · X: 2026-08-03 08:00:05 · Y: 1.62mRun #1380 · Time per task · X: 2026-08-03 09:00:05 · Y: 1.62mRun #1381 · Time per task · X: 2026-08-03 10:00:05 · Y: 1.62mRun #1382 · Time per task · X: 2026-08-03 11:00:05 · Y: 1.62mRun #1383 · Time per task · X: 2026-08-03 12:00:05 · Y: 1.62mRun #1384 · Time per task · X: 2026-08-03 13:00:05 · Y: 1.62mRun #1385 · Time per task · X: 2026-08-03 14:00:05 · Y: 1.62mRun #1386 · Time per task · X: 2026-08-03 15:00:05 · Y: 1.62mRun #1387 · Time per task · X: 2026-08-03 16:00:06 · Y: 1.62mRun #1388 · Time per task · X: 2026-08-03 17:00:05 · Y: 1.61mRun #1389 · Time per task · X: 2026-08-03 18:00:05 · Y: 1.61mRun #1390 · Time per task · X: 2026-08-03 19:00:05 · Y: 1.61mRun #1391 · Time per task · X: 2026-08-03 20:00:05 · Y: 1.60mRun #1392 · Time per task · X: 2026-08-03 21:00:05 · Y: 1.60mRun #1393 · Time per task · X: 2026-08-03 22:00:05 · Y: 1.59mRun #1394 · Time per task · X: 2026-08-03 23:00:05 · Y: 1.59mRun #1395 · Time per task · X: 2026-08-04 00:00:05 · Y: 1.59mRun #1396 · Time per task · X: 2026-08-04 01:00:05 · Y: 1.60mRun #1397 · Time per task · X: 2026-08-04 02:00:05 · Y: 1.60mRun #1398 · Time per task · X: 2026-08-04 03:00:05 · Y: 1.60mRun #1399 · Time per task · X: 2026-08-04 04:00:05 · Y: 1.59mRun #1400 · Time per task · X: 2026-08-04 05:00:05 · Y: 1.59mRun #1401 · Time per task · X: 2026-08-04 06:00:05 · Y: 1.59mRun #1402 · Time per task · X: 2026-08-04 07:00:05 · Y: 1.59mRun #1403 · Time per task · X: 2026-08-04 08:00:05 · Y: 1.59mRun #1404 · Time per task · X: 2026-08-04 09:00:05 · Y: 1.59mRun #1405 · Time per task · X: 2026-08-04 10:00:05 · Y: 1.60mRun #1406 · Time per task · X: 2026-08-04 11:00:05 · Y: 1.60mRun #1407 · Time per task · X: 2026-08-04 12:00:05 · Y: 1.60mRun #1408 · Time per task · X: 2026-08-04 13:00:06 · Y: 1.60mRun #1409 · Time per task · X: 2026-08-04 14:00:05 · Y: 1.60mRun #1410 · Time per task · X: 2026-08-04 15:00:05 · Y: 1.60mRun #1411 · Time per task · X: 2026-08-04 16:00:06 · Y: 1.60mRun #1412 · Time per task · X: 2026-08-04 17:00:06 · Y: 1.62mRun #1413 · Time per task · X: 2026-08-04 18:00:29 · Y: 1.62mRun #1414 · Time per task · X: 2026-08-04 19:00:29 · Y: 1.62mRun #1415 · Time per task · X: 2026-08-04 20:00:29 · Y: 1.64mRun #1416 · Time per task · X: 2026-08-04 21:00:29 · Y: 1.64mRun #1417 · Time per task · X: 2026-08-04 22:00:29 · Y: 1.64mRun #1418 · Time per task · X: 2026-08-04 23:00:30 · Y: 1.64mRun #1419 · Time per task · X: 2026-08-05 00:00:29 · Y: 1.64m
Run?Fetched?Score?Quality?Cost/task?Time/task?Intel?Code?Agent?MMMU%?
#1419 2026-08-05 00:00:29 7.8 7.8 $0.0149 1.64m 12.2 9.4 1.8 51.4
#1418 2026-08-04 23:00:30 7.8 7.8 $0.0149 1.64m 12.2 9.4 1.8 51.4
#1417 2026-08-04 22:00:29 7.8 7.8 $0.0149 1.64m 12.2 9.4 1.8 51.4
#1416 2026-08-04 21:00:29 7.8 7.8 $0.0149 1.64m 12.2 9.4 1.8 51.4
#1415 2026-08-04 20:00:29 7.8 7.8 $0.0149 1.64m 12.2 9.4 1.8 51.4
#1414 2026-08-04 19:00:29 7.8 7.8 $0.0149 1.62m 12.2 9.4 1.8 51.4
#1413 2026-08-04 18:00:29 7.8 7.8 $0.0149 1.62m 12.2 9.4 1.8 51.4
#1412 2026-08-04 17:00:06 7.8 7.8 $0.0149 1.62m 12.2 9.4 1.8 51.4
#1411 2026-08-04 16:00:06 7.8 7.8 $0.0149 1.60m 12.2 9.4 1.8 51.4
#1410 2026-08-04 15:00:05 7.8 7.8 $0.0149 1.60m 12.2 9.4 1.8 51.4
#1409 2026-08-04 14:00:05 7.8 7.8 $0.0149 1.60m 12.2 9.4 1.8 51.4
#1408 2026-08-04 13:00:06 7.8 7.8 $0.0149 1.60m 12.2 9.4 1.8 51.4
#1407 2026-08-04 12:00:05 7.8 7.8 $0.0149 1.60m 12.2 9.4 1.8 51.4
#1406 2026-08-04 11:00:05 7.8 7.8 $0.0149 1.60m 12.2 9.4 1.8 51.4
#1405 2026-08-04 10:00:05 7.8 7.8 $0.0149 1.60m 12.2 9.4 1.8 51.4
#1404 2026-08-04 09:00:05 7.8 7.8 $0.0149 1.59m 12.2 9.4 1.8 51.4
#1403 2026-08-04 08:00:05 7.8 7.8 $0.0149 1.59m 12.2 9.4 1.8 51.4
#1402 2026-08-04 07:00:05 7.8 7.8 $0.0149 1.59m 12.2 9.4 1.8 51.4
#1401 2026-08-04 06:00:05 7.8 7.8 $0.0149 1.59m 12.2 9.4 1.8 51.4
#1400 2026-08-04 05:00:05 7.8 7.8 $0.0149 1.59m 12.2 9.4 1.8 51.4
#1399 2026-08-04 04:00:05 7.8 7.8 $0.0149 1.59m 12.2 9.4 1.8 51.4
#1398 2026-08-04 03:00:05 7.8 7.8 $0.0149 1.60m 12.2 9.4 1.8 51.4
#1397 2026-08-04 02:00:05 7.8 7.8 $0.0149 1.60m 12.2 9.4 1.8 51.4
#1396 2026-08-04 01:00:05 7.8 7.8 $0.0149 1.60m 12.2 9.4 1.8 51.4
#1395 2026-08-04 00:00:05 7.8 7.8 $0.0149 1.59m 12.2 9.4 1.8 51.4
#1394 2026-08-03 23:00:05 7.8 7.8 $0.0149 1.59m 12.2 9.4 1.8 51.4
#1393 2026-08-03 22:00:05 7.8 7.8 $0.0149 1.59m 12.2 9.4 1.8 51.4
#1392 2026-08-03 21:00:05 7.8 7.8 $0.0149 1.60m 12.2 9.4 1.8 51.4
#1391 2026-08-03 20:00:05 7.8 7.8 $0.0149 1.60m 12.2 9.4 1.8 51.4
#1390 2026-08-03 19:00:05 7.8 7.8 $0.0149 1.61m 12.2 9.4 1.8 51.4
#1389 2026-08-03 18:00:05 7.8 7.8 $0.0149 1.61m 12.2 9.4 1.8 51.4
#1388 2026-08-03 17:00:05 7.8 7.8 $0.0149 1.61m 12.2 9.4 1.8 51.4
#1387 2026-08-03 16:00:06 7.8 7.8 $0.0149 1.62m 12.2 9.4 1.8 51.4
#1386 2026-08-03 15:00:05 7.8 7.8 $0.0149 1.62m 12.2 9.4 1.8 51.4
#1385 2026-08-03 14:00:05 7.8 7.8 $0.0149 1.62m 12.2 9.4 1.8 51.4
#1384 2026-08-03 13:00:05 7.8 7.8 $0.0149 1.62m 12.2 9.4 1.8 51.4
#1383 2026-08-03 12:00:05 7.8 7.8 $0.0149 1.62m 12.2 9.4 1.8 51.4
#1382 2026-08-03 11:00:05 7.8 7.8 $0.0149 1.62m 12.2 9.4 1.8 51.4
#1381 2026-08-03 10:00:05 7.8 7.8 $0.0149 1.62m 12.2 9.4 1.8 51.4
#1380 2026-08-03 09:00:05 7.8 7.8 $0.0149 1.62m 12.2 9.4 1.8 51.4
#1379 2026-08-03 08:00:05 7.8 7.8 $0.0149 1.62m 12.2 9.4 1.8 51.4
#1378 2026-08-03 07:00:05 7.8 7.8 $0.0149 1.62m 12.2 9.4 1.8 51.4
#1377 2026-08-03 06:00:05 7.8 7.8 $0.0149 1.61m 12.2 9.4 1.8 51.4
#1376 2026-08-03 05:00:05 7.8 7.8 $0.0149 1.61m 12.2 9.4 1.8 51.4
#1375 2026-08-03 04:00:05 7.8 7.8 $0.0149 1.61m 12.2 9.4 1.8 51.4
#1374 2026-08-03 03:00:05 7.8 7.8 $0.0149 1.61m 12.2 9.4 1.8 51.4
#1373 2026-08-03 02:00:05 7.8 7.8 $0.0149 1.61m 12.2 9.4 1.8 51.4
#1372 2026-08-03 01:00:05 7.8 7.8 $0.0149 1.60m 12.2 9.4 1.8 51.4
#1371 2026-08-03 00:00:05 7.8 7.8 $0.0149 1.60m 12.2 9.4 1.8 51.4
#1370 2026-08-02 23:00:05 7.8 7.8 $0.0149 1.60m 12.2 9.4 1.8 51.4
#1369 2026-08-02 22:00:05 7.8 7.8 $0.0149 1.60m 12.2 9.4 1.8 51.4
#1368 2026-08-02 21:00:05 7.8 7.8 $0.0149 1.60m 12.2 9.4 1.8 51.4
#1367 2026-08-02 20:00:05 7.8 7.8 $0.0149 1.60m 12.2 9.4 1.8 51.4
#1366 2026-08-02 19:00:05 7.8 7.8 $0.0149 1.60m 12.2 9.4 1.8 51.4
#1365 2026-08-02 18:00:05 7.8 7.8 $0.0149 1.61m 12.2 9.4 1.8 51.4
#1364 2026-08-02 17:00:05 7.8 7.8 $0.0149 1.61m 12.2 9.4 1.8 51.4
#1363 2026-08-02 16:00:05 7.8 7.8 $0.0149 1.61m 12.2 9.4 1.8 51.4
#1362 2026-08-02 15:00:06 7.8 7.8 $0.0149 1.61m 12.2 9.4 1.8 51.4
#1361 2026-08-02 14:00:05 7.8 7.8 $0.0149 1.61m 12.2 9.4 1.8 51.4
#1360 2026-08-02 13:00:05 7.8 7.8 $0.0149 1.61m 12.2 9.4 1.8 51.4
#1359 2026-08-02 12:00:05 7.8 7.8 $0.0149 1.61m 12.2 9.4 1.8 51.4
#1358 2026-08-02 11:00:05 7.8 7.8 $0.0149 1.61m 12.2 9.4 1.8 51.4
#1357 2026-08-02 10:00:05 7.8 7.8 $0.0149 1.61m 12.2 9.4 1.8 51.4
#1356 2026-08-02 09:00:05 7.8 7.8 $0.0149 1.61m 12.2 9.4 1.8 51.4
#1355 2026-08-02 08:00:04 7.8 7.8 $0.0149 1.61m 12.2 9.4 1.8 51.4
#1354 2026-08-02 07:00:05 7.8 7.8 $0.0149 1.61m 12.2 9.4 1.8 51.4
#1353 2026-08-02 06:00:05 7.8 7.8 $0.0149 1.60m 12.2 9.4 1.8 51.4
#1352 2026-08-02 05:00:05 7.8 7.8 $0.0149 1.60m 12.2 9.4 1.8 51.4
#1351 2026-08-02 04:00:05 7.8 7.8 $0.0149 1.58m 12.2 9.4 1.8 51.4
#1350 2026-08-02 03:00:05 7.8 7.8 $0.0149 1.58m 12.2 9.4 1.8 51.4
#1349 2026-08-02 02:00:05 7.8 7.8 $0.0149 1.55m 12.2 9.4 1.8 51.4
#1348 2026-08-02 01:00:05 7.8 7.8 $0.0149 1.55m 12.2 9.4 1.8 51.4
#1347 2026-08-02 00:00:05 7.8 7.8 $0.0149 1.55m 12.2 9.4 1.8 51.4
#1346 2026-08-01 23:00:05 7.8 7.8 $0.0149 1.55m 12.2 9.4 1.8 51.4
#1345 2026-08-01 22:00:05 7.8 7.8 $0.0149 1.55m 12.2 9.4 1.8 51.4
#1344 2026-08-01 21:00:05 7.8 7.8 $0.0149 1.55m 12.2 9.4 1.8 51.4
#1343 2026-08-01 20:00:05 7.8 7.8 $0.0149 1.55m 12.2 9.4 1.8 51.4
#1342 2026-08-01 19:00:05 7.8 7.8 $0.0149 1.55m 12.2 9.4 1.8 51.4
#1341 2026-08-01 18:00:05 7.8 7.8 $0.0149 1.55m 12.2 9.4 1.8 51.4
#1340 2026-08-01 17:00:05 7.8 7.8 $0.0149 1.55m 12.2 9.4 1.8 51.4
#1339 2026-08-01 16:00:05 7.8 7.8 $0.0149 1.55m 12.2 9.4 1.8 51.4
#1338 2026-08-01 15:00:05 7.8 7.8 $0.0149 1.55m 12.2 9.4 1.8 51.4
#1337 2026-08-01 14:00:05 7.8 7.8 $0.0149 1.55m 12.2 9.4 1.8 51.4
#1336 2026-08-01 13:00:05 7.8 7.8 $0.0149 1.55m 12.2 9.4 1.8 51.4
#1335 2026-08-01 12:00:05 7.8 7.8 $0.0149 1.55m 12.2 9.4 1.8 51.4
#1334 2026-08-01 11:00:05 7.8 7.8 $0.0149 1.55m 12.2 9.4 1.8 51.4
#1333 2026-08-01 10:00:05 7.8 7.8 $0.0149 1.55m 12.2 9.4 1.8 51.4
#1332 2026-08-01 09:00:05 7.8 7.8 $0.0149 1.55m 12.2 9.4 1.8 51.4
#1331 2026-08-01 08:00:04 7.8 7.8 $0.0149 1.55m 12.2 9.4 1.8 51.4
#1330 2026-08-01 07:00:05 7.8 7.8 $0.0149 1.55m 12.2 9.4 1.8 51.4
#1329 2026-08-01 06:00:05 7.8 7.8 $0.0149 1.55m 12.2 9.4 1.8 51.4
#1328 2026-08-01 05:00:05 7.8 7.8 $0.0149 1.55m 12.2 9.4 1.8 51.4
#1327 2026-08-01 04:00:05 7.8 7.8 $0.0149 1.55m 12.2 9.4 1.8 51.4
#1326 2026-08-01 03:00:05 7.8 7.8 $0.0149 1.55m 12.2 9.4 1.8 51.4
#1325 2026-08-01 02:00:05 7.8 7.8 $0.0149 1.55m 12.2 9.4 1.8 51.4
#1324 2026-08-01 01:00:05 7.8 7.8 $0.0149 1.55m 12.2 9.4 1.8 51.4
#1323 2026-08-01 00:00:05 7.8 7.8 $0.0149 1.55m 12.2 9.4 1.8 51.4
#1322 2026-07-31 23:00:05 7.8 7.8 $0.0149 1.55m 12.2 9.4 1.8 51.4
#1321 2026-07-31 22:00:05 7.8 7.8 $0.0149 1.55m 12.2 9.4 1.8 51.4
#1320 2026-07-31 21:00:05 7.8 7.8 $0.0149 1.55m 12.2 9.4 1.8 51.4
#1319 2026-07-31 20:00:05 7.8 7.8 $0.0149 1.55m 12.2 9.4 1.8 51.4
#1318 2026-07-31 19:00:05 7.8 7.8 $0.0149 1.55m 12.2 9.4 1.8 51.4
#1317 2026-07-31 18:00:05 7.8 7.8 $0.0149 1.55m 12.2 9.4 1.8 51.4
#1316 2026-07-31 17:00:05 7.8 7.8 $0.0149 1.54m 12.2 9.4 1.8 51.4
#1315 2026-07-31 16:00:05 7.8 7.8 $0.0149 1.54m 12.2 9.4 1.8 51.4
#1314 2026-07-31 15:00:05 7.8 7.8 $0.0149 1.54m 12.2 9.4 1.8 51.4
#1313 2026-07-31 14:00:05 7.8 7.8 $0.0149 1.54m 12.2 9.4 1.8 51.4
#1312 2026-07-31 13:00:05 7.8 7.8 $0.0149 1.54m 12.2 9.4 1.8 51.4
#1311 2026-07-31 12:00:05 7.8 7.8 $0.0149 1.54m 12.2 9.4 1.8 51.4
#1310 2026-07-31 11:00:05 7.8 7.8 $0.0149 1.54m 12.2 9.4 1.8 51.4
#1309 2026-07-31 10:00:05 7.8 7.8 $0.0149 1.54m 12.2 9.4 1.8 51.4
#1308 2026-07-31 09:00:13 7.8 7.8 $0.0149 1.54m 12.2 9.4 1.8 51.4
#1307 2026-07-31 08:00:13 7.8 7.8 $0.0149 1.54m 12.2 9.4 1.8 51.4
#1306 2026-07-31 07:00:13 7.8 7.8 $0.0149 1.54m 12.2 9.4 1.8 51.4
#1305 2026-07-31 06:00:13 7.8 7.8 $0.0132 1.37m 12.2 9.4 1.8 51.4
#1304 2026-07-31 05:00:13 7.8 7.8 $0.0132 1.37m 12.2 9.4 1.8 51.4
#1303 2026-07-31 04:00:13 7.8 7.8 $0.0132 1.37m 12.2 9.4 1.8 51.4
#1302 2026-07-31 03:00:13 7.8 7.8 $0.0132 1.37m 12.2 9.4 1.8 51.4
#1301 2026-07-31 02:00:13 7.8 7.8 $0.0132 1.37m 12.2 9.4 1.8 51.4
#1300 2026-07-31 01:00:13 7.8 7.8 $0.0132 1.37m 12.2 9.4 1.8 51.4